Python Polars: The Definitive Guide

   

Welcome to the official repository of the book Python Polars: The Definitive Guide by Jeroen Janssens and Thijs Nieuwdorp. The book is still being written and is scheduled to be published by O'Reilly in November 2024.

• Read the Early Release version on the O'Reilly Learning Platform.
• Become a member of the Polars Discord server to discuss anything related to Polars and to download Early Release PDFs from the #book-the-definitive-guide channel.

Description

Get ready to speed up your data analysis and start working with larger-than-memory datasets. Polars offers a blazingly fast, multi-threaded, elegant API for data loading, manipulation, and processing. Authors Jeroen Janssens and Thijs Nieuwdorp walk you through every aspect of Python Polars as they tackle practical use cases using real-world datasets. You’ll not only learn the syntax, but also understand the underlying concepts. You don’t need to have any experience with Pandas or Spark, but if you do, this book will help you make a smooth transition.

With this definitive guide at your side, you’ll be able to:

• Process larger-than-memory datasets at record speed
• Apply the eager, lazy, and streaming APIs of Polars and decide when to use which
• Transition smoothly from Pandas or Spark to Polars
• Integrate Polars into your existing codebase
• Work with Arrow and Parquet to efficiently read and write data
• Translate complex ETL tasks into efficient and elegant queries

Outline

Note that this outline is subject to change.

Front matter

• Foreword by Ritchie Vink, creator of Polars
• Acknowledgements

Part 1: Begin

1. Introducing Polars
2. First Steps
3. Transitioning from Pandas to Polars
4. Transitioning from Spark to Polars

Part 2: Load

5. Data Types and Data Structures
6. Eager and Lazy APIs
7. Reading and Writing Data

Part 3: Express

8. Beginning Expressions
9. Continuing Expressions
10. Combining Expressions

Part 4: Transform

11. Selecting and Creating Columns
12. Filtering and Sorting Rows
13. Working with Special Data Types
14. Summarizing and Aggregating
15. Joining and Concatenating
16. Reshaping

Part 5: Advance

17. Creating Visualizations
18. Extending Polars
19. SQL with Polars
20. Debugging and Testing with Polars
21. Polars Internals
22. Integrating with Other Tools