© 2020

Thinking in Pandas

How to Use the Python Data Analysis Library the Right Way

  • Establishes a foundation of understanding by exploring the underlying data structures that pandas is built on

  • Guides the reader through architecting a pandas based solution by emphasizing performance

  • Uses simple, practical, and exploratory examples to empower the reader to recognize when to use a given pandas feature


Table of contents

  1. Front Matter
    Pages i-xi
  2. Hannah Stepanek
    Pages 1-7
  3. Hannah Stepanek
    Pages 9-30
  4. Hannah Stepanek
    Pages 31-64
  5. Hannah Stepanek
    Pages 65-108
  6. Hannah Stepanek
    Pages 109-119
  7. Hannah Stepanek
    Pages 121-133
  8. Hannah Stepanek
    Pages 135-140
  9. Hannah Stepanek
    Pages 141-155
  10. Hannah Stepanek
    Pages 157-169
  11. Back Matter
    Pages 171-186

About this book


Understand and implement big data analysis solutions in pandas with an emphasis on performance. This book strengthens your intuition for working with pandas, the Python data analysis library, by exploring its underlying implementation and data structures.

Thinking in Pandas introduces the topic of big data and demonstrates concepts by looking at exciting and impactful projects that pandas helped to solve. From there, you will learn to assess your own projects by size and type to see if pandas is the appropriate library for your needs. Author Hannah Stepanek explains how to load and normalize data in pandas efficiently, and reviews some of the most commonly used loaders and several of their most powerful options. You will then learn how to access and transform data efficiently, what methods to avoid, and when to employ more advanced performance techniques. You will also go over basic data access and munging in pandas and the intuitive dictionary syntax. Choosing the right DataFrame format, working with multi-level DataFrames, and how pandas might be improved upon in the future are also covered.

By the end of the book, you will have a solid understanding of how the pandas library works under the hood. Get ready to make confident decisions in your own projects by utilizing pandas—the right way.

You will:

  • Understand the underlying data structure of pandas and why it performs the way it does under certain circumstances
  • Discover how to use pandas to extract, transform, and load data correctly with an emphasis on performance
  • Choose the right DataFrame so that the data analysis is simple and efficient.
  • Improve performance of pandas operations with other Python libraries


Pandas Python Big Data Data Frame Data Analysis High Performance Python Data Processing

Authors and affiliations

  1. 1.PortlandUSA

About the authors

Hannah Stepanek is a software developer with a passion for performance and is an open source advocate. She has over seven years of industry experience programming in Python and spent about two of those years implementing a data analysis project using pandas.

Hannah was born and raised in Corvallis, OR, and graduated from Oregon State University with a major in Electrical Computer Engineering. She enjoys engaging with the software community, often giving talks at local meetups as well as larger conferences. In early 2019, she spoke at PyCon US about the pandas library and at OpenCon Cascadia about the benefits of open source software. In her spare time she enjoys riding her horse Sophie and playing board games.

Bibliographic information

Industry Sectors
Chemical Manufacturing
IT & Software
Finance, Business & Banking
Oil, Gas & Geosciences