Home>Courses>Effective Data Manipulation with pandas

Effective Data Manipulation with pandas

Delve into effective data manipulation with pandas. Discover filtering, merging, grouping, and reshaping techniques through hands-on examples, best practices, and performance tips for real-world analysis.

Beginner

89 Lessons

24h

Certificate of Completion

AI-POWERED

Explanations

AI-POWERED

Explanations

This course includes

564 Playgrounds

17 Quizzes

Course Overview

What You'll Learn

Course Content

Recommendations

Course Overview

The course is a comprehensive guide to using pandas for data analysis. It covers a wide range of topics related to data manipulation, including filtering, merging, grouping, pivoting, and reshaping data. In this course, you’ll learn about the best practices and efficient techniques for working with data. You’ll be provided with numerous examples of real-world data analysis problems and gain hands-on experience with the pandas library to solve them effectively. This course will also cover performance consid...Show More

What You'll Learn

An understanding of efficient data manipulation techniques for working with data in pandas

Working knowledge of different techniques for handling missing data in pandas

The ability to reshape and pivot data

Hands-on experience of the best practices for working with pandas

An understanding of efficient data manipulation techniques for working with data in pandas

Course Content

Introduction

10 Lessons

Get familiar with pandas data structures for efficient data manipulation in Python.

Similarities in pandas and NumPy

Categorical Data in pandas

Exercise: Series in pandas

Solution: Series in pandas

Summary

Quiz: pandas Series

Series Deep Dive

27 Lessons

Unpack the core of pandas Series manipulation, covering attributes, operations, and data cleaning.

Data Loading and Series Attributes

Operators and Dunder Methods

Aggregate Methods

Exercise: Aggregate Methods

Solution: Aggregate Methods

Conversion Methods

Manipulation Methods

Quiz: Methods in Series

Conditional Methods

Handling Missing Data

Other Manipulation Methods

Data Cleaning

Quiz: Duplicate values and NaN

Indexing Operations

Indexing Operations (.iloc)

Exercise: Data Manipulation and Indexing

Solution: Data Manipulation and Indexing

Quiz: Indexing, Manipulation Methods, and Data Cleaning

String Manipulation

Optimizing Manipulations Using Cython

Date and Time Manipulation

Dates in the Index

Quiz: String Manipulation, Date-Time Manipulation, and DT Indexing

Plotting with a Series: Histogram, Box Plot, and Kernel Density

Plotting with a Series: Line, Bar, and Pie Plots

Categorical Manipulation

Quiz: Plotting and Categorical Data

DataFrames

29 Lessons

Examine building, manipulating, and visualizing DataFrames in pandas for effective data analysis.

Introduction to DataFrames

Math Methods on DataFrames

Quiz: DataFrames and Math Methods on DataFrames

Exercise: DataFrames in pandas

Solution: DataFrames in pandas

Looping and Aggregation

The apply() Method

Exercise: Looping, Aggregation and apply() Method

Solution: Looping, Aggregation, and apply() Method

Columns Types, .assign, and Memory Usage

Creating and Updating Columns

Dealing with Missing and Duplicated Data

Quiz: Missing and Duplicated Data

Sorting Columns and Indexes

Filtering and Indexing Operations

Indexing by Position

Indexing by Name

Filtering with Function and .loc

Line and Bar Plots

Scatter, Area, and Stacked Bar Plots

Exercise: Sorting, Columns, Filtering, and Indexing Operations.

Solution: Sorting, Columns, Filtering, and Indexing Operations

Exercise: Plotting

Solution: Plotting

Quiz: Sorting Columns, Filtering, and Indexing Operations.

Reshaping DataFrames with Dummies

Reshaping by Pivoting and Grouping

Aggregations

Manipulating Data

21 Lessons

Grasp the fundamentals of manipulating and reshaping data, handling time series, joins, and exporting formats.

Grouping

More Aggregations

Cross-tabulation Deep Dive

Exercise: Reshaping/Aggregations

Solution: Reshaping/Aggregations

Quiz: Reshaping, Pivot Tables, Aggregations

Melting and Transposing Data

Stacking and Flattening Data

Quiz: Melting, Transposing, Stacking, and Unstacking Data

Working with Time Series

Adding Rows and Columns in a DataFrame

Joins in DataFrames

Joining Real-World Datasets

Quiz: Joining in pandas

Exporting Data to CSV and Excel

Exporting Data to Feather, SQL, and JSON

Styling DataFrames

Checking if DataFrames are Equal

Debugging Chains

Debugging apply (and friends)

Debugging Memory Usage and Timing Information

Wrapping Up

1 Lessons

Explore continuous improvement in data analysis, from understanding data to engaging in real-world projects.

Conclusion

Appendix

1 Lessons

Follow the process of installing and setting up pandas for Python projects.

Installation

Trusted by 2.5 million developers working at companies

"These are high-quality courses. Trust me. I own around 10 and the price is worth it for the content quality. EducativeInc came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks"

Anthony Walker

@_webarchitect_

"Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!"

Evan Dunbar

ML Engineer

"You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it."

Carlos Matias La Borde

Software Developer

"I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site"

Souvik Kundu

Front-end Developer

"Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content."

Vinay Krishnaiah

Software Developer

"I've tried probably 5-7 different sites and Educative is easily the best. It perfectly blends explanation with interactivity"

Eric Downs

Musician/Entrepeneur

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Instant Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

AI-Powered Mock Interviews

Put your skills to the test in a simulated interview setting. Receive personalized feedback based on your performance. Available in Premium & Premium Plus plans.

Adaptive Learning

At various checkpoints throughout Educative courses, you will be prompted to take a quick assessment. Receive a condensed curriculum tailored to your strengths and skill gaps.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

Recommended before starting this course

Course

Learn to Code: Python for Absolute Beginners

Want to learn how to code? Get hands-on with Python for beginners. Master the basics, solve real-world problems, and confidently build in-demand Python skills for diverse industries.

beginner

8 hours

Course

Python 101: Interactively learn how to program with Python 3

This is a 101-level course in Python that will help you learn to program in Python for free.

beginner

10 hours

Course

Python 201 - Interactively Learn Advanced Concepts in Python 3

Delve into intermediate and advanced Python: explore key modules, understand Unicode, generators, iterators, master web tasks and effective code testing for enhanced programming skills.

intermediate

11 hours

Course

Learn to Code: Python for Absolute Beginners

beginner

8 hour

Course

Python 101: Interactively learn how to program with Python 3

beginner

10 hour

Course

Python 201 - Interactively Learn Advanced Concepts in Python 3

intermediate

11 hour

Related Courses and Skill Paths

Course

Introduction to Data Science with Python

Delve into foundational Python programming, explore libraries like pandas and Matplotlib, and gain insights into data management, analysis, and visualization with practical projects.

beginner

4 hours 10 mins

Course

Machine Learning with NumPy, pandas, scikit-learn, and More

Delve into practical machine learning with NumPy, pandas, scikit-learn, and more. Gain insights into data analysis, feature engineering, and deep learning using industry-standard frameworks. Basic Python required.

intermediate

15 hours

Course

Data Analytics Interview Prep Using Pandas

The ultimate guide to data analytics interviews using Pandas. Strengthen your skills with advanced concepts and practice with real-world interview questions. Developed by FAANG engineers.

beginner

2 hours 30 mins

Course

Introduction to Data Science with Python

beginner

4 hour 10 min

Course

Machine Learning with NumPy, pandas, scikit-learn, and More

intermediate

15 hour

Course

Data Analytics Interview Prep Using Pandas