Home>Courses>Advanced pandas—Going Beyond the Basics

Advanced pandas—Going Beyond the Basics

Explore advanced pandas techniques for reshaping, manipulating, and handling data. Gain insights into using unconventional features and extended libraries to streamline workflows and enhance data analysis.

Intermediate

94 Lessons

16h

Certificate of Completion

AI-POWERED

Explanations

AI-POWERED

Explanations

This course includes

584 Playgrounds

10 Quizzes

Course Overview

What You'll Learn

Course Content

Apply Your Skills

Recommendations

Course Overview

Pandas is an easy-to-use and performant Python library for data manipulation and analysis. It is an important toolkit in a world where the volume of data created and captured is growing exponentially. In this course, you’ll discover an in-depth exploration of the pandas library. The course covers advanced techniques to reshape data, manipulate data, and handle various data types. You will also learn how to use less conventional pandas features to streamline workflows, while also leveraging extended pandas...Show More

TAKEAWAY SKILLS

Python

Data Manipulation

Data Plotting

Data Extraction

Data Statistics

Data Science

Analysis Tools

Python 3

Data Collection

Data Cleaning

Data Visualisation

Data Analysis

Data types

Python Programming

Polars

Time Series Analysis

Data Storytelling

What You'll Learn

Understanding of pandas’ extensive capabilities in reading data from different sources

Working knowledge of how to effectively handle different types of data in pandas

Hands-on experience using data reshaping and manipulation techniques in pandas

Ability to leverage extended pandas libraries for advanced capabilities in handling and analyzing data

Familiarity with less conventional yet useful features of pandas

Knowledge of efficiency boosting techniques

Understanding of pandas’ extensive capabilities in reading data from different sources

Course Content

Before We Begin

1 Lessons

Get familiar with advanced pandas for data manipulation, transformation, and visualization skills.

Course Introduction

Reading Data into pandas

8 Lessons

Get started with reading diverse data formats into pandas for efficient analysis.

Importance of Data Ingestion

Read Data from the Web

Read Data from HTML Files

Read Data from XML Files

Read Data from Statistical Software Files

Read Data from SQL Databases

Read Data from Binary Files (Feather, HDF5, ORC, Parquet)

Quiz

Combining Data

7 Lessons

Examine methods for combining and merging pandas DataFrames to enhance data manipulation.

Importance of Combining Data

Concatenate

Merging—Types of Joins

Merge 2—Implementation

Merging—Scenarios

Combine and Update

Quiz

Reshaping and Manipulating Data

13 Lessons

Enhance your skills in reshaping and manipulating data for effective analysis in pandas.

Importance of Reshaping and Manipulating Data

GroupBy—The groupby() method

GroupBy—Aggregate

GroupBy—Transform and Filter

GroupBy—Further Useful Features

Pivot—Long and Wide Formats

Pivot—The pivot() method

Unpivot

Stack and Unstack

Further Reshaping Capabilities

Advanced Indexing 1

Advanced Indexing 2

Quiz

Encoding Data Types

2 Lessons

Take a closer look at inspecting, converting, and encoding data types in pandas.

Inspect Data Types

Convert and Encode Data Types

Handling Numerical Data

10 Lessons

Focus on advanced arithmetic, comparison, filtering, and statistical methods using pandas.

Arithmetic Operations 1

Arithmetic Operations 2

Comparison Operations

Filtering

Ordered Numerical Data

Discretize and Clip Data

Statistical Methods

Cumulative Operations

Apply Custom Functions

Quiz

Handling Categorical Data

6 Lessons

Master handling and transforming categorical data for efficient and meaningful analysis using pandas.

Encode Categorical Data

Modify Categorical Data

Comparison and Other Common Operations

Factorize and Cross-Tabulate

Other Features and Properties

Quiz

Handling Text Data

7 Lessons

Learn how to use pandas methods for transforming and managing complex text data efficiently.

Text Data Types

String Methods—Basic Transformations and Checks

String Methods—Slice, Split, and Partition

String Methods—Concatenate and Match

String Methods—Find, Extract, and Replace

String Methods—Leading and Trailing Characters

Quiz

Handling Time Series Data

17 Lessons

Unpack the core of advanced pandas techniques for time series analysis, manipulation, and resampling.

Time Series Data Types

Time Series Indexes—Creating Indexes

Time Series Indexes—Slice and Index

Time Series Indexes—Attributes

Time Series Indexes—Methods

Arithmetic Operations with Timedelta and DateOffset

Closer Look at Time Deltas

Business Dates and Holidays

Business Hours

Time Zones

Timeseries Merging

Resampling—Upsample and Downsample

Resampling—Aggregation and Other Parameters

Shifting and Frequency Conversion

Window Operations—Rolling

Window Operations—Weighted, Expanding, and Exponential Moving

Quiz

10.

Handling Sparse Data Structures

2 Lessons

Break apart the techniques for handling and optimizing sparse data structures using pandas.

Sparse Arrays

Accessors and Operations

11.

Handling Missing Data

4 Lessons

Grasp the fundamentals of representing, detecting, and managing missing data in pandas.

Missing Data Representation

Missing Data Detection and Calculations

Managing Missing Data

Quiz

12.

Leveraging Further Features of pandas

6 Lessons

Solve problems in advanced pandas features like function chaining, assertions, styling, settings, and efficiency.

Function Chaining with pipe()

Assertion Functions

DataFrame Table Styles

Option Settings

Efficiency Boosts

Quiz

13.

Utilizing Extended Libraries

5 Lessons

Follow the process of leveraging advanced libraries to enhance data analysis with pandas.

14.

Wrap Up

1 Lessons

Build on essential pandas skills for advanced data handling and real-world applications.

Conclusion

15.

Appendix

5 Lessons

Learn how to use setups, prerequisites, and updates for advanced pandas functionalities.

What's New in pandas 2.0

Setup Requirements

Overview of Statistical Software and Binary File Formats

Prerequisite Setup for Reading Data into pandas

Prerequisite Setup for Utilizing Extended Libraries

Course Author

Kenneth Leung

Project

Unveil Smart Offers through RFM Intelligence

intermediate

1 hour 40 min

Project

Unveil Smart Offers through RFM Intelligence

Utilize RFM intelligence and machine learning for tailored customer offers to enhance loyalty and marketing efficiency.

intermediate

1 hour 40 mins

Trusted by 2.5 million developers working at companies

"These are high-quality courses. Trust me. I own around 10 and the price is worth it for the content quality. EducativeInc came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks"

Anthony Walker

@_webarchitect_

"Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!"

Evan Dunbar

ML Engineer

"You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it."

Carlos Matias La Borde

Software Developer

"I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site"

Souvik Kundu

Front-end Developer

"Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content."

Vinay Krishnaiah

Software Developer

"I've tried probably 5-7 different sites and Educative is easily the best. It perfectly blends explanation with interactivity"

Eric Downs

Musician/Entrepeneur

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Instant Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

AI-Powered Mock Interviews

Put your skills to the test in a simulated interview setting. Receive personalized feedback based on your performance. Available in Premium & Premium Plus plans.

Adaptive Learning

At various checkpoints throughout Educative courses, you will be prompted to take a quick assessment. Receive a condensed curriculum tailored to your strengths and skill gaps.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

Recommended before starting this course

Course

Mastering Data Analysis with Python Pandas

Gain insights into using Python Pandas for efficient data analysis and manipulation. Delve into detailed functions, parameters, and methods to elevate your data handling skills.

beginner

2 hours 25 mins

Course

Effective Data Manipulation with pandas

Delve into effective data manipulation with pandas. Discover filtering, merging, grouping, and reshaping techniques through hands-on examples, best practices, and performance tips for real-world analysis.

beginner

24 hours

Course

A Practical Guide to Machine Learning with Python

Explore practical coding of basic machine learning models using Python. Gain insights into algorithms like linear regression, logistic regression, SVM, KNN, and decision trees.

beginner

72 hours 30 mins

Course

Mastering Data Analysis with Python Pandas

beginner

2 hour 25 min

Course

Effective Data Manipulation with pandas

beginner

24 hour

Course

A Practical Guide to Machine Learning with Python

beginner

72 hour 30 min

Related Courses and Skill Paths

Course

Data Analysis & Processing with Pandas

Gain insights into Pandas' powerful tools for data analysis. Learn about Series, DataFrames, and optimize performance for data operations, filtering, and file uploads in data science and machine learning.

intermediate

4 hours

Course

Pandas Brain Teasers

Explore puzzles designed to enhance your critical thinking and problem-solving skills using pandas. Gain insights into common pitfalls and sharpen your data manipulation techniques.

intermediate

1 hour 20 mins

Course

Machine Learning with NumPy, pandas, scikit-learn, and More

Delve into practical machine learning with NumPy, pandas, scikit-learn, and more. Gain insights into data analysis, feature engineering, and deep learning using industry-standard frameworks. Basic Python required.

intermediate

15 hours

Course

Data Analysis & Processing with Pandas

Machine Learning with NumPy, pandas, scikit-learn, and More