Home>Courses>Data Science Projects with Python

Data Science Projects with Python

Delve into data science with Python by exploring datasets, building models, and learning logistic regression, decision trees, gradient boosting, and SHAP values. Gain insights into deploying and monitoring models.

Beginner

98 Lessons

24h

Certificate of Completion

AI-POWERED

Explanations

AI-POWERED

Explanations

This course includes

7 Projects

52 Playgrounds

7 Quizzes

Course Overview

What You'll Learn

Course Content

Apply Your Skills

Recommendations

Course Overview

As businesses gather vast amounts of data, machine learning is becoming an increasingly valuable tool for utilizing data to deliver cutting-edge predictive models that support informed decision-making. In this course, you will work on a data science project with a realistic dataset to create actionable insights for a business. You’ll begin by exploring the dataset and cleaning it using pandas. Next, you will learn to build and evaluate logistic regression classification models using scikit-learn. You will...Show More

What You'll Learn

Hands-on experience in data exploration, data processing, data modeling and data visualization using pandas, scikit-learn, and Matplotlib

The ability to evaluate model performance and interpret model predictions

Working knowledge of how predictive models can support business decision-making

An understanding of the mathematical foundations of machine learning models

Hands-on experience in data exploration, data processing, data modeling and data visualization using pandas, scikit-learn, and Matplotlib

Course Content

Introduction

2 Lessons

Get familiar with machine learning's role in data science and essential Python libraries.

Overview

Course Structure

Data Exploration and Cleaning

16 Lessons

Discover the logic behind data exploration and cleaning for effective data science projects.

Introduction: Python for Data Science

Exercise: Getting Familiar with Python

Different Types of Data Science Problems

Introduction to Jupyter and pandas

Exercise: Loading the Case Study Data in a Jupyter Notebook

Getting Familiar with Data and Performing Data Cleaning

Exercise: Verifying Basic Data Integrity

Boolean Masks

Exercise: Continuing Verification of Data Integrity

Exercise: Exploring and Cleaning the Data

Exercise: Exploring the Credit Limit and Demographic Feature

Deep Dive: Categorical Features

Exercise: Implementing OHE for a Categorical Feature

Exploring the Financial History Features in the Dataset

Summary: Data Exploration and Cleaning

Quiz: Data Exploration and Cleaning

(Challenge) Exploring Remaining Financial Features in Dataset

Project

Introduction to scikit-learn and Model Evaluation

14 Lessons

Examine scikit-learn tools for model training, evaluation metrics, and generating synthetic data.

Introduction: scikit-learn and Model Evaluation

The Response Variable and Concluding the Initial Exploration

scikit-learn

Generating Synthetic Data

Exercise: Linear Regression in scikit-learn

Model Performance Metrics for Binary Classification

Splitting the Data: Training and Test Sets

Classification Accuracy

Exercise: Calculating True and False Rates and Confusion Matrix

Exercise: Obtaining Probabilities from Logistic Regression Model

The Receiver Operating Characteristic (ROC) Curve

Precision

Summary: Introduction to scikit-learn and Model Evaluation

Quiz: Introduction to scikit-learn and Model Evaluation

(Challenge) Logistic Regression and Precision-Recall Curve

Project

Details of Logistic Regression and Feature Extraction

16 Lessons

Break down complex ideas in logistic regression, feature extraction, and their practical applications.

Introduction: Logistic Regression and Feature Extraction

Examining Relationships Between Features and Response Variable

Pearson Correlation

Mathematics of Linear Correlation

Exercise: F-test and Univariate Feature Selection

Finer Points of the F-test

Exercise: Visualizing the Feature and Response Variable Relationship

Univariate Feature Selection

Exercise: Plotting the Sigmoid Function

Scope of Functions

Why Is Logistic Regression Considered a Linear Model?

Exercise: Finding Appropriate Features for Logistic Regression

Logistic Regression Predictions Using Sigmoid

Exercise: Linear Decision Boundary of Logistic Regression

Summary: Details of Logistic Regression and Feature Extractor

Quiz: Details of Logistic Regression and Feature Extraction

(Challenge) Logistic Regression Model and Coefficients

Project

The Bias-Variance Trade-Off

14 Lessons

Map out the steps for regularization, cross-validation, and gradient descent in logistic regression.

Introduction: The Bias-Variance Trade-Off

Estimating the Coefficients and Intercepts of Logistic Regression

Gradient Descent to Find Optimal Parameter Values

Exercise: Using Gradient Descent to Minimize a Cost Function

Assumptions of Logistic Regression

The Motivation for Regularization

Exercise: Generating and Modeling Synthetic Classification Data

Lasso (L1) and Ridge (L2) Regularization

Cross-Validation

Exercise: The Synthetic Data Classification Problem

Options for Logistic Regression in scikit-learn

Scaling Data, Pipelines, and Interaction Features in Scikit-Learn

Summary: The Bias-Variance Trade-Off

Quiz: The Bias-Variance Trade-Off

(Challenge) Cross-Validation and Feature Engineering

Project

10.

Decision Trees and Random Forests

13 Lessons

Tackle decision trees and random forests to enhance predictive modeling and handle non-linear data.

Introduction: Decision Trees and Random Forests

Decision Trees

Exercise: A Decision Tree in scikit-learn

Training Decision Trees: Node Impurity

Training Decision Trees: Greedy Algorithm and Stopping Criteria

Using Decision Trees: Advantages and Predicted Probabilities

A More Convenient Approach to Cross-Validation

Exercise: Find Optimal Hyperparameters for a Decision Tree

Random Forests: Predictions and Ensembles of Decision Trees

Exercise: Fitting a Random Forest

Checkerboard Graph

Summary: Decision Trees and Random Forests

Quiz: Decision Trees and Random Forests

(Challenge) Cross-Validation Grid Search with Random Forest

Project

12.

Gradient Boosting, XGBoost, and SHAP Values

12 Lessons

Master advanced techniques in gradient boosting, XGBoost, and SHAP values for model performance and interpretation.

Introduction: XGBoost

Gradient Boosting and XGBoost

XGBoost Hyperparameters: Early Stopping

XGBoost Hyperparameters: Tuning the Learning Rate

Other Important Hyperparameters in XGBoost

Exercise: Randomized Grid Search to Tune XGBoost Hyperparameters

Another Way of Growing Trees: XGBoost's grow_policy

Explaining Model Predictions with SHAP Values

Exercise: SHAP Visualization and Analysis

Missing Data

Summary: Gradient Boosting, XGBoosting, and SHAP Values

Quiz: Gradient Boosting, XGBoosting, and SHAP Values

(Challenge) XGBoost and SHAP Explanation for Case Study Data

Project

14.

Test Set Analysis, Financial Insights, and Delivery to the Client

10 Lessons

Learn how to use test set analysis for model evaluation, financial insights, and client delivery.

Introduction: Test Set Analysis

Review of Modeling Results

Model Performance on the Test Set

Distribution of Predicted Probability and Decile Chart

Exercise: Equal-Interval Chart

Calibration of Predicted Probabilities

Financial Analysis

Exercise: Characterizing Costs and Savings

Summary: Analysis, Financial Insights, and Delivery to the Client

Quiz: Test Set Analysis and Financial Insights

(Challenge) Deriving Financial Insights

Project

16.

Appendix

1 Lessons

Create a Jupyter Notebook locally with recommended hardware, software, and Anaconda.

How to Create Jupyter Notebook Locally

Course Author

Packt

Trusted by 2.5 million developers working at companies

"These are high-quality courses. Trust me. I own around 10 and the price is worth it for the content quality. EducativeInc came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks"

Anthony Walker

@_webarchitect_

"Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!"

Evan Dunbar

ML Engineer

"You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it."

Carlos Matias La Borde

Software Developer

"I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site"

Souvik Kundu

Front-end Developer

"Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content."

Vinay Krishnaiah

Software Developer

"I've tried probably 5-7 different sites and Educative is easily the best. It perfectly blends explanation with interactivity"

Eric Downs

Musician/Entrepeneur

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Instant Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

AI-Powered Mock Interviews

Put your skills to the test in a simulated interview setting. Receive personalized feedback based on your performance. Available in Premium & Premium Plus plans.

Adaptive Learning

At various checkpoints throughout Educative courses, you will be prompted to take a quick assessment. Receive a condensed curriculum tailored to your strengths and skill gaps.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

Recommended before starting this course

Course

Python 3: From Beginner to Advanced

Gain insights into Python by exploring basic to advanced concepts, including loops, classes, and GUIs with Tkinter. Delve into testing and become a productive Python programmer.

beginner

4 hours

Course

Data Science for Non-Programmers

Gain insights into conducting meaningful data analysis in Python without prior programming experience. Discover Python fundamentals, data preprocessing, EDA, and predictive analytics for solving business problems.

beginner

13 hours

Course

Fundamentals of Machine Learning for Software Engineers

Explore machine learning's essentials for software engineers, delve into supervised learning, neural networks, and deep learning, and gain skills to tackle real-world data challenges effectively.

beginner

15 hours

Course

Python 3: From Beginner to Advanced

beginner

4 hour

Course

Data Science for Non-Programmers

beginner

13 hour

Course

Fundamentals of Machine Learning for Software Engineers

beginner

15 hour

Related Courses and Skill Paths

Course

An Introductory Guide to Data Science and Machine Learning

Gain insights into data science fundamentals, explore machine learning and big data, and delve into real-time projects. Discover systematic approaches to data acquisition, wrangling, and solving diverse problems.

beginner

6 hours

Course

Data Science in Production: Building Scalable Model Pipelines

Gain insights into building scalable data and model pipelines, explore different cloud environments, delve into streaming workflows, and discover essential tools for creating real-time data products.

advanced

8 hours

Course

Data Science Interview Handbook

The ultimate guide to data science interviews. Developed by FAANG engineers, it covers Python, algorithms, ML concepts, and interview questions. Get interview-ready in just a few hours.

intermediate

9 hours

Course

An Introductory Guide to Data Science and Machine Learning

beginner

6 hour

Course

Data Science in Production: Building Scalable Model Pipelines

advanced

8 hour

Course

Data Science Interview Handbook