Home>Courses>An Introduction to Entity Resolution in Python

An Introduction to Entity Resolution in Python

Gain insights into entity resolution in Python, covering business use cases, semantic preprocessing, graph clustering, and weak supervision. Increase business value through hands-on coding and strategic decision-making.

Advanced

63 Lessons

Certificate of Completion

AI-POWERED

Explanations

AI-POWERED

Explanations

This course includes

1 Project

1 Assessment

192 Playgrounds

7 Quizzes

Course Overview

What You'll Learn

Course Content

Recommendations

Course Overview

A typical business stores data across multiple systems, including ERPs for operations, a CRM for marketing, files, notebooks, and BI apps for other purposes. Records of the same customer (entity) exist in multiple places, likely not in sync across nor unique within sources. This inconsistent situation generates an opportunity for us to drive business value by cross-referencing and deduplicating records with entity resolution. This course covers business acumen and hands-on coding. It starts with several bu...Show More

A typical business stores data across multiple systems, including ERPs for operations, a CRM for marketing, files, notebooks, an...Show More

What You'll Learn

The ability to deduplicate records using Python

Familiarity with an entity resolution framework and business cases

An understanding of semantic similarity and search

Experience with classification in the context of entity resolution

Hands-on experience in data-centric AI using weak supervision and confident learning

The ability to deduplicate records using Python

Course Content

Introduction to Entity Resolution and Applications

7 Lessons

Learn how to use entity resolution techniques in Python to improve data quality and integration.

About the Course

Deduplication vs. Linkage

Location Resolution: Geocoding

Master Data Management

Analytics in a Fragmented Data Landscape

Direct Impact with Payment Resolution

Real-Time Entity Resolution

A Quickstart Guide Using the RecordLinkage Package

8 Lessons

Get started with entity resolution in Python using text preprocessing, similarity scoring, and evaluation techniques.

Solver’s Kitchen—Installation and Service for Restaurants

Effective Text Preprocessing

Similarity Features

Match vs. No-Match

Evaluate the Match Quality

Geocoders for Location Resolution

Sell with Insights

Quiz on Entity Resolution Fundamentals

Preprocessing

7 Lessons

Work your way through preprocessing text and location data for enhanced entity resolution.

Why Preprocessing Is Important

Preprocessing Using pandas

Removing and Replacing Tokens

Phonetic Algorithms

Preprocess Locations Using Open Data

Categories from Unstructured Texts

Quiz on Preprocessing

Indexing

6 Lessons

Apply your skills to enhance the efficiency of entity resolution using various indexing techniques.

Significance of Indexing

Equality-Based Indexing

Sort-Based Indexing

Combine Indexing Techniques

K-Nearest Embeddings Blocking

Quiz on Indexing

Feature Engineering

5 Lessons

Deepen your knowledge of feature engineering for entity resolution, exploring various similarity methods.

Introduce Similarity

Similarity of Numeric Attributes

Edit- and Substring-Based Similarity

Embedding-Based Similarity

Quiz on Similarity Features

Pairwise Matching

12 Lessons

See how it works to tackle class imbalances and enhance binary classification in entity resolution.

Binary Classification in Entity Resolution

Learning from Labeled Examples

Targeting Uncertainty with Active Learning

Fighting Label Errors

Programmatic Labeling

Undersampling with NearMiss

Oversampling with Text Augmentation

Interpretable Matching

Deep Matching

Exercise: Undersampling

Solution: Undersampling

Quiz on Pairwise Matching

Clustering

6 Lessons

Piece together the parts of clustering techniques to improve classification accuracy in entity resolution.

Motivating Clustering

Transitive Clustering

Merge Center Clustering (MCC)

Markov Clustering

Manual Review and Labeling

Quiz on Clustering

Integration

8 Lessons

Step through integrating entity resolution in data stacks via various platforms and services.

Motivating Integration

Local Stack with DuckDB and dbt

In the Cloud with Snowflake and dbt

SQL-First Entity Resolution with Splink

Entity Resolution as a Service

Exercise: Indexing with Splink

Solution: Indexing with Splink

Quiz on Integration

Entity Resolution Fundamentals

Assessment

Matching Products Across Two Online Shops

Project

11.

Conclusion

1 Lessons

Look at essential insights and skills for effective entity resolution in various systems.

Wrap Up

12.

Appendix

3 Lessons

Examine batch geocoding, vector search with LanceDB, and essential resources for entity resolution.

Batch Geocode with Geoapify and Python

Embeddings and Vector Search with LanceDB

Glossary

Course Author

Paul Kinsvater

Trusted by 2.6 million developers working at companies

"These are high-quality courses. Trust me. I own around 10 and the price is worth it for the content quality. EducativeInc came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks"

Anthony Walker

@_webarchitect_

"Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!"

Evan Dunbar

ML Engineer

"You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it."

Carlos Matias La Borde

Software Developer

"I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site"

Souvik Kundu

Front-end Developer

"Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content."

Vinay Krishnaiah

Software Developer

"I've tried probably 5-7 different sites and Educative is easily the best. It perfectly blends explanation with interactivity"

Eric Downs

Musician/Entrepeneur

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Instant Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

AI-Powered Mock Interviews

Put your skills to the test in a simulated interview setting. Receive personalized feedback based on your performance. Available in Premium & Premium Plus plans.

Adaptive Learning

At various checkpoints throughout Educative courses, you will be prompted to take a quick assessment. Receive a condensed curriculum tailored to your strengths and skill gaps.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

Recommended before starting this course

Course

Python 3: From Beginner to Advanced

Gain insights into Python by exploring basic to advanced concepts, including loops, classes, and GUIs with Tkinter. Delve into testing and become a productive Python programmer.

beginner

4 hours

Course

Fundamentals of Machine Learning: A Pythonic Introduction

Gain insights into machine learning concepts, implement and compare algorithms with scikit-learn, and explore supervised learning, clustering, regression, SVMs, autoencoders, and ensemble learning with practical projects using Python.

beginner

14 hours

Course

Natural Language Processing with Machine Learning

Gain insights into processing text data, creating word embeddings, and using LSTMs for semantic analysis and machine translation. Explore industry-relevant NLP techniques with Python and TensorFlow.

advanced

9 hours

Course

Python 3: From Beginner to Advanced

beginner

4 hour

Course

Fundamentals of Machine Learning: A Pythonic Introduction

beginner

14 hour

Course

Natural Language Processing with Machine Learning

advanced

9 hour

Related Courses and Skill Paths

Course

Machine Learning System Design

Gain insights into ML system design, state-of-the-art techniques, and best practices for scalable production. Learn from top researchers and stand out in your next ML interview.

intermediate

1 hour 30 mins

Course

Applied Machine Learning: Deep Learning for Industry

Gain insights into industry-level machine learning by applying advanced TensorFlow and Python techniques. Explore efficient methods for creating scalable models, from data pipelines to deployment and inference.

advanced

3 hours

Course

Image Recognition with Machine Learning

Gain insights into image data processing and CNNs for image classification using TensorFlow. Delve into CNN architectures and their applications, requiring Python and TensorFlow knowledge.

advanced

7 hours

Course

Machine Learning System Design

intermediate

1 hour 30 min

Course

Applied Machine Learning: Deep Learning for Industry

advanced

3 hour

Course

Image Recognition with Machine Learning