An Introduction to Entity Resolution in Python

Gain insights into entity resolution in Python, covering business use cases, semantic preprocessing, graph clustering, and weak supervision. Increase business value through hands-on coding and strategic decision-making.

Advanced

63 Lessons

Certificate of Completion

AI-POWERED

Explanations

AI-POWERED

Explanations

This course includes

1 Project

1 Assessment

192 Playgrounds

7 Quizzes

This course includes

1 Project

1 Assessment

192 Playgrounds

7 Quizzes

Course Overview

A typical business stores data across multiple systems, including ERPs for operations, a CRM for marketing, files, notebooks, and BI apps for other purposes. Records of the same customer (entity) exist in multiple places, likely not in sync across nor unique within sources. This inconsistent situation generates an opportunity for us to drive business value by cross-referencing and deduplicating records with entity resolution. This course covers business acumen and hands-on coding. It starts with several bu...Show More

What You'll Learn

The ability to deduplicate records using Python

Familiarity with an entity resolution framework and business cases

An understanding of semantic similarity and search

Experience with classification in the context of entity resolution

Hands-on experience in data-centric AI using weak supervision and confident learning

What You'll Learn

The ability to deduplicate records using Python

Course Content

Introduction to Entity Resolution and Applications

Learn how to use entity resolution techniques in Python to improve data quality and integration.

About the Course

Deduplication vs. Linkage

Location Resolution: Geocoding

Master Data Management

Analytics in a Fragmented Data Landscape

Direct Impact with Payment Resolution

Real-Time Entity Resolution

A Quickstart Guide Using the RecordLinkage Package

Get started with entity resolution in Python using text preprocessing, similarity scoring, and evaluation techniques.

Solver’s Kitchen—Installation and Service for Restaurants

Effective Text Preprocessing

Similarity Features

Match vs. No-Match

Evaluate the Match Quality

Geocoders for Location Resolution

Sell with Insights

Quiz on Entity Resolution Fundamentals

Preprocessing

Work your way through preprocessing text and location data for enhanced entity resolution.

Why Preprocessing Is Important

Preprocessing Using pandas

Removing and Replacing Tokens

Phonetic Algorithms

Preprocess Locations Using Open Data

Categories from Unstructured Texts

Quiz on Preprocessing

Indexing

Apply your skills to enhance the efficiency of entity resolution using various indexing techniques.

Significance of Indexing

Equality-Based Indexing

Sort-Based Indexing

Combine Indexing Techniques

K-Nearest Embeddings Blocking

Quiz on Indexing

Feature Engineering

Deepen your knowledge of feature engineering for entity resolution, exploring various similarity methods.

Introduce Similarity

Similarity of Numeric Attributes

Edit- and Substring-Based Similarity

Embedding-Based Similarity

Quiz on Similarity Features

Pairwise Matching

12 Lessons

See how it works to tackle class imbalances and enhance binary classification in entity resolution.

Clustering

6 Lessons

Piece together the parts of clustering techniques to improve classification accuracy in entity resolution.

Integration

8 Lessons

Step through integrating entity resolution in data stacks via various platforms and services.

Entity Resolution Fundamentals

Assessment

Matching Products Across Two Online Shops

Project

Conclusion

1 Lesson

Look at essential insights and skills for effective entity resolution in various systems.

10.

Appendix

3 Lessons

Examine batch geocoding, vector search with LanceDB, and essential resources for entity resolution.

Course Author

Trusted by 1.4 million developers working at companies

Anthony Walker

@_webarchitect_

Evan Dunbar

ML Engineer

Carlos Matias La Borde

Software Developer

Souvik Kundu

Front-end Developer

Vinay Krishnaiah

Software Developer

Eric Downs

Musician/Entrepeneur

Kenan Eyvazov

DevOps Engineer

Souvik Kundu

Front-end Developer

Eric Downs

Musician/Entrepeneur

Anthony Walker

@_webarchitect_

Evan Dunbar

ML Engineer

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Instant Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

AI-Powered Mock Interviews

Put your skills to the test in a simulated interview setting. Receive personalized feedback based on your performance. Available in Premium & Premium Plus plans.

Adaptive Learning

At various checkpoints throughout Educative courses, you will be prompted to take a quick assessment. Receive a condensed curriculum tailored to your strengths and skill gaps.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

FOR TEAMS

Interested in this course for your business or team?

Unlock this course (and 1,000+ more) for your entire org with DevPath