This course helps you master the topic of transformers for natural language processing, including the architecture, training, and prompt design
Intermediate
137 Lessons
15h
Certificate of Completion
This course helps you master the topic of transformers for natural language processing, including the architecture, training, and prompt design
AI-POWERED
AI-POWERED
This course includes
This course includes
Course Overview
The demand for language understanding is on the rise in many fields, such as media, social media, and research papers. Vast amounts of data need to be processed for research, documents need to be translated and summarized for every area of the economy, and social media posts need to be scanned for ethical and legal reasons, among hundreds of other AI tasks whose use is ever-expanding. This course will cover everything from developing code to prompt design, a new programming skill that controls the behavio...
What You'll Learn
Ability to work with Python, PyTorch, and TensorFlow
Ability to explore and implement transformers, as well as key AI language understanding neural network models
Ability to learn the new skills required to become an Industry 4.0 AI Specialist
Proficiency in Python deep learning and the necessary tools needed to effectively enhance language understanding
Ability to create a transformer-based recommendation system
What You'll Learn
Ability to work with Python, PyTorch, and TensorFlow
Show more
Course Content
Course Introduction
Basics of Transformers
Architecture of the Transformer Model
Fine-Tuning BERT Models
Pretraining a RoBERTa Model from Scratch
Downstream NLP Tasks with Transformers
10 Lessons
Machine Translation with the Transformer
10 Lessons
The Rise of Transformers with GPT-3 Engines
10 Lessons
Applying Transformers for AI Text Summarization
9 Lessons
Matching Tokenizers and Datasets
6 Lessons
Semantic Role Labeling with BERT-Based Transformers
7 Lessons
Your Data Speaks: Story, Questions, and Answers
9 Lessons
Detecting Customer Emotions to Make Predictions
7 Lessons
Analyzing Fake News with Transformers
7 Lessons
Interpreting Black Box Transformer Models
8 Lessons
From NLP to Task-Agnostic Transfomer Models
7 Lessons
The Emergence of Transformer-Driven Copilots
8 Lessons
Conclusion
1 Lesson
Course Author
Trusted by 1.4 million developers working at companies
Anthony Walker
@_webarchitect_
Evan Dunbar
ML Engineer
Carlos Matias La Borde
Software Developer
Souvik Kundu
Front-end Developer
Vinay Krishnaiah
Software Developer
Eric Downs
Musician/Entrepeneur
Kenan Eyvazov
DevOps Engineer
Souvik Kundu
Front-end Developer
Eric Downs
Musician/Entrepeneur
Anthony Walker
@_webarchitect_
Evan Dunbar
ML Engineer
See how Educative uses AI to make your learning more immersive than ever before.