Lead the GenAI revolution. Future-proof your skills by understanding AI basics, machine learning, algorithms, ethical practices, and real-world applications. Stay ahead in tech leadership.

In one form or the other, AI is going to be infused in all the tech products. Meaning, that in order to stay a relevant leader, it has become essential to have a solid, broad understanding of AI. While you may not be implementing the solution, you need to speak the language of AI.
 
Whether you’re leading a team on creating AI solutions, or you just want a better understanding of AI, then this course is for you. In this course, I have deconstructed the concepts most relevant for you.
 
You will start by learning the basics of AI, its connection with machine learning, and the different types of algorithms you should be familiar with. You’ll then learn the rules, best practices, and infrastructure for creating great AI products that users trust. Then, you will go through some real case studies of AI application and do a deep dive into Ethical AI. You'll end by getting an outlook into the current status and future of AI. In a nutshell, this course is your no-fuss, comprehensive guide to the essentials of AI.

Grokking AI for Engineering & Product Managers

# BERT
One of the biggest challenges in NLP is the **lack of enough training data**. Overall there is an enormous amount of text data available, but if we want to create **task-specific datasets**, we need to split that pile into very many diverse fields. When we do this, we end up with only a few thousand or a few hundred thousand human-labeled training examples. Unfortunately, in order to perform well, deep learning-based NLP models require much larger amounts of data; they see major improvements when trained on millions, or billions, of annotated training examples. 

To help bridge this gap in data, researchers have developed various techniques for training **general-purpose language representation models** using the enormous piles of unannotated text on the web (this is known as pre-training). These general-purpose pre-trained models can then be fine-tuned on smaller task-specific datasets, e.g., when working with problems like question answering and sentiment analysis. This approach results in great improvements compared in accuracy to training on the smaller task-specific datasets from scratch. BERT is a recent addition to these techniques for NLP pre-training; it caused a stir in the deep learning community because it presented **state-of-the-art results** in a wide variety of NLP tasks, like question answering.

The best part about BERT is that it can be **downloaded and used for free.** We can either use the  BERT models to extract high-quality language features from our text data, or **we can fine-tune these models on a specific task, like sentiment analysis and question answering, with our own data to produce state-of-the-art predictions**.

## The core idea behind BERT
What is language modeling really about? Which problems are language models trying to solve? Basically, their task is to “fill in the blank” based on context. For example, given

***“The woman went to the store and bought a _____ of shoes.”***

A language model might complete this sentence by saying that the word “cart” would fill the blank 20% of the time and the word “pair” 80% of the time.

In the pre-BERT world, a language model would have looked at this text sequence during training from either left-to-right or combined left-to-right and right-to-left. This one-directional approach works well for generating sentences. We can predict the next word, append it to the sequence, then predict the next word until we have a complete sentence.

Now enters BERT, a language model that is bidirectionally trained (this is also its key technical innovation). This means we can now have a deeper sense of language context and flow compared to the single-direction language models.

The Fundamentals

AI in Practice

Real Case Studies

Responsible AI

What's Next

Natural Language Processing: BERT