Method 2: SRL First

Learn about using SRL first when performing NER tasks with transformers.

We'll cover the following

Question-answering with ELECTRA
Project management constraints
Using SRL to find questions
Code playground

Let’s try to do better with person entity questions by applying an SRL-first method.

The transformer could not find who was driving to go to Las Vegas and thought it was Nat King Cole instead of Jo and Maria.

What went wrong? Can we see what the transformers think and obtain an explanation? To find out, let’s go back to semantic role modeling.

Let’s run the same sequence on AllenNLP in the semantic role labeling section, to obtain a visual representation of the verb drove in our sequence by running the SRL BERT model:

Get hands-on with 1400+ tech skills courses.

Course Introduction

Basics of Transformers

Architecture of the Transformer Model

Fine-Tuning BERT Models

Pretraining a RoBERTa Model from Scratch

Downstream NLP Tasks with Transformers

Machine Translation with the Transformer

The Rise of Transformers with GPT-3 Engines

Applying Transformers for AI Text Summarization

Matching Tokenizers and Datasets

Transformers for NLP—Exam 1

Semantic Role Labeling with BERT-Based Transformers

Your Data Speaks: Story, Questions, and Answers

Detecting Customer Emotions to Make Predictions

Analyzing Fake News with Transformers

Interpreting Black Box Transformer Models

From NLP to Task-Agnostic Transfomer Models

The Emergence of Transformer-Driven Copilots

Transformers for NLP—Exam 2

Conclusion

Appendix

Method 2: SRL First