Getting Started with Google BERT/

...

/

Training the ELECTRA Model

Training the ELECTRA Model

Learn how to train the ELECTRA model.

We'll cover the following...

The generator is trained using the MLM task.

Selecting the masking position

So, for a given input, X=[x1,x2,...,xn]X = [x_1, x_2, ..., x_n], we ...