Training the ELECTRA Model

The generator is trained using the MLM task.

Selecting the masking position

So, for a given input, $X = [x_1, x_2, ..., x_n]$, we ...