Quiz: Different BERT Variants

Take a short quiz to test your understanding of different BERT variants.

1

(Select all that apply.) Which options are used as the parameter reduction techniques in ALBERT?

A)

Cross-layer parameter sharing technique

B)

Factorized linear layer parameterization technique

C)

Factorized embedding layer parameterization technique

D)

Factorized softmax layer parameterization technique

Question 1 of 70 attempted

Get hands-on with 1400+ tech skills courses.