Effect of Code-Switching and Transliteration
Learn about code-switching and transliteration and how M-BERT handles code-switched and transliterated text.
Let's investigate how M-BERT handles code-switching and transliteration. But first, we need to understand what code-switching and transliteration are.
Code-switching
Mixing or alternating different languages in a conversation is called code-switching. For instance, let's consider the following English sentence:
Instead of uttering the sentence just in English, let's incorporate some Hindi words in between. The sentence becomes the following:
As we can observe in the preceding sentence, the words 'nowadays' and 'little' are uttered in Hindi. This is an example of code-switched text.
Transliteration
In transliteration, instead of writing a text in the source language script, we use the target language script. Let's understand transliteration with the help of an example. Consider the following ...