Large Language Models

Large language models (LLMs) are all the rage at the moment. Companies like Google, OpenAI, and Amazon have all invested incredible amounts of money into the management and training of LLMs.

To define them in simple terms, LLMs are nothing but extremely large neural networks (typically with several attention layers, which allow for better processing of sequences and contexts) meant for NLP tasks. They typically have an enormous number of parameters (in the billions or even hundreds of billions) and require a ridiculous amount of input data. LLMs encode information from a training set in their many parameters and can accurately leverage them upon inference. Pretrained models are available for the public to use out-of-the-box or through a process called fine-tuning (adapting the pretrained model for a specific task).

The rise of ChatGPT, Google Bard, and other chat-based interfaces have created an explosion in popularity for LLMs, but there are countless risks that the ...