GPT vs BERT Explained Transformer Based Models Decoder vs Encoder Simple

In this video, we understand how modern language models evolved after Transformers and learn the difference between GPT and BERT in a simple and intuitive way. Here is the GitHub repo link https://github.com/switch2ai You can download all the code, scripts, and documents from the above GitHub repository. We start from the evolution timeline. 2017 Transformer architecture introduced 2018 ULMFiT introduced transfer learning in NLP Language Model A language model estimates the probability of a token occurring in a sequence Example apple is a great company The model learns patterns, gram…