Chat GPT Rewards Model Explained!

How does Reinforcement learning come into play with ChatGPT? ABOUT ME ⭕ Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1 📚 Medium Blog: https://medium.com/@dataemporium 💻 Github: https://github.com/ajhalthor 👔 LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/ Transformer Neural Networks: https://www.youtube.com/watch?v=TQQlZhbC5ps RESOURCES [1] ChatGPT blog: https://openai.com/blog/chatgpt/ [2] Instruct GPT which is the model ChatGPT was modeled after: https://arxiv.org/pdf/2203.02155.pdf [3] Likert Scale: https://www.youtube.com/watch?v=Tf_71r1Ve5w [4] Main paper behind nucleus sampling: https://arxiv.org/pdf/1904.09751.pdf [5] PPO algorithm: https://openai.com/blog/openai-baselines-ppo/ [6] PPO algorithms (main paper): https://arxiv.org/pdf/1707.06347.pdf [7] GPT original paper: https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf [8] GPT-3 paper: https://arxiv.org/pdf/2005.14165.pdf [9] Nice article by hugging face: https://huggingface.co/blog/rlhf MATH COURSES (7 day free trial) 📕 Mathematics for Machine Learning: https://imp.i384100.net/MathML 📕 Calculus: https://imp.i384100.net/Calculus 📕 Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics 📕 Bayesian Statistics: https://imp.i384100.net/BayesianStatistics 📕 Linear Algebra: https://imp.i384100.net/LinearAlgebra 📕 Probability: https://imp.i384100.net/Probability OTHER RELATED COURSES (7 day free trial) 📕 ⭐ Deep Learning Specialization: https://imp.i384100.net/Deep-Learning 📕 Python for Everybody: https://imp.i384100.net/python 📕 MLOps Course: https://imp.i384100.net/MLOps 📕 Natural Language Processing (NLP): https://imp.i384100.net/NLP 📕 Machine Learning in Production: https://imp.i384100.net/MLProduction 📕 Data Science Specialization: https://imp.i384100.net/DataScience 📕 Tensorflow: https://imp.i384100.net/Tensorflow