AI Chatbot Training From Pre Training to Human Feedback

Key Takeaways

This is only part of the story though. This whole process is called pre-training. The goal of autocompleting a random passage of text from the internet is very different from the goal of being a good AI assistant. To address this, chatbots undergo another type of training just as important called reinforcement learning with human feedback. Workers flag unhelpful or problematic predictions, and their corrections further change the model's parameters, making them more likely to give predictions that users prefer.