How Does ChatGPT Work

Key Takeaways

so how does chat GPT work well in a nutshell the model is trained on a large data set now that data consists of a lot of different things but generally speaking it's human generated text such as conversations articles and social media posts now during the training the model learns to predict the next word in a sequence based on the word that comes before this process is called pre-training GPT generative pre-trained Transformer but it doesn't stay general for long because the next step is to take it and fine tune it you prune out what you want you add details that you like and then you have something that's a little more robust for your use case and in this case the specific task it was trained on is being a chatbot being conversational and responding to text prompts so for to generate a response what it's looking for is you to type something into that little box right there now it doesn't always have to be a question it can be a statement it can be a request it can be any kind of conversational thing you might type into a text box like this