3 LLM Tips Developers Should Know

Key Takeaways

[Music] So, I've seen this trend going around where people show off Balkan breakfasts. Well, since I'm from the Balkans, this is just breakfast for me, I guess. So, let me have some wonderful breakfast right now while I explain to you the three tips every developer working with LLMs should know about. Tip number one, prompt engineering. You need to make sure to craft your prompts. Be specific about them. Experiment. give clear and concrete instructions to your LLM. This is more of an art than a science. So, you're going to have to be a bit creative when it comes to those things. Maybe try few shot um examples basically where you're going to give the LLM examples of what you want it to return or think about the chain of thought prompting where you give your LLM the example of a chain of thought how they should solve this given problem. Tip number two, output parsing and validation. Here's the thing, models may not always return the exact same thing you want, right? Maybe you're expecting JSON, but it gives you something else. So, it is critical for you as a developer to make sure you have proper error handling. I'll actually include a link to an example piece of Python code how to do this, but this is going to be critical to making your application quite robust when it comes to the actual responses. Tip number three, model selection and fine-tuning. It's easy just to choose the best model there, the strongest one, the most robust. You may not always need that kind of a model. So choosing the correct model for your application and for specific elements of your application. Maybe you want to choose two different models to do two different things is kind of one of those critical things to make your application cost efficient and also optimized. Also consider fine-tuning for your specific use cases for your business needs. You may need to fine-tune a model so it would promptly provide you with the accurate and the correct format of responses. So check that out. [Music] Nothing can beat this. It's the best thing in the world. So, if you want to have some bulk breakfast, head over to your grocery store's fresh food aisle and get a bunch of vegetables, cheese, and meat. But if you want to apply some of these best practices about LLMs that I showed you, definitely go check out Amazon Bedrock because it provides you all of the necessary resources and infrastructure for you to build amazing applications powered by LLMs. Oh my god.