Key Tips for Launching RAG Solutions #podcast #machinelearningoperations #rag

Key Takeaways

when I speak to teams and companies trying to deploy especially rag applications I would say that's the majority of the llm not the only ones but the majority of LM use cases yeah that's kind of what separates I would say like those who made it to production and production could be an internal solution right but essentially all of those break when you try to test an llm application it's more of a you know metric driven apprach so that's where you want to start including more euristic and L as a judge wants now it it might change obviously right depending on what users and customers are asking for we're not trying to like build something that is super established and people have been done before and just kind of like put an lln uh tag on it if the existing tools work well by all means let's use them