New course with Google Cloud: Understanding and Applying Text Embeddings with Vertex AI

Key Takeaways

hi I'm excited to introduce understanding and applying text embeddings with DirectX AI built in partnership with Google Cloud taught by Nikita namjashi and me this short course shows you how to use text embeddings that is given a sentence paragraph or other arbitrary length piece of text how to compute the feature Vector for it that tries to capture the meaning or the semantics of the text and it turns out this helps you to figure out what pieces of text are similar if you've heard of word embeddings like where to back it's totally fine if you haven't the short post doesn't assume this is prime knowledge but these sentence level embeddings that you learned about in this course are significantly more useful and Powerful I'm delighted to introduce Nikita who is a developer advocate for gents of AI at Google Cloud her full-time job is to help developers build gentle AI applications with LMS large language models so I'm looking forward to her sharing her deep experience on building many practical applications of us in this course thanks Andrew I've had the pleasure of supporting a lot of large companies as well as startups building exciting applications using embedding algorithms these give us a way to quickly build text search clustering keyword extraction and other applications and are a key part of the toolbox for developers using generative AI I really look forward to sharing what I'm seeing out in the field with you specifically embeddings are a way that we can represent data as points in space where the locations are semantically meaningful that is the locations capture something about the meaning of a piece of text by using a large pre-trained embeddings model you can prototype many text applications in minutes that frankly used to take most teams months and this is unlocking a lot of exciting and creative new applications so as one example embeddings are an important part of using OMS for question on stream talks when you want your answers to be based on an external knowledge base that wasn't included in the lm's original training data say you want the album to answer questions about an organization you work for or on a specialized domain the key technique for this called retrieval augmented generation requires giving the LM access information that wasn't included in the training data and this often is too much information to Simply fit into the prompt by allowing the large language model to retrieve information from a specific knowledge base you can also base the response on a particular document and figure out where the answer came from this is called grounding an llm where you can get the LM to basically cite a specific source and significantly reduce the chance of hallucinations which is when a large language model produces text that seems plausible but isn't factually accurate or grounded in reality and we can do all of this without specialized model fine tuning but just using embeddings and a bit of prompting so that makes the whole development process a lot faster after finishing this course you understand and also end up with code that you can use to compute embeddings and also be able to use it in your own question answering system or other applications that might refer to a specific document or set of documents but more broadly these embeddings are a key tool for genitive AI developers and having this tool in your pocket would be useful for many things you might want to build in the future so I hope you enjoy the course foreign [Music]