AutoLLM & FastAPI Tutorial: Query 100+ Language Models! 😱

Key Takeaways

this is huge we are going to build an application which is capable of talking to 100 plus large language model and in this video we are going to see how to create a API so let's get [Music] started hi everyone I'm really excited to show you how to create an API from Auto llm using fast API in the previous video we already seen this code so I link that in the description below first Import Auto query engine from autol llm this is used to create a query engine next import the simple directory reader to read all the files which is in the data folder if you see the folder structure you have a folder called Data inside that we have a file called text.txt the content is about autol llm so using this documents variable we are going to read all the files which is in the data folder so it's simple direct reader and data and load data next Define a query engine and pause the document inside the query engine this will automatically create the emings required next next you are able to query the query engine so I've asked explain me about autol llm this should automatically respond with the response to convert this into fast API application import uvon next from Auto llm Import Auto fast API this will import the fast API required next instead of response we are going to create app equals autofast API Dot from query engine and pass the query engine inside the bracket just by having the one line of code you are able to convert this application into a fast API application now at app.get and then back slash that's the root folder we are going to define a main function where we are passing the query inside that then returning the query engine. query next we are going to define the main function which isore name and Main and then UV con. run and pause the app come host could be 0.0.0 that's the like the local host and then port number 8,000 that's it so it's just literally adding three lines of code compared to what it was before first you create an app using autofast API then you create a main function and return the query engine. query that should process the query at the end you define the uvon do run application and pass the app thus this application will be running in port number 8,000 in your Local Host so I'm going to run this code now so we're going to type python app.py in your terminal and click enter now it's passing documents generating eddings and you can see your API is running in port number 8,000 so we going to test this API using Postman so I have opened Postman now I've entered the URL here as 0000 colon 8000 now going into the params tab enter the key which is q and then pass the value what is auto l M I have asked the question here which you can see and I'm going to click Send now the application is running and you got a response now Auto LM is a feature Rich package that simplifies large model and you can see the structure of the response here in this tab that's it now you have created API endpoint that can respond to your query as simple as that I'm also going to create more videos in regards to autol llm so stay tuned I hope you like this video do like share and subscribe and thanks for watching