Autogen: Ollama integration 🤯 Step by Step Tutorial. Mind-blowing!

Key Takeaways

hi everyone I'm really excited to show you how to integrate AMA with autogen with ol llama you can add large language open-source models let's get started I have already done a beginner tutorial in regards to autogen I will link that in the description below we have already covered how to integrate text generation web Bui with autogen and LM studio with autogen the structure of the code will look pretty much the same first you import autogen then you you add a API base if you don't provide this API base it'll automatically get it from chat gbt then you create LM config which has a timeout and config list assign this settings to the assistant LM config isal LM config assistant is the bot user proxy is the user that's me who is talking to the bot you create the user proxy agent setting the work directory then you can initiate a chat with the question write a program to find even number to integrate ol Lama with auto agent we use light llm now we going to set up light llm and integrate that with auto agent go to terminal cond activate autogen it's your activating the virtual envirment which we have already created in the previous video then pip install Light llm click enter now light llm hyphen hyen model and then mention ol Lama SL mistro and click enter now you can see the application is served under 1262 port number I'm copying the URL and then going to the app.py file and changing the API base and saving it now open another terminal keep the previous terminal running here we're going to type python app.py enter now you can see our autogen app talking to mistol to check which model it's using I'm going to type another question what is your base AI model and then start the application again here you can see hello I am large language model trained by Mr AI That's it you are using Mr AI through ol Lama as simple as that I use the port number one 262 the whole URL like this you can also use port number 8,000 and copy this URL please do write if you have any questions in the comments below I hope you like this video please do like share and subscribe thanks for watching