How to Use Ollama in 3 minutes - Run LLMs locally for FREE (LLama3 & more)

Key Takeaways

all you need to do is go to ama.com click on download and then depending on your computer you can do any of the following options Mac OS Linux or Windows and follow the instructions to install o Lama um I myself am on Linux so my instructions will help most of you very little because most of you will not be using Linux so just follow the instructions for um Mac OS and or Windows or Linux if you have Linux so once you have Ama and installed you can go to your command line and type AMA and it will show you the commands that are available for AMA so run will run a model of you know a model you're interested in um AMA pull will pull the model to your computer so basically install download the model to your computer and AMA list will tell you what models you have already available so let's do that I have open Hermes available right now so if I wanted to use llama 3 I would have to do all Lama pull llama 3 or alternatively I can just do AMA run llama 3 in a before running llama 3 actually do the poll so let's do that I have now um downloaded llama 3 and I did this by doing AMA run Lama 3 which is the same as pull and then run and now I am actually chatting with Lama 3 so we can try it hey can you tell me me about about yourself so you can see it's typing but it's typing very slowly um but it behaves just like chat gbt would behave so uh it's a large language model chat and you can interact with it just like you do with jet gbt and um llama 3 is supposed to be almost as powerful as jet gbt just a note while it's responding if you go to the AMA website you can click on models up here and I will show you the available models so llama 3 is what we're using right now and we'll also try out mixol and but there's a bunch of other models like llama 2 which I don't suggest you use because it's just a weaker older version of llama 3 by meta but there's a bunch of other models you can try out but most of them will not be as powerful as jet gbt or llama 3 so llama 3 is done responding and you know this is what it looks like but it took about a minute to respond F which I think it's mostly because my computer is overwhelmed um because I have a lot of things open but you know it it will work exactly like J gbt except it's on your computer and it's completely free which is nice