Fine-Tune Any LLM, Convert to GGUF, And Deploy Using Ollama

Brev · Beginner ·🧠 Large Language Models ·1y ago
Follow Along: https://console.brev.dev/launchable/deploy/now?userID=p2mzt91a8&orgID=ejmrvoj8m&name=Finetune+Llama3+and+Convert+to+Ollama+Modelfile&instance=A10G%40g5.2xlarge&diskStorage=500&cloudID=devplane-brev-1&python=3.10&cuda=12.0.1&file=https%3A%2F%2Fgithub.com%2Fbrevdev%2Fnotebooks%2Fblob%2Fmain%2Fllama3-to-ollama.ipynb&launchableID=env-2iBAoNimbkT4imNoAQXyIOXwrXd Join Our Discord: https://discord.com/invite/NVDyv7TUgJ Request Access To the Model: https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct In this guide, we walk through how to fine-tune Llama3-8B using ORPO fine-tunin…
Watch on YouTube ↗ (saves to browser)
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Next Up
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)