Fine-Tune Llama 3.1 and Deploy Using NVIDIA NIM Directly From Your Laptop

Brev · Intermediate ·🛠️ AI Tools & Apps ·1y ago
NVIDIA Developer Program: https://developer.nvidia.com/nim Get Access To The NIM: https://build.nvidia.com/meta/llama-3_1-8b-instruct Follow Along: https://brev.dev/llama3-1-nim In this tutorial, we walk through getting access to the NVIDIA Developer program to gain access to the cutting edge Llama3.1 8B Instruct Model NIM. We fine-tune Llama 3.1 using a PEFT technique called LoRA using the NVIDIA Nemo Framework. And we deploy the fine-tuned model on an NVIDIA NIM. This video serves as an example for how you might develop an AI application with a fine-tuned LLAMA 3.1 model and deploy it f…
Watch on YouTube ↗ (saves to browser)
2024 Year In Review | Talks at Google
Next Up
2024 Year In Review | Talks at Google
Talks at Google