How to Fine-Tune Mistral 7B on Your Own Data

Brev · Beginner ·🧠 Large Language Models ·2y ago
Hi! Harper Carroll from Brev.dev here. In this tutorial video, I walk you through how to fine-tune Mistral 7B, which outperforms Llama 2 13B on all tested benchmarks, on your own data.... like how I do with my journal entries from over the years, teen angst and all. Notebook: https://github.com/brevdev/notebooks/blob/main/mistral-finetune-own-data.ipynb Notebook to fine-tune on a HF dataset: https://github.com/brevdev/notebooks/blob/main/mistral-finetune.ipynb My explanation on how QLoRA works: https://brev.dev/blog/how-qlora-works Join the Discord: https://discord.com/invite/NVDyv7TUgJ F…
Watch on YouTube ↗ (saves to browser)
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Next Up
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)