End-to-End (small) LLM Fine-tuning Tutorial (from data to model to live demo) | On DGX Spark

Daniel Bourke · Advanced ·📰 AI News & Updates ·2mo ago
In this video we fully fine-tune Google's Gemma 3 270M Small Language Model to do structured data extraction. Because the Gemma 3 270M is quite small in world of LLMs, we're able to do all of the training locally on a NVIDIA DGX Spark (see here for more: https://nvda.ws/4iQXZU4). The code should also run in Google Colab. If you have any issues, please let me know in a comment. Links: Google Colab Notebook - https://colab.research.google.com/drive/1hV6Gcz8vBRS9t0bYkBp6W1ne_yqG6mJx?usp=sharing Learn Hugging Face Book Version - https://www.learnhuggingface.com/notebooks/hugging_face_llm_ful…
Watch on YouTube ↗ (saves to browser)

Chapters (9)

Welcome to the Machine Learning Cooking Show
0:57 Why Fine-Tune Your Own Model?
2:47 Ingredients and Preparation
5:45 Understanding the Task and Data
18:27 Formatting Data for the Model
20:41 Testing the Base Model
30:29 Model Fine-Tuning
31:08 Testing the Model with Sample Data
32:26 Setting U

Playlist

Uploads from Daniel Bourke · Daniel Bourke · 0 of 60

← Previous Next →
1 Xbox One S Unboxing and Xbox One Comparison
Xbox One S Unboxing and Xbox One Comparison
Daniel Bourke
 2 HOW (not) TO BUILD A PULL UP BAR
HOW (not) TO BUILD A PULL UP BAR
Daniel Bourke
 3 High Protein Vegan Snack - Crunchy Spicy Chickpeas
High Protein Vegan Snack - Crunchy Spicy Chickpeas
Daniel Bourke
 4 Functional Friday | Backyard Workout
Functional Friday | Backyard Workout
Daniel Bourke
 5 Text/Profanity Checker in Python
Text/Profanity Checker in Python
Daniel Bourke
 6 Drawing Flowers in Python
Drawing Flowers in Python
Daniel Bourke
 7 Functional Friday | Raw Training Australia
Functional Friday | Raw Training Australia
Daniel Bourke
 8 My Instagram is Fake - TDBS 15 April 2017
My Instagram is Fake - TDBS 15 April 2017
Daniel Bourke
 9 Trying Something New - TDBS April 14 2017
Trying Something New - TDBS April 14 2017
Daniel Bourke
 10 I Finally Realised... - TDBS 16 April 2017
I Finally Realised... - TDBS 16 April 2017
Daniel Bourke
 11 Finding The Right Medium - TDBS 18 April 2017
Finding The Right Medium - TDBS 18 April 2017
Daniel Bourke
 12 I'm Camera Shy - TDBS 17 April 2017
I'm Camera Shy - TDBS 17 April 2017
Daniel Bourke
 13 Full Day of Eating - Guessing My Macronutrient Ranges
Full Day of Eating - Guessing My Macronutrient Ranges
Daniel Bourke
 14 What Is Neuralink??! - TDBS 22 April 2017
What Is Neuralink??! - TDBS 22 April 2017
Daniel Bourke
 15 I Failed My First Two Years Of University - TDBS 21 April 2017
I Failed My First Two Years Of University - TDBS 21 April 2017
Daniel Bourke
 16 Disagree and Commit, Words of Wisdom from Jeff Bezos - TDBS 19 April 2017
Disagree and Commit, Words of Wisdom from Jeff Bezos - TDBS 19 April 2017
Daniel Bourke
 17 A Lesson In Movement | Raw Training Australia
A Lesson In Movement | Raw Training Australia
Daniel Bourke
 18 My First Time Speaking In Public - TDBS 20 April 2017
My First Time Speaking In Public - TDBS 20 April 2017
Daniel Bourke
 19 What I Would Do Differently At High School - TDBS 23 April 2017
What I Would Do Differently At High School - TDBS 23 April 2017
Daniel Bourke
 20 Self-Awareness Is A Super Power - TDBS 24 April 2017
Self-Awareness Is A Super Power - TDBS 24 April 2017
Daniel Bourke
 21 A Template For Cold Emails - TDBS 25 April 2017
A Template For Cold Emails - TDBS 25 April 2017
Daniel Bourke
 22 800 Calorie Pancake of Peace | High Protein Pancake
800 Calorie Pancake of Peace | High Protein Pancake
Daniel Bourke
 23 3 Benefits of Cold Showers
3 Benefits of Cold Showers
Daniel Bourke
 24 My First Wedding, Relationships And Public Speaking - TDBS 30 April 2017
My First Wedding, Relationships And Public Speaking - TDBS 30 April 2017
Daniel Bourke
 25 I'm Addicted to Learning - TDBS 28 April 2017
I'm Addicted to Learning - TDBS 28 April 2017
Daniel Bourke
 26 FALLING IS FUN | Functional Friday 4
FALLING IS FUN | Functional Friday 4
Daniel Bourke
 27 My first HACKATHON! | 100 Days of Code 1
My first HACKATHON! | 100 Days of Code 1
Daniel Bourke
 28 MORE MACHINE LEARNING | 100 Days of Code 2
MORE MACHINE LEARNING | 100 Days of Code 2
Daniel Bourke
 29 TensorBoard and learning from Einstein | 100 Days of Code 3
TensorBoard and learning from Einstein | 100 Days of Code 3
Daniel Bourke
 30 What I Learned From Creating My Own Radio Show - TDBS 101
What I Learned From Creating My Own Radio Show - TDBS 101
Daniel Bourke
 31 It's Not All Sunshine
It's Not All Sunshine
Daniel Bourke
 32 Ego Versus Self
Ego Versus Self
Daniel Bourke
 33 Job Interview Tips and Open Ocean Swim | 100 Days of Code 4
Job Interview Tips and Open Ocean Swim | 100 Days of Code 4
Daniel Bourke
 34 I Want To Help 100,000 People Workout | AI Powered Personal Trainer
I Want To Help 100,000 People Workout | AI Powered Personal Trainer
Daniel Bourke
 35 MACHINE LEARNING IN 5 MINUTES
MACHINE LEARNING IN 5 MINUTES
Daniel Bourke
 36 COFFEE, YOGA and AWS | 100 Days of Code 5
COFFEE, YOGA and AWS | 100 Days of Code 5
Daniel Bourke
 37 MY FIRST STARTUP WEEKEND | 100 Days of Code 6
MY FIRST STARTUP WEEKEND | 100 Days of Code 6
Daniel Bourke
 38 The most valuable skill I've learned
The most valuable skill I've learned
Daniel Bourke
 39 What Is An Expert Generalist?
What Is An Expert Generalist?
Daniel Bourke
 40 GENERATING TV SCRIPTS WITH DEEP LEARNING | 100 Days of Code 7
GENERATING TV SCRIPTS WITH DEEP LEARNING | 100 Days of Code 7
Daniel Bourke
 41 This Is Just The Beginning | TDBS Episode 100
This Is Just The Beginning | TDBS Episode 100
Daniel Bourke
 42 How do you know when to call it quits?
How do you know when to call it quits?
Daniel Bourke
 43 The War of Art & Facing Resistance
The War of Art & Facing Resistance
Daniel Bourke
 44 I Predicted The Apple Watch In 2004
I Predicted The Apple Watch In 2004
Daniel Bourke
 45 How I keep myself on track | 100 Days Of Code 8
How I keep myself on track | 100 Days Of Code 8
Daniel Bourke
 46 Short Term vs Long Term Satisfaction
Short Term vs Long Term Satisfaction
Daniel Bourke
 47 Attention, please
Attention, please
Daniel Bourke
 48 TEACHING BOTS TO PLAY GAMES | 100 Days of Code 9
TEACHING BOTS TO PLAY GAMES | 100 Days of Code 9
Daniel Bourke
 49 Udacity Deep Learning Nanodegree Language Translation Project Submission | 100 Days of Code 10
Udacity Deep Learning Nanodegree Language Translation Project Submission | 100 Days of Code 10
Daniel Bourke
 50 Learning about Generative Adversarial Networks on Udacity | 100 Days of Code 11
Learning about Generative Adversarial Networks on Udacity | 100 Days of Code 11
Daniel Bourke
 51 Completing Andrew Ng's Machine Learning Course on Coursera | 100 Days of Code 12
Completing Andrew Ng's Machine Learning Course on Coursera | 100 Days of Code 12
Daniel Bourke
 52 Finishing the Treehouse Python Track | 100 Days of Code 13
Finishing the Treehouse Python Track | 100 Days of Code 13
Daniel Bourke
 53 GENERATING FACES WITH GANs | 100 Days of Code 14
GENERATING FACES WITH GANs | 100 Days of Code 14
Daniel Bourke
 54 TWO WAYS TO INCREASE YOUR METABOLISM
TWO WAYS TO INCREASE YOUR METABOLISM
Daniel Bourke
 55 Graduating From the Udacity Deep Learning Nanodegree | 100 Days of Code 15
Graduating From the Udacity Deep Learning Nanodegree | 100 Days of Code 15
Daniel Bourke
 56 SLEEP YOUR WAY TO FAT LOSS
SLEEP YOUR WAY TO FAT LOSS
Daniel Bourke
 57 WHAT I'VE LEARNED FROM TALKING TO PEOPLE
WHAT I'VE LEARNED FROM TALKING TO PEOPLE
Daniel Bourke
 58 GET-TO vs. HAVE-TO
GET-TO vs. HAVE-TO
Daniel Bourke
 59 3 Life Principles I Learned From Ray Dalio
3 Life Principles I Learned From Ray Dalio
Daniel Bourke
 60 PYTHON && POETRY | 100 Days of Code 16
PYTHON && POETRY | 100 Days of Code 16
Daniel Bourke
India’s Orange Economy Explained
Next Up
India’s Orange Economy Explained
Full Disclosure