NVIDIA DGX Spark vs RTX 4090 | LLM inference, training speed and more

Daniel Bourke · Beginner ·📰 AI News & Updates ·3mo ago
This video compares the NVIDIA DGX Spark and NVIDIA RTX 4090 across several benchmarks and attributes such as price and footprint. Benchmark code - https://github.com/mrdbourke/gpu-benchmarking Exolabs blog post - https://blog.exolabs.net/nvidia-dgx-spark/ DGX Spark - https://nvda.ws/4iQXZU4 Deep learning PC specs - https://pcpartpicker.com/user/mrdbourke/saved/#view=sJCnGX Courses I teach: Learn AI/ML (beginner-friendly course) - https://dbourke.link/ZTMMLcourse Learn Hugging Face - https://dbourke.link/ZTMHuggingFace Learn TensorFlow - https://dbourke.link/ZTMTFcourse Learn PyTorch - https://dbourke.link/ZTMPyTorch Connect elsewhere: Download Nutrify (my startup) - https://apple.co/4ahM7Wc My website - https://www.mrdbourke.com X/Twitter - https://www.twitter.com/mrdbourke LinkedIn - https://www.linkedin.com/in/mrdbourke Get email updates on my work - https://dbourke.link/newsletter Read my novel Charlie Walks - https://www.charliewalks.com Timestamps: 0:50 - RTX 4090 vs DGX Spark Specs 1:57 - Quick Summary (note: spoilers) 2:39 - Footprint and Size 4:02 - Benchmarks Overview 4:43 - Results 4:48 - vLLM Input and Output Speed 5:06 - llama.cpp Input and Output Speed 6:32 - Image Generation Results 7:08 - LLM Fine-tuning 8:42 - Object Detection Model Fine-tuning 9:11 - What should you get?
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Daniel Bourke · Daniel Bourke · 0 of 60

← Previous Next →
1 Xbox One S Unboxing and Xbox One Comparison
Xbox One S Unboxing and Xbox One Comparison
Daniel Bourke
 2 Text/Profanity Checker in Python
Text/Profanity Checker in Python
Daniel Bourke
 3 Drawing Flowers in Python
Drawing Flowers in Python
Daniel Bourke
 4 Finding The Right Medium - TDBS 18 April 2017
Finding The Right Medium - TDBS 18 April 2017
Daniel Bourke
 5 What Is Neuralink??! - TDBS 22 April 2017
What Is Neuralink??! - TDBS 22 April 2017
Daniel Bourke
 6 Disagree and Commit, Words of Wisdom from Jeff Bezos - TDBS 19 April 2017
Disagree and Commit, Words of Wisdom from Jeff Bezos - TDBS 19 April 2017
Daniel Bourke
 7 A Lesson In Movement | Raw Training Australia
A Lesson In Movement | Raw Training Australia
Daniel Bourke
 8 FALLING IS FUN | Functional Friday 4
FALLING IS FUN | Functional Friday 4
Daniel Bourke
 9 My first HACKATHON! | 100 Days of Code 1
My first HACKATHON! | 100 Days of Code 1
Daniel Bourke
 10 MORE MACHINE LEARNING | 100 Days of Code 2
MORE MACHINE LEARNING | 100 Days of Code 2
Daniel Bourke
 11 TensorBoard and learning from Einstein | 100 Days of Code 3
TensorBoard and learning from Einstein | 100 Days of Code 3
Daniel Bourke
 12 Job Interview Tips and Open Ocean Swim | 100 Days of Code 4
Job Interview Tips and Open Ocean Swim | 100 Days of Code 4
Daniel Bourke
 13 I Want To Help 100,000 People Workout | AI Powered Personal Trainer
I Want To Help 100,000 People Workout | AI Powered Personal Trainer
Daniel Bourke
 14 MACHINE LEARNING IN 5 MINUTES
MACHINE LEARNING IN 5 MINUTES
Daniel Bourke
 15 COFFEE, YOGA and AWS | 100 Days of Code 5
COFFEE, YOGA and AWS | 100 Days of Code 5
Daniel Bourke
 16 MY FIRST STARTUP WEEKEND | 100 Days of Code 6
MY FIRST STARTUP WEEKEND | 100 Days of Code 6
Daniel Bourke
 17 GENERATING TV SCRIPTS WITH DEEP LEARNING | 100 Days of Code 7
GENERATING TV SCRIPTS WITH DEEP LEARNING | 100 Days of Code 7
Daniel Bourke
 18 Attention, please
Attention, please
Daniel Bourke
 19 TEACHING BOTS TO PLAY GAMES | 100 Days of Code 9
TEACHING BOTS TO PLAY GAMES | 100 Days of Code 9
Daniel Bourke
 20 Udacity Deep Learning Nanodegree Language Translation Project Submission | 100 Days of Code 10
Udacity Deep Learning Nanodegree Language Translation Project Submission | 100 Days of Code 10
Daniel Bourke
 21 Learning about Generative Adversarial Networks on Udacity | 100 Days of Code 11
Learning about Generative Adversarial Networks on Udacity | 100 Days of Code 11
Daniel Bourke
 22 Completing Andrew Ng's Machine Learning Course on Coursera | 100 Days of Code 12
Completing Andrew Ng's Machine Learning Course on Coursera | 100 Days of Code 12
Daniel Bourke
 23 Finishing the Treehouse Python Track | 100 Days of Code 13
Finishing the Treehouse Python Track | 100 Days of Code 13
Daniel Bourke
 24 GENERATING FACES WITH GANs | 100 Days of Code 14
GENERATING FACES WITH GANs | 100 Days of Code 14
Daniel Bourke
 25 Graduating From the Udacity Deep Learning Nanodegree | 100 Days of Code 15
Graduating From the Udacity Deep Learning Nanodegree | 100 Days of Code 15
Daniel Bourke
 26 WHAT I'VE LEARNED FROM TALKING TO PEOPLE
WHAT I'VE LEARNED FROM TALKING TO PEOPLE
Daniel Bourke
 27 3 Life Principles I Learned From Ray Dalio
3 Life Principles I Learned From Ray Dalio
Daniel Bourke
 28 PYTHON && POETRY | 100 Days of Code 16
PYTHON && POETRY | 100 Days of Code 16
Daniel Bourke
 29 Physique Update and 6 Things I Wish I Knew Before Starting Gym
Physique Update and 6 Things I Wish I Knew Before Starting Gym
Daniel Bourke
 30 The 100 Days is Over! | 100 Days of Code 17
The 100 Days is Over! | 100 Days of Code 17
Daniel Bourke
 31 How to Burn Over 100 Calories in 4 Minutes
How to Burn Over 100 Calories in 4 Minutes
Daniel Bourke
 32 Solving Sudoku with AI | Learning Intelligence 1
Solving Sudoku with AI | Learning Intelligence 1
Daniel Bourke
 33 Upper Body Calisthenics Workout in the Park
Upper Body Calisthenics Workout in the Park
Daniel Bourke
 34 What is an Adversarial Search Agent? | Learning Intelligence 2
What is an Adversarial Search Agent? | Learning Intelligence 2
Daniel Bourke
 35 My Self-Created Artificial Intelligence Master's Degree | Learning Intelligence 0
My Self-Created Artificial Intelligence Master's Degree | Learning Intelligence 0
Daniel Bourke
 36 Try Going Over It Again | Learning Intelligence 3
Try Going Over It Again | Learning Intelligence 3
Daniel Bourke
 37 Python and Pullups | Learning Intelligence 4
Python and Pullups | Learning Intelligence 4
Daniel Bourke
 38 AI Meets Blockchain! | Learning Intelligence 5
AI Meets Blockchain! | Learning Intelligence 5
Daniel Bourke
 39 How to Pass the Turing Test + I FAILED | Learning Intelligence 6
How to Pass the Turing Test + I FAILED | Learning Intelligence 6
Daniel Bourke
 40 Biology and Physics meet Computer Science | Learning Intelligence 7
Biology and Physics meet Computer Science | Learning Intelligence 7
Daniel Bourke
 41 Udacity Artificial Intelligence Nanodegree Project 3 Progress | Learning Intelligence 8
Udacity Artificial Intelligence Nanodegree Project 3 Progress | Learning Intelligence 8
Daniel Bourke
 42 Passing Project 3 of Udacity's Artificial Intelligence Nanodegree | Learning Intelligence 9
Passing Project 3 of Udacity's Artificial Intelligence Nanodegree | Learning Intelligence 9
Daniel Bourke
 43 Bayes Networks, Hidden Markov Models and How I Wake Up | Learning Intelligence 10
Bayes Networks, Hidden Markov Models and How I Wake Up | Learning Intelligence 10
Daniel Bourke
 44 Udacity AI Nanodegree Progress and Bayes' Rule Explained | Learning Intelligence 11
Udacity AI Nanodegree Progress and Bayes' Rule Explained | Learning Intelligence 11
Daniel Bourke
 45 Udacity AI Nanodegree Project 4 Planning and Progress | Learning Intelligence 12
Udacity AI Nanodegree Project 4 Planning and Progress | Learning Intelligence 12
Daniel Bourke
 46 Finishing Term 1 of Udacity's Artificial Intelligence Nanodegree | Learning Intelligence 13
Finishing Term 1 of Udacity's Artificial Intelligence Nanodegree | Learning Intelligence 13
Daniel Bourke
 47 deeplearning.ai Progress! | Learning Intelligence 14
deeplearning.ai Progress! | Learning Intelligence 14
Daniel Bourke
 48 Coursera Deep Learning Specialization Progress | Learning Intelligence 15
Coursera Deep Learning Specialization Progress | Learning Intelligence 15
Daniel Bourke
 49 Computer Vision Basics + More deeplearning.ai Progress! | Learning Intelligence 16
Computer Vision Basics + More deeplearning.ai Progress! | Learning Intelligence 16
Daniel Bourke
 50 My Experience at CodeCamp, Intro to Keras and Failing Hard | Learning Intelligence 17
My Experience at CodeCamp, Intro to Keras and Failing Hard | Learning Intelligence 17
Daniel Bourke
 51 In-Depth Udacity Deep Learning Nanodegree Review
In-Depth Udacity Deep Learning Nanodegree Review
Daniel Bourke
 52 Completing the Deeplearning.ai Specialization on Coursera | Learning Intelligence 18
Completing the Deeplearning.ai Specialization on Coursera | Learning Intelligence 18
Daniel Bourke
 53 You're Never Too Young to Start Learning AI - Learning Intelligence Talks with Shaik Asad
You're Never Too Young to Start Learning AI - Learning Intelligence Talks with Shaik Asad
Daniel Bourke
 54 Starting Term 2 of the Udacity Artificial Intelligence Nanodegree | Learning Intelligence 19
Starting Term 2 of the Udacity Artificial Intelligence Nanodegree | Learning Intelligence 19
Daniel Bourke
 55 Submitting the Computer Vision Capstone Project | Udacity AI Nanodegree | Learning Intelligence 20
Submitting the Computer Vision Capstone Project | Udacity AI Nanodegree | Learning Intelligence 20
Daniel Bourke
 56 Leg Day at World Gym Northlakes ft. Ben Jones Fitness
Leg Day at World Gym Northlakes ft. Ben Jones Fitness
Daniel Bourke
 57 deeplearning.ai Sequence Models Course Progress | Learning Intelligence 21
deeplearning.ai Sequence Models Course Progress | Learning Intelligence 21
Daniel Bourke
 58 Graduating from the deeplearning.ai Coursera Specialization | Learning Intelligence 22
Graduating from the deeplearning.ai Coursera Specialization | Learning Intelligence 22
Daniel Bourke
 59 Udacity Artificial Intelligence Nanodegree NLP Concentration Progress | Learning Intelligence 23
Udacity Artificial Intelligence Nanodegree NLP Concentration Progress | Learning Intelligence 23
Daniel Bourke
 60 Learning How to Build What's Next at Google Cloud On Board Brisbane
Learning How to Build What's Next at Google Cloud On Board Brisbane
Daniel Bourke

Related AI Lessons

⚡
AI Is Accelerating. Our Human Systems Are Not.
AI is advancing rapidly, but human systems are struggling to keep pace, highlighting a need for urgent adaptation
Medium · AI
 ⚡
Your Entire Economy Is Now Dependent On AI Spending — And Nobody Told You
The economy is increasingly dependent on AI spending, which may have unseen consequences, making it crucial to understand and monitor AI's impact
Medium · AI
 ⚡
BlackRock Signals AI Spending Has Reached Macroeconomic Scale, Disrupting Portfolio Strategy
BlackRock warns that AI spending has reached a macroeconomic scale, disrupting portfolio strategy and requiring a fundamental shift in investment approaches
Dev.to AI
 ⚡
Big Tech firms are accelerating AI investments and integration, while regulators and companies focus on safety and responsible adoption.
Big Tech firms are investing heavily in AI, driving growth and transformation, while prioritizing safety and responsible adoption
Dev.to AI

Chapters (11)

0:50 RTX 4090 vs DGX Spark Specs
1:57 Quick Summary (note: spoilers)
2:39 Footprint and Size
4:02 Benchmarks Overview
4:43 Results
4:48 vLLM Input and Output Speed
5:06 llama.cpp Input and Output Speed
6:32 Image Generation Results
7:08 LLM Fine-tuning
8:42 Object Detection Model Fine-tuning
9:11 What should you get?
Up next
Why OpenAI Is Feuding With Apple
The Information
Watch →