The Dangerous Illusion of AI Coding? - Jeremy Howard
Dive into the realities of AI-assisted coding, the origins of modern fine-tuning, and the cognitive science behind machine learning with fast.ai founder Jeremy Howard. In this episode, we unpack why AI might be turning software engineering into a slot machine and how to maintain true technical intuition in the age of large language models.
GTC is coming, the premier AI conference, great opportunity to learn about AI. NVIDIA and partners will showcase breakthroughs in physical AI, AI factories, agentic AI, and inference, exploring the next wave of AI innovation for developers and researchers. Register for virtual GTC for free, using my link and win NVIDIA DGX Spark (https://nvda.ws/4qQ0LMg)
Jeremy Howard is a renowned data scientist, researcher, entrepreneur, and educator. As the co-founder of fast.ai, former President of Kaggle, and the creator of ULMFiT, Jeremy has spent decades democratizing deep learning. His pioneering work laid the foundation for modern transfer learning and the pre-training and fine-tuning paradigm that powers today's language models.
Key Topics and Main Insights Discussed:
- The Origins of ULMFiT and Fine-Tuning
- The Vibe Coding Illusion and Software Engineering
- Cognitive Science, Friction, and Learning
- The Future of Developers
RESCRIPT: https://app.rescript.info/public/share/BhX5zP3b0m63srLOQDKBTFTooSzEMh_ARwmDG_h_izk
https://app.rescript.info/api/public/sessions/62d06c0336c567d6/pdf
Jeremy Howard:
https://x.com/jeremyphoward
https://www.answer.ai/
---
TIMESTAMPS (fixed):
00:00:00 Introduction & GTC Sponsor
00:04:30 ULMFiT & The Birth of Fine-Tuning
00:12:00 Intuition & The Mechanics of Learning
00:18:30 Abstraction Hierarchies & AI Creativity
00:23:00 Claude Code & The Interpolation Illusion
00:27:30 Coding vs. Software Engineering
00:30:00 Cosplaying Intelligence: Dennett vs. Searle
00:36:30 Automation, Radiology & Desirable Difficulty
00:42:30 Organizational Knowledge & The Slope
00:48:00 Vibe Coding as a Slot Machine
00:54:00
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
More on: LLM Engineering
View skill →Related AI Lessons
⚡
⚡
⚡
⚡
The Four Knowledge Systems Almost Nobody Gets Right
Medium · AI
The Four Knowledge Systems Almost Nobody Gets Right
Medium · Data Science
The Four Knowledge Systems Almost Nobody Gets Right
Medium · Programming
Large Language Model MY Learnings On LLM from Scratch (Sebastian) [PART 1]
Medium · AI
Chapters (10)
Introduction & GTC Sponsor
4:30
ULMFiT & The Birth of Fine-Tuning
12:00
Intuition & The Mechanics of Learning
18:30
Abstraction Hierarchies & AI Creativity
23:00
Claude Code & The Interpolation Illusion
27:30
Coding vs. Software Engineering
30:00
Cosplaying Intelligence: Dennett vs. Searle
36:30
Automation, Radiology & Desirable Difficulty
42:30
Organizational Knowledge & The Slope
48:00
Vibe Coding as a Slot Machine
🎓
Tutor Explanation
DeepCamp AI