STOP Using AdamW, EVERYONE Uses Muon Now

Vuk Rosić · Advanced ·📄 Research Papers Explained ·3w ago
github - https://github.com/vukrosic/muon-optimizer-guide/blob/main/course/muon_optimizer_guide.md Become AI Researcher - https://www.skool.com/become-ai-researcher-2669/about --- X - https://x.com/VukRosic99 Discord (do AI research with us) - https://discord.gg/6AbXGpKTwN Full AI Research Course - https://youtu.be/44l-xL7OKLo 0:00 Why Use Muon 0:24 Muon Training Experiments 1:03 Basic Weight Updates 1:33 The AdamW Problem 3:11 How Muon Works 4:55 Muon Usage Rules 5:19 Code And Implementation 6:23 Robotics AI Testing
Watch on YouTube ↗ (saves to browser)

Chapters (8)

Why Use Muon
0:24 Muon Training Experiments
1:03 Basic Weight Updates
1:33 The AdamW Problem
3:11 How Muon Works
4:55 Muon Usage Rules
5:19 Code And Implementation
6:23 Robotics AI Testing
Resilience in Children Exposed to Trauma, Disaster and War: Global Perspectives
Next Up
Resilience in Children Exposed to Trauma, Disaster and War: Global Perspectives
Coursera