How Cursor Trained Composer on Fireworks: Distributed Infrastructure for High-Performance RL
Key Takeaways
Federico Cassano and Dmytro Dzhulgakov discuss training Composer on Fireworks
Original Description
Cursor's Federico Cassano and Fireworks' Dmytro Dzhulgakov explain how they collaborated to build Composer as a specialized foundation model. The core insight: models have finite capacity in their weights, and allocating all those bits to the singular task of software engineering in Cursor frees the model to be both better at the task and far more efficient at inference. Rather than start from pre-training and work up, they took an unconventional top-down approach — mid-training and RL on top of an open-source base to get a useful model into users' hands fast, then specializing the model around real Cursor usage. With Fireworks providing distributed infrastructure, Composer delivers frontier-class coding performance with the speed of a much smaller model.
Hosted by Sonya Huang, Sequoia Capital
00:00 Introduction
00:53 Why Cursor Trained Composer 2
04:55 Specialization vs Bitter Lesson
06:16 Composer 2 Training Recipe
16:32 Scaling RL Infrastructure Worldwide
23:32 Floating Point Drift
25:11 MoE Sensitivity Explained
26:25 Router Replay Fix
27:19 Real Time RL Loop
31:49 Long Horizon Agents
34:29 Why RL Everywhere
37:34 LLM as Judge Rewards
39:14 RL in Hard Domains
40:13 Build Your Own Environments
44:34 Closing Thoughts
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
More on: LLM Engineering
View skill →Related Reads
📰
📰
📰
📰
A lightweight workflow for keeping up with AI conference papers
Dev.to · Daniel
Why CitedEvidence Believes Great Researchers Read Less Than You Think
Medium · AI
How to Write a Literature Review That Actually Argues Something
Medium · Machine Learning
I Built a Personal Paper Engine to Stop Losing Research Papers
Dev.to · Ethan
Chapters (15)
Introduction
0:53
Why Cursor Trained Composer 2
4:55
Specialization vs Bitter Lesson
6:16
Composer 2 Training Recipe
16:32
Scaling RL Infrastructure Worldwide
23:32
Floating Point Drift
25:11
MoE Sensitivity Explained
26:25
Router Replay Fix
27:19
Real Time RL Loop
31:49
Long Horizon Agents
34:29
Why RL Everywhere
37:34
LLM as Judge Rewards
39:14
RL in Hard Domains
40:13
Build Your Own Environments
44:34
Closing Thoughts
🎓
Tutor Explanation
DeepCamp AI