Recursion Is The Next Scaling Law In AI

Y Combinator · Beginner ·🚀 Entrepreneurship & Startups ·1w ago
A 7-million parameter model outperforming models a thousand times its size on tasks like ARC Prize. That's what recursive reasoning unlocks. In this episode of Decoded, YC's Ankit Gupta and Francois Chaubard break down two recent papers on recursive AI models, HRMs and TRMs, that are achieving state-of-the-art results with a fraction of the parameters of today's largest models. They explain why standard LLMs hit a fundamental ceiling on certain reasoning tasks, how recursion at inference time gives small models the compute depth to break through it, and what happens when you combine these ideas with the power of large-scale foundation models. Apply to Y Combinator: https://www.ycombinator.com/apply Work at a startup: https://www.ycombinator.com/jobs 00:00 - Intro 00:35 - Model Foundations 01:15 - RNN Limits and LLM Contrast 02:36 - Reasoning Limits and Sorting Analogy 04:22 - HRM Paper Introduction 05:25 - HRM Architecture and Intuition 07:36 - HRM Results and Outer Loop 09:46 - TRM Paper Overview 11:20 - TRM Training and Fixed Point 13:30 - Detailed HRM Summary 20:46 - Comparing HRM and TRM 34:45 - Future Outlook and Outro
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related AI Lessons

After 25 years of writing the cheques himself, Bezos is opening Blue Origin to outsiders
Blue Origin considers external funding after 25 years, potentially disrupting the space industry, and it's crucial to understand the implications of this move on the market and competitors like SpaceX
The Next Web AI
What the "Bus Factor" Problem Looks Like for Solopreneurs
Learn how the bus factor problem affects solopreneurs and why it matters for business continuity
Dev.to · Khalfan
Reducing Startup Costs With Automation: A Real Playbook
Learn how to reduce startup costs with automation and create a playbook for implementation
Dev.to · AdamVibe
How to Validate Your Startup Idea for Free in 2026 — A Step-by-Step Framework
Learn to validate your startup idea for free with a step-by-step framework to minimize risks and increase chances of success
Dev.to · John Leslie

Chapters (12)

Intro
0:35 Model Foundations
1:15 RNN Limits and LLM Contrast
2:36 Reasoning Limits and Sorting Analogy
4:22 HRM Paper Introduction
5:25 HRM Architecture and Intuition
7:36 HRM Results and Outer Loop
9:46 TRM Paper Overview
11:20 TRM Training and Fixed Point
13:30 Detailed HRM Summary
20:46 Comparing HRM and TRM
34:45 Future Outlook and Outro
Up next
20 Questions To Help You Start a Business
Coursera
Watch →