Small Models That Reason — Data, RL, Test-Time Compute | ML Math

Zariga Tongy · Beginner ·🧠 Large Language Models ·3mo ago

About this lesson

Reasoning without giant parameter counts: quality data, reinforcement learning / search, and spending compute at inference time — mechanisms over benchmarks. Prereq: neural nets (5.3), transformers (5.4). 🔗 https://8gwifi.org/math #reasoning #RL #small models #LLM #AI

Original Description

Reasoning without giant parameter counts: quality data, reinforcement learning / search, and spending compute at inference time — mechanisms over benchmarks. Prereq: neural nets (5.3), transformers (5.4). 🔗 https://8gwifi.org/math #reasoning #RL #small models #LLM #AI

Watch on YouTube ↗ (saves to browser)

Sign in to unlock AI tutor explanation · ⚡30

Related Reads

Sharing your ideas to ai

Sharing ideas with AI can provide different perspectives, improve ideas, and affect their perceived value, as seen in personal project experiences with various AI tools

Reddit r/artificial

Inside Kimi K3: The Architecture, the Training, and the Tasks It Actually Wins

Explore the architecture, training, and capabilities of Kimi K3, the largest open model announced, and understand its winning tasks

Getting Started with Microsoft Foundry Local: Running AI Models Without the Cloud

Run AI models locally without the cloud using Microsoft Foundry Local and build a fully local RAG assistant

Medium · Python

Inkling by Mira Murati: US Best open-weights AI Model is here

Learn how to use Inkling, the US Best open-weights AI Model, for free and unlock its potential in machine learning applications

Medium · Machine Learning

5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems

Dave Ebbelaar (LLM Eng)