Fine-Tuning a "Tab Tab" Code Completion Model

Oxen · Beginner ·🧠 Large Language Models ·11mo ago

Key Takeaways

This video demonstrates fine-tuning a code completion model with a tab tab approach

Original Description

Links + Notes 📝 https://www.oxen.ai/blog Join Fine-Tune Fridays 🔧 https://oxen.ai/community Discord 🗿 https://discord.com/invite/s3tBEn7Ptg Use Oxen AI 🐂 https://oxen.ai/ Oxen.ai offers one click fine-tuning or fine-tunes for you! Built on top of the worlds best data versioning tool, we offer tools to automate model evals, generate synthetic data, and effortlessly fine-tune models. -- Chapters 0:00 Intro to Building a Cursor-like “Tab Tab” Code Completion Model 1:55 What is Marimo 6:31 The Task: “Tab Tab” 9:11 Use Case Specific Constraints 10:33 The Formula 11:56 Vibing with Qwen3 Coder 480B Instruct 14:23 Examples of the Input and Output Format 23:15 The Evaluating Dataset 29:01 The Training Dataset 37:36 The Results (Comparing GPT, Claude, Qwen, and Llama Models) 42:29 Next Steps
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related AI Lessons

⚡
How We Translate 300-Page Books Using Claude Without Hitting Token Limits
Learn how to translate long documents using Claude without hitting token limits by breaking them into overlapping chunks
Dev.to · 龚旭东
 ⚡
Building HITL Feedback RAG: Embeddings, Retrieval, and Reranking
Learn to build a Human-in-the-Loop (HITL) Feedback RAG system using embeddings, retrieval, and reranking to improve model performance
Medium · AI
 ⚡
Building HITL Feedback RAG: Embeddings, Retrieval, and Reranking
Learn to build a Human-in-the-Loop (HITL) Feedback RAG system using embeddings, retrieval, and reranking to improve LLM performance
Medium · LLM
 ⚡
A simple way to test model fallbacks with RouterBase
Learn to test model fallbacks with RouterBase using a simple fallback wrapper and OpenAI-compatible API surface
Dev.to · routerbasecom

Chapters (11)

Intro to Building a Cursor-like “Tab Tab” Code Completion Model
1:55 What is Marimo
6:31 The Task: “Tab Tab”
9:11 Use Case Specific Constraints
10:33 The Formula
11:56 Vibing with Qwen3 Coder 480B Instruct
14:23 Examples of the Input and Output Format
23:15 The Evaluating Dataset
29:01 The Training Dataset
37:36 The Results (Comparing GPT, Claude, Qwen, and Llama Models)
42:29 Next Steps
Up next
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)
Watch →