SmolGPT: A minimal PyTorch implementation for training a small LLM from scratch

📰 Hacker News · amrrs

SmolGPT: A minimal PyTorch implementation for training a small LLM from scratch. 55 comments, 434 points on Hacker News.

Published 29 Jan 2025