A Visual Tour of Modern LLM Architectures

LLM Architecture Gallery: https://sebastianraschka.com/llm-architecture-gallery/ In this video, I take you on a visual tour of modern LLM architectures and walk through the key ideas behind models like DeepSeek, Qwen3-Next, Kimi, Sarvam, Ling 2.5, and Nemotron. We look at what actually changed in recent LLM design, including grouped-query attention (GQA), sliding-window attention, multi-head latent attention (MLA), DeepSeek sparse attention, and hybrid linear attention. The goal of the gallery is to make it easier to compare architectures side by side, connect the diagrams back to papers, c…