LLM Architecture Gallery
📰 Hacker News · tzury
Explore a curated gallery of 83 modern language-model architectures, comparing diagrams, implementation links, and key features.
Action Steps
- Browse the LLM Architecture Gallery to explore 83 modern language-model architectures
- Use the architecture diff tool to compare two models side by side
- Download the print-ready digital poster or purchase a physical poster on Redbubble to support the project
- Contribute to the project by submitting corrections or suggestions through the issue tracker
- Explore the implementation links and code for each model to learn more about their architecture and design
Who Needs to Know This
Data scientists, AI engineers, and researchers can use this gallery to stay up-to-date on the latest LLM architectures and compare their features.
Key Insight
💡 The LLM Architecture Gallery provides a comprehensive and curated reference for modern language-model architectures, making it easier to compare and learn from different models.
Share This
🚀 Explore 83 modern LLM architectures in one place! 🤖
Key Takeaways
Explore a curated gallery of 83 modern language-model architectures, comparing diagrams, implementation links, and key features.
Full Article
Title: LLM Architecture Gallery | Sebastian Raschka, PhD
URL Source: https://sebastianraschka.com/llm-architecture-gallery/
Published Time: Wed, 01 Jul 2026 01:01:11 GMT
Markdown Content:
[Skip to main content](https://sebastianraschka.com/llm-architecture-gallery/#main-content)
[Sebastian Raschka](https://sebastianraschka.com/)[](https://x.com/rasbt "X")[](https://www.linkedin.com/in/sebastianraschka/ "LinkedIn")[](https://github.com/rasbt "GitHub")
🌙
Search this website Submit search
[Home](https://sebastianraschka.com/)[ Blog](https://magazine.sebastianraschka.com/)[Books](https://sebastianraschka.com/books)[Courses](https://sebastianraschka.com/teaching)[LLM Gallery](https://sebastianraschka.com/llm-architecture-gallery/)[LLMs From Scratch](https://sebastianraschka.com/llms-from-scratch/)[Reasoning Models](https://sebastianraschka.com/reasoning-from-scratch/)[Talks](https://sebastianraschka.com/elsewhere)
More
[Blog Archive](https://sebastianraschka.com/blog/)[Quick Paper and Model Notes](https://sebastianraschka.com/notes/)[Research](https://sebastianraschka.com/publications/)[About](https://sebastianraschka.com/about/)
# LLM Architecture Gallery
### A curated reference for modern language-model architectures
Compare architecture diagrams, implementation links, release dates, attention mechanisms, decoder types, and compact fact sheets without digging through individual posts.
83 models
Jun 18 last updated
[Browse gallery](https://sebastianraschka.com/llm-architecture-gallery/#architecture-gallery)[Compare two models](https://sebastianraschka.com/llm-architecture-gallery/#architecture-diff-tool)[Changes](https://sebastianraschka.com/llm-architecture-gallery/changelog/)[RSS](https://sebastianraschka.com/llm-architecture-gallery/rss.xml)
The gallery focuses on text-only LLMs and language-model backbones. For multimodal releases, cards usually describe the text decoder/backbone rather than every vision, audio, or image-generation component.
Corrections are welcome in the [issue tracker](https://github.com/rasbt/LLMs-from-scratch/issues/new?labels=architecture-gallery&title=Architecture%20Gallery%3A%20). If the latest changes are missing, try a hard reload (macOS: Command + Shift + R; Windows: Ctrl + F5).
#### Poster and print-ready download
Several readers asked for a way to support this project, so the gallery is now available as a physical poster on Redbubble and, upon request, as a print-ready digital download on Gumroad. I ordered the Redbubble print to check the quality; the photo shows the Medium size (26.9 x 23.4 in).
[Physical Poster](https://www.redbubble.com/i/poster/LLM-Architecture-Gallery-by-Ahead-of-AI/179274487/flk2)[Digital Download](https://rasbt.gumroad.com/l/llm-gallery)
Architecture diff tool
### Select two models to compare their architectures
If you want to compare two architectures side by side instead of browsing the gallery, use this diff tool. You can use the selectors here or the `Model A` / `Model B` actions on each card.
Model A Model B
Swap Clear
[Jump to Model A](https://sebastianraschka.com/llm-architecture-gallery/#)[Jump to Model B](https://sebastianraschka.com/llm-arch
URL Source: https://sebastianraschka.com/llm-architecture-gallery/
Published Time: Wed, 01 Jul 2026 01:01:11 GMT
Markdown Content:
[Skip to main content](https://sebastianraschka.com/llm-architecture-gallery/#main-content)
[Sebastian Raschka](https://sebastianraschka.com/)[](https://x.com/rasbt "X")[](https://www.linkedin.com/in/sebastianraschka/ "LinkedIn")[](https://github.com/rasbt "GitHub")
🌙
Search this website Submit search
[Home](https://sebastianraschka.com/)[ Blog](https://magazine.sebastianraschka.com/)[Books](https://sebastianraschka.com/books)[Courses](https://sebastianraschka.com/teaching)[LLM Gallery](https://sebastianraschka.com/llm-architecture-gallery/)[LLMs From Scratch](https://sebastianraschka.com/llms-from-scratch/)[Reasoning Models](https://sebastianraschka.com/reasoning-from-scratch/)[Talks](https://sebastianraschka.com/elsewhere)
More
[Blog Archive](https://sebastianraschka.com/blog/)[Quick Paper and Model Notes](https://sebastianraschka.com/notes/)[Research](https://sebastianraschka.com/publications/)[About](https://sebastianraschka.com/about/)
# LLM Architecture Gallery
### A curated reference for modern language-model architectures
Compare architecture diagrams, implementation links, release dates, attention mechanisms, decoder types, and compact fact sheets without digging through individual posts.
83 models
Jun 18 last updated
[Browse gallery](https://sebastianraschka.com/llm-architecture-gallery/#architecture-gallery)[Compare two models](https://sebastianraschka.com/llm-architecture-gallery/#architecture-diff-tool)[Changes](https://sebastianraschka.com/llm-architecture-gallery/changelog/)[RSS](https://sebastianraschka.com/llm-architecture-gallery/rss.xml)
The gallery focuses on text-only LLMs and language-model backbones. For multimodal releases, cards usually describe the text decoder/backbone rather than every vision, audio, or image-generation component.
Corrections are welcome in the [issue tracker](https://github.com/rasbt/LLMs-from-scratch/issues/new?labels=architecture-gallery&title=Architecture%20Gallery%3A%20). If the latest changes are missing, try a hard reload (macOS: Command + Shift + R; Windows: Ctrl + F5).
#### Poster and print-ready download
Several readers asked for a way to support this project, so the gallery is now available as a physical poster on Redbubble and, upon request, as a print-ready digital download on Gumroad. I ordered the Redbubble print to check the quality; the photo shows the Medium size (26.9 x 23.4 in).
[Physical Poster](https://www.redbubble.com/i/poster/LLM-Architecture-Gallery-by-Ahead-of-AI/179274487/flk2)[Digital Download](https://rasbt.gumroad.com/l/llm-gallery)
Architecture diff tool
### Select two models to compare their architectures
If you want to compare two architectures side by side instead of browsing the gallery, use this diff tool. You can use the selectors here or the `Model A` / `Model B` actions on each card.
Model A Model B
Swap Clear
[Jump to Model A](https://sebastianraschka.com/llm-architecture-gallery/#)[Jump to Model B](https://sebastianraschka.com/llm-arch
DeepCamp AI