The Architecture Wars Are Back: Mamba-3 Challenges Transformers While Nvidia Fights to Keep Them Alive

Mamba-3 claims to beat Transformers on language modeling. Nvidia drops a technique to shrink LLM memory 20x. The foundational architecture of AI is genuinely in play for the first time since 2017.