How Zyphra went all-in on AMD + Why Devs feel faster with AI but are slower — with Quentin Anthony

OpenAI recently made waves by being the first big model lab to commit to a hyperscale AMD cluster (together with their own Titan XPUs), giving AMD the first biglab silicon win outside of Nvidia/Google. Returning guest Quentin Anthony, Head of Model Training at Zyphra and advisor at EleutherAI, has recently done this same transition. In part 1 of this pod, Quentin describes his journey from working on Oak Ridge National Lab's Frontier supercomputer to leading Zyphra's ambitious move to AMD MI300X GPUs, where they're achieving performance that beats NVIDIA H100s on certain workloads while dramatically reducing costs. The discussion dives deep into the technical challenges of kernel development, with Quentin explaining why he often bypasses high-level frameworks like Triton to write directly in ROCm or even GPU assembly when necessary. In Part 2, Quentin then candidly discusses his experience in the controversial METR software engineering productivity study, which found that developers felt 20% faster while using AI coding tools, but were in fact 20% slower. Quentin was one of the few developers who showed measurable speedup from AI tools. He shares practical insights on avoiding the "slot machine effect" of endlessly prompting models, the importance of context rot awareness, and why he prefers direct API access over tools like Cursor to maintain complete control over model context. The conversation also covers the state of open source AI research, with Quentin arguing that siloed, focused teams with guaranteed funding produce better results than grand collaborative efforts. He explains why kernel datasets alone won't solve the GPU programming problem, the challenges of evaluating kernel quality, and why companies should invest more in ecosystem development rather than traditional marketing. https://www.linkedin.com/in/quentin-anthony/ https://www.zyphra.com/post/zamba2-7b *Key Topics:* • AMD MI300X advantages: 192GB VRAM, superior memory bandwidth • Writing kernels