The Latency Goldilocks Zone Explained

Rafael (Head of Innovation, iFood) and Daniel (Data and AI Manager, iFood) pull back the curtain on ILO-Agent — iFood's conversational AI ordering system built for 200 million users across Latin America. Recorded live at AI House Amsterdam, this conversation goes deep into the engineering and product decisions behind building recommendation systems and agentic AI, and why the speed of your AI's response might actually be destroying user trust. The Latency Goldilocks Zone Explained // MLOps Podcast #376 with iFood's Rafael Borger (Head of Innovation) and Daniel Wolbert (Data and AI Manager) 🍕 Recommendation Systems at Scale — Why personalizing for 200M users with wildly different food tastes, budgets, and cultures is a fundamentally different problem than standard ML 🤖 ILO-Agent Deep Dive — What iFood's conversational AI agent actually does, how it handles open-ended requests ("a romantic dinner for two, my wife hates onions"), and where it's headed ⏱️ The Latency Goldilocks Zone — The fascinating insight that LLM responses can be too fast (users don't trust them) or too slow (users abandon) — and how to find the sweet spot 🧠 Perceived vs. Actual Latency — Why showing progress indicators and partial results can make a 6-second response feel instant, and how iFood uses this in production 🛒 The Tinder for Food Experience — How iFood is experimenting with swipe-based discovery to solve "I don't know what I want to eat" for millions of undecided users 🗣️ Voice vs. Text AI Interfaces — Why voice ordering limits you to 6 items in 30 seconds, and why text-based agents need radically different output design 🔗 Agent-to-Agent (A2A) Architectures — What happens when your customer support agent and your ordering agent need to collaborate, and the standardization challenges ahead 📊 Measuring Product-Market Fit for AI — Why the Sean Ellis / Chanel score method breaks down in Brazil, and what iFood uses instead 🏗️ Scalability vs. Ecosystem Health — The real tension betwee