AI is Building Our Data Pipelines Now (Estuary Live Demo)

The MAD Podcast with Matt Turck · Intermediate ·🛠️ AI Tools & Apps ·2h ago
What if the most notoriously tedious parts of data engineering could be completely handed over to AI? In this live demo from Data Driven NYC, Estuary CEO David Yaffe discusses how they are using Claude to automatically generate, diagnose, and deploy complex, real-time data pipelines. Forget spending weeks wrestling with schema evolution, broken connectors, and manual ETL formatting—watch as David prompts an AI agent to instantly write a production-ready YAML specification that seamlessly connects Postgres, Snowflake, and BigQuery right before the audience's eyes. 03:07 – The "20% Problem" (Why manual data pipelines always break) 05:00 – Live Audience Demo: Moving live Postgres data to Snowflake in milliseconds 08:03 – Watch Claude write a complete pipeline YAML spec in seconds 09:52 – Why "Building Blocks" are the only way to survive the AI hype cycle Estuary Website - https://estuary.dev/ X/Twitter - https://x.com/Estuary HOSTED BY: FirstMark Capital Website - https://firstmark.com X/Twitter - https://twitter.com/FirstMarkCap Matt Turck (Managing Director) Blog - https://mattturck.com LinkedIn - https://www.linkedin.com/in/turck/ X/Twitter - https://twitter.com/mattturck This session was recorded live at a recent Data Driven NYC, our in-person, monthly event series. If you are ever in New York, you can join the upcoming events by following FirstMark on Luma: https://luma.com/firstmarkcap Check out the MAD Podcast: Spotify - https://open.spotify.com/show/7yLATDSaFvgJG80ACcRJtq Apple - https://podcasts.apple.com/us/podcast/the-mad-podcast-with-matt-turck/id1686238724
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related AI Lessons

Chapters (4)

3:07 The "20% Problem" (Why manual data pipelines always break)
5:00 Live Audience Demo: Moving live Postgres data to Snowflake in milliseconds
8:03 Watch Claude write a complete pipeline YAML spec in seconds
9:52 Why "Building Blocks" are the only way to survive the AI hype cycle
Up next
New Way Now: Fetcherr delivers AI-driven decisions for maximum market impact with Google Cloud
Google Cloud
Watch →