AI is Building Our Data Pipelines Now (Estuary Live Demo)
Skills:
AI Workflow Automation90%
What if the most notoriously tedious parts of data engineering could be completely handed over to AI? In this live demo from Data Driven NYC, Estuary CEO David Yaffe discusses how they are using Claude to automatically generate, diagnose, and deploy complex, real-time data pipelines. Forget spending weeks wrestling with schema evolution, broken connectors, and manual ETL formatting—watch as David prompts an AI agent to instantly write a production-ready YAML specification that seamlessly connects Postgres, Snowflake, and BigQuery right before the audience's eyes.
03:07 – The "20% Problem" (Why manual data pipelines always break)
05:00 – Live Audience Demo: Moving live Postgres data to Snowflake in milliseconds
08:03 – Watch Claude write a complete pipeline YAML spec in seconds
09:52 – Why "Building Blocks" are the only way to survive the AI hype cycle
Estuary
Website - https://estuary.dev/
X/Twitter - https://x.com/Estuary
HOSTED BY:
FirstMark Capital
Website - https://firstmark.com
X/Twitter - https://twitter.com/FirstMarkCap
Matt Turck (Managing Director)
Blog - https://mattturck.com
LinkedIn - https://www.linkedin.com/in/turck/
X/Twitter - https://twitter.com/mattturck
This session was recorded live at a recent Data Driven NYC, our in-person, monthly event series. If you are ever in New York, you can join the upcoming events by following FirstMark on Luma: https://luma.com/firstmarkcap
Check out the MAD Podcast:
Spotify - https://open.spotify.com/show/7yLATDSaFvgJG80ACcRJtq
Apple - https://podcasts.apple.com/us/podcast/the-mad-podcast-with-matt-turck/id1686238724
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
More on: AI Workflow Automation
View skill →Related AI Lessons
Chapters (4)
3:07
The "20% Problem" (Why manual data pipelines always break)
5:00
Live Audience Demo: Moving live Postgres data to Snowflake in milliseconds
8:03
Watch Claude write a complete pipeline YAML spec in seconds
9:52
Why "Building Blocks" are the only way to survive the AI hype cycle
🎓
Tutor Explanation
DeepCamp AI