Conversational AI Meets SQL Server: Real-Time Orchestration with LangGraph and LangChain

In this episode of Data Exposed, Data Platform MVP Ömer Çolakoğlu demonstrates how to build a real-time, voice-enabled orchestration system that connects LLMs with SQL Server using LangGraph and LangChain. The architecture enables natural language queries to trigger modular tools that return live data eliminating hallucinations and ensuring precision. Through a real-world simulation in the manufacturing industry, Ömer showcases how agents can retrieve order, inventory, and cost data using only human language. With voice commands, dynamic prompt handling, and direct SQL access, this solution redefines how we interact with enterprise systems. 0:00 Introduction 2:10 Scenario 4:33 What are Azure AI, LangChain, LandGraph, and Speech Technologies 5:14 Scenario 5:29 Lang Chain and Lang Chain in Action 8:00 Integration in LandGraph Workflow 8:25 Demo 11:17 Conclusion 12:30 Getting started About Ömer Faruk ÇOLAKOĞLU: Ömer Çolakoğlu has been a Data Platform MVP from Turkey since 2020. He began his career as a software developer in the IT industry in 2003, where he was introduced to SQL Server. Over the years, he transitioned into database administration, working as a SQL Server DBA since 2006. Currently, he serves as the IT Manager for a private company. Ömer is also a passionate educator, delivering online courses on various platforms. With over 15 courses and more than 350,000 students worldwide, he has made a significant impact in the field of online education. As a public speaker, Ömer has delivered numerous talks to students and business people, including two TEDx Talks. A true community enthusiast, he is actively involved in many volunteer groups, dedicating his time and expertise to support and uplift others. About MVPs: Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologi