Phoenix in Python: Debug RAG Failures with Traces and Evals

Professor Py: AI Engineering · Beginner ·🛠️ AI Tools & Apps ·1mo ago

About this lesson

Debug RAG pipelines with Phoenix traces and Python to pinpoint whether the retriever or the generator failed. Learn a reproducible workflow to trace retrieval runs, replay traced runs, inspect retriever outputs and generated text, and attach eval spans to find failing links fast. Demo uses Phoenix (OpenTelemetry bridge), Phoenix Python client and pandas with span instrumentation and a keyword-recall evaluation. Subscribe for step-by-step AI engineering and LLM debugging tutorials. #RAG #PhoenixTracing #OpenTelemetry #Python #LLMDebugging #AIEngineering #RetrievalAugmentedGeneration

Original Description

Debug RAG pipelines with Phoenix traces and Python to pinpoint whether the retriever or the generator failed. Learn a reproducible workflow to trace retrieval runs, replay traced runs, inspect retriever outputs and generated text, and attach eval spans to find failing links fast. Demo uses Phoenix (OpenTelemetry bridge), Phoenix Python client and pandas with span instrumentation and a keyword-recall evaluation. Subscribe for step-by-step AI engineering and LLM debugging tutorials. #RAG #PhoenixTracing #OpenTelemetry #Python #LLMDebugging #AIEngineering #RetrievalAugmentedGeneration
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related Reads

📰
3 Free AI Tools I Use to Save Hours Every Week
Discover 3 free AI tools to automate repetitive tasks and save hours every week, boosting productivity
Dev.to · Hari Haran
📰
My AI Bill Dropped 95% When I Switched to Chinese Models
Switching to Chinese AI models can significantly reduce costs, with one company experiencing a 95% drop in their AI bill, making it a viable option for businesses looking to cut expenses.
Dev.to AI
📰
AI Dubbing for Short Drama: The 2026 Playbook That Actually Scales
Learn how to scale AI dubbing for short drama with the 2026 playbook, improving efficiency and quality in audio post-production
Dev.to AI
📰
Why AI App Backends Are Becoming Accounting Systems
Learn how AI app backends are evolving into accounting systems and why it matters for SaaS businesses
Dev.to · StructureIntelligence
Up next
Advanced Tutorial NotebookLM Slides For Powerpoint
Russell Stannard (TTVideos)
Watch →