Playground in Prod - Optimising Agents in Production Environments — Samuel Colvin, Pydantic

Deploying an agent is only the start. In this workshop, Samuel Colvin shows how to improve agents after they are already live, using Pydantic AI and Logfire to change prompts, models, and other parameters in production without redeploying or restarting services. The session covers managed variables for live prompt and model updates, how to run evals and compare prompt variants against real datasets, and how GEPA can be used to evolve better prompts from production traces and feedback signals. If you're building agents in production and want a practical path from manual tuning to continuous optimization, this is a strong hands-on walkthrough. Speaker info: - https://x.com/samuelcolvin - https://www.linkedin.com/in/samuel-colvin/ - https://github.com/samuelcolvin