Build agentic testing systems to validate AI generated code | ODSP912

Microsoft Developer · Intermediate ·🤖 AI Agents & Automation ·1mo ago

Key Takeaways

Builds agentic testing systems to validate AI-generated code using autonomous agents

Original Description

AI is driving rapid expansion of software, but vibe coding lacks the rigor needed for reliability. Traditional tests can’t keep pace with agent-generated logic. To scale, we must move beyond manual checks to Agentic Testing: using autonomous agents to validate autonomous systems. Explore patterns for creating autonomous test agents, detecting failures across workflows, and continuously verifying behavior. Take away practical approaches to make AI-driven software reliable and production ready. 𝗦𝗲𝘀𝘀𝗶𝗼𝗻 𝗜𝗻𝗳𝗼𝗿𝗺𝗮𝘁𝗶𝗼𝗻: This is one of many sessions from the Microsoft Build 2026 event. View even more sessions on-demand and learn about Microsoft Build at https://build.microsoft.com ODSP912 | English (US) | Agents & apps Pre-recorded | (300) Advanced #MSBuild Chapters: 0:00 - Exploring the challenge of validating autonomous agent-built applications 00:03:41 - Markdown-based TestMD framework integration for CI/CD 00:04:08 - Shareable evidence through video logs and trace runs 00:05:28 - Starting test case execution and opening KNCLI in interactive mode 00:07:21 - Initializing KNCLI session within agent environment 00:08:35 - Demonstration of KNCLI aiding AI agents in building and testing end-to-end workflows 00:09:23 - Order placement and test data generation for checkout 00:10:02 - First workflow completed and preparing for second step 00:10:45 - Workflow successfully completed and test passed
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related Reads

📰
The Automatic Triage: Using AI to Prioritize Indie Game Feedback
Learn how to use AI to prioritize indie game feedback with a Prioritization Matrix, streamlining your development process and improving player satisfaction
Dev.to AI
📰
A Receipt Is Not Proof Forever. It Is a Promise to Reopen the Claim.
A receipt is not proof forever, but rather a promise to reopen a claim, highlighting the importance of verification and validation in AI and software development
Dev.to AI
📰
The Hidden Bottleneck in Robot Learning Isn’t Algorithms — It’s Environments
Robot learning is hindered by a lack of shared environments, not algorithms, and simulation-first robotics needs standardized scenes, rules, and arenas
Dev.to AI
📰
I Built a One-Curl Audio Translator with Telnyx AI Inference
Learn how to build a one-curl audio translator using Telnyx AI Inference for podcast localization, meeting translation, and lecture dubbing
Dev.to · anusha

Chapters (9)

Exploring the challenge of validating autonomous agent-built applications
3:41 Markdown-based TestMD framework integration for CI/CD
4:08 Shareable evidence through video logs and trace runs
5:28 Starting test case execution and opening KNCLI in interactive mode
7:21 Initializing KNCLI session within agent environment
8:35 Demonstration of KNCLI aiding AI agents in building and testing end-to-end wor
9:23 Order placement and test data generation for checkout
10:02 First workflow completed and preparing for second step
10:45 Workflow successfully completed and test passed
Up next
How To Build Your Own RAG AI System - Better Results Than Claude
Web Dev Simplified
Watch →