Your Ground Truth Is Wrong: Evaluating STT with truth files & semantic WER | AssemblyAI Workshop
AssemblyAI Applied AI Engineers hosted a live workshop where they walked through how to evaluate speech-to-text models with real-world audio.
Get the TL;DR on:
- How to build a STT evaluation framework (async and streaming)
- A/B testing in production and alternatives to WER that actually predict performance
- Tips for evaluating across messy, real-world audio with ground truth best practices
Ready to test on your own audio?
📄 No-code Truth File Corrector: https://www.assemblyai.com/dashboard/tools/truth-file-corrector?utm_source=youtube&utm_medium=referral&utm_campaign=workshop&utm_conten…
Watch on YouTube ↗
(saves to browser)
DeepCamp AI