How I Built an AI Guitar Teacher | Learn To Use AI with Live Video
In this video, Roboflow Engineer Felipe Tomino walks us through a custom computer vision application he built to help people practice guitar scales. The application uses a webcam to detect a guitar in real-time, mapping out the fretboard, sound hole, and other features. From there, the application overlays an interactive diagram for practicing scales.
You'll hear about how Felipe used Roboflow’s Auto Label feature to quickly annotate his dataset, train a custom model, and then power the application with Roboflow's Serverless Video API which allows for processing live video streams via WebRTC.…
Watch on YouTube ↗
(saves to browser)
Chapters (5)
Introduction: Why build a vision app to practice guitar?
2:27
Preparing the dataset with Auto Label
5:32
Powering the app with the Serverless Video API
7:44
Code overview: Connecting WebRTC to a Canvas Overlay
9:31
Live Demo: Practicing Guitar Scales in Real-Time
DeepCamp AI