Understanding TDT: The Mechanism Behind the Fastest Models on the Open ASR Leaderboard

TL;DR: The Token-and-Duration Transducer (TDT) extends RNN-T by jointly predicting what token to emit...