The Demo Worked on a 7B Model. Production Traffic Changed the Math.

The demo looked fine on a small model with one user. Then real traffic showed up, latency got ugly,...