The Demo Was One User. Then Batch Size Became Real.

The demo worked because the test was one user, one prompt, one response. Then real usage showed up,...