Why Static Load Balancing Fails for LLM Infrastructure (And What Works Instead)

When Team Maxim started building Bifrost, they assumed load balancing for LLM requests would work...