GlimpRouter: Efficient Collaborative Inference by Glimpsing One Token of Thoughts

arXiv:2601.05110v3 Announce Type: replace Abstract: Large Reasoning Models (LRMs) achieve remarkable performance by explicitly generating multi-step chains of thought, but this capability incurs substantial inference latency and computational cost. Collaborative inference offers a promising solution by selectively allocating work between lightweight and large models, yet a fundamental challenge remains: determining when a reasoning step requires the capacity of a large model or the efficiency of