Integrating LLMs into a Go service without losing your mind (or adding 550ms latency)

Right, so. This is a post I wish existed six months ago when we were first wiring LLMs into our Go...