KV cache memory calculator: how much does your LLM actually use?

Before you can compress something, you need to know how big it is. Most engineers know the KV cache...