How I accidentally built a cost tracking tool for LLMs

Last month I got an API bill that made me physically flinch. $2,847. I had no idea where it came...