Build a BPE tokenizer in 30 lines of Python and you will never read a prompt the same way again

Most engineers who use language models every day cannot, on a blank piece of paper, describe what...