Attention Complexity Made Simple: Examples, Analogies & Memory Tricks

Attention complexity describes how the computation and memory required by self-attention grow as the sequence length increases. Continue reading on Medium »