Tokenization and Embeddings in Transformers

Before self-attention in the transformer model, there's a phase called data preparation. Let's say we have a simple sentence like ...