Understanding Transformers in plain English

Title: Understanding Transformers in plain English

URL Source: https://medium.com/@subhashrinivasan/understanding-transformers-in-plain-english-f9572a83bb5b?source=rss------machine_learning-5

Published Time: 2026-06-24T16:03:58Z

Markdown Content:
[Sitemap](https://medium.com/sitemap/sitemap.xml)

[Open in app](https://play.google.com/store/apps/details?id=com.medium.reader&referrer=utm_source%3DmobileNavBar&source=post_page---top_nav_layout_nav-----------------------------------------)

Sign up

[Sign in](https://medium.com/m/signin?operation=login&redirect=https%3A%2F%2Fmedium.com%2F%40subhashrinivasan%2Funderstanding-transformers-in-plain-english-f9572a83bb5b&source=post_page---top_nav_layout_nav-----------------------global_nav------------------)

[](https://medium.com/?source=post_page---top_nav_layout_nav-----------------------------------------)

Get app

[Write](https://medium.com/m/signin?operation=register&redirect=https%3A%2F%2Fmedium.com%2Fnew-story&source=---top_nav_layout_nav-----------------------new_post_topnav------------------)

[Search](https://medium.com/search?source=post_page---top_nav_layout_nav-----------------------------------------)

Sign up

[Sign in](https://medium.com/m/signin?operation=login&redirect=https%3A%2F%2Fmedium.com%2F%40subhashrinivasan%2Funderstanding-transformers-in-plain-english-f9572a83bb5b&source=post_page---top_nav_layout_nav-----------------------global_nav------------------)


Member-only story

# Understanding Transformers in plain English

[](https://medium.com/@subhashrinivasan?source=post_page---byline--f9572a83bb5b---------------------------------------)

[Subhashrinivasan](https://medium.com/@subhashrinivasan?source=post_page---byline--f9572a83bb5b---------------------------------------)

Follow

5 min read

·

1 hour ago

[](https://medium.com/m/signin?actionUrl=https%3A%2F%2Fmedium.com%2F_%2Fvote%2Fp%2Ff9572a83bb5b&operation=register&redirect=https%3A%2F%2Fmedium.com%2F%40subhashrinivasan%2Funderstanding-transformers-in-plain-english-f9572a83bb5b&user=Subhashrinivasan&userId=1d98bc9ed627&source=---header_actions--f9572a83bb5b---------------------clap_footer------------------)

[](https://medium.com/m/signin?actionUrl=https%3A%2F%2Fmedium.com%2F_%2Frepost%2Fp%2Ff9572a83bb5b&operation=register&redirect=https%3A%2F%2Fmedium.com%2F%40subhashrinivasan%2Funderstanding-transformers-in-plain-english-f9572a83bb5b&user=Subhashrinivasan&userId=1d98bc9ed627&source=---header_actions--f9572a83bb5b---------------------repost_header------------------)

[](https://medium.com/m/signin?actionUrl=https%3A%2F%2Fmedium.com%2F_%2Fbookmark%2Fp%2Ff9572a83bb5b&operation=register&redirect=https%3A%2F%2Fmedium.com%2F%40subhashrinivasan%2Funderstanding-transformers-in-plain-english-f9572a83bb5b&source=---header_actions--f9572a83bb5b---------------------bookmark_footer------------------)

[Listen](https://medium.com/m/signin?actionUrl=https%3A%2F%2Fmedium.com%2Fplans%3Fdimension%3Dpost_audio_button%26postId%3Df9572a83bb5b&operation=register&redirect=https%3A%2F%2Fmedium.com%2F%40subhashrinivasan%2Funderstanding-transformers-in-plain-english-f9572a83bb5b&source=---header_actions--f9572a83bb5b---------------------post_audio_button------------------)

Share

Press enter or click to view image in full size


In this blog, I explain how Transformers work in the simplest possible language. If you are someone like me, without a deep machine learning background but you understand systems and data flow, you’ll understand transformers.

The blog is organized as a sequence of transitions of the input token, with one leading to the other in the generation of the output token.

## What is a Transformer?

A Transformer is a deep n