Simplest explanation of Layer Normalization in Transformers
➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖
Timestamps:
0:00 Intro
0:25 Why normalization is needed?
1:58 What is normalization?
3:47 Internal Covariate Shift
6:20 Batch Normalization
11:34 Layer Normalization in Transformers
15:57 Outro
➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖
Follow my entire Transformers playlist :
📕 Transformers Playlist: https://www.youtube.com/watch?v=lRylkiFdUdk&list=PLuhqtP7jdD8CQTxwVsuiFYGvHtFpNhlR3&index=1&t=0s
➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖
✔ RNN Playlist: https://www.youtube.com/watch?v=lWPkNkShNbo&list=PLuhqtP7jdD8ARBnzj8SZwNFhwWT89fAFr&t=0s
✔ CNN Playlist: https://www.youtube.com/watch?v=E5Z7FQp7AQQ&list=PLuhqtP7jdD8CD6rO…
Watch on YouTube ↗
(saves to browser)
Chapters (7)
Intro
0:25
Why normalization is needed?
1:58
What is normalization?
3:47
Internal Covariate Shift
6:20
Batch Normalization
11:34
Layer Normalization in Transformers
15:57
Outro
DeepCamp AI