The relationship between convolution & self-attention
Full video: https://youtu.be/KnCRTP11p5U?si=SP2WfoTYZQlTKzRN
This is a clip from a full deep-dive that explains why Transformer-based models have replaced Convolutional Neural Networks (CNN) in computer vision.
Watch on YouTube ↗
(saves to browser)
DeepCamp AI