Sliding Window Attention (Longformer) Explained

In this video we talk about the sliding window attention, the diluted sliding window attention and the global+sliding window ...