RevNet: Backpropagation without Storing Activations

Connor Shorten · Advanced ·📄 Research Papers Explained ·6y ago
This video presents the Reversible ResNet! This technique saves enormous amounts of memory at the trade-off of more computation! Thanks for watching, please Subscribe! Paper Link: https://arxiv.org/pdf/1707.04585.pdf
Watch on YouTube ↗ (saves to browser)

Playlist

Uploads from Connor Shorten · Connor Shorten · 42 of 60

1 DenseNets
DenseNets
Connor Shorten
2 DeepWalk Explained
DeepWalk Explained
Connor Shorten
3 Inception Network Explained
Inception Network Explained
Connor Shorten
4 AutoAugment
AutoAugment
Connor Shorten
5 StackGAN
StackGAN
Connor Shorten
6 StyleGAN
StyleGAN
Connor Shorten
7 Progressive Growing of GANs Explained
Progressive Growing of GANs Explained
Connor Shorten
8 Improved Techniques for Training GANs
Improved Techniques for Training GANs
Connor Shorten
9 Word2Vec Explained
Word2Vec Explained
Connor Shorten
10 Must Read Papers on GANs
Must Read Papers on GANs
Connor Shorten
11 Unsupervised Feature Learning
Unsupervised Feature Learning
Connor Shorten
12 Self-Supervised GANs
Self-Supervised GANs
Connor Shorten
13 Embedding Graphs with Deep Learning
Embedding Graphs with Deep Learning
Connor Shorten
14 Transfer Learning in GANs
Transfer Learning in GANs
Connor Shorten
15 ReLU Activation Function
ReLU Activation Function
Connor Shorten
16 AC-GAN Explained
AC-GAN Explained
Connor Shorten
17 SimGAN Explained
SimGAN Explained
Connor Shorten
18 DC-GAN Explained!
DC-GAN Explained!
Connor Shorten
19 ResNet Explained!
ResNet Explained!
Connor Shorten
20 Graph Convolutional Networks
Graph Convolutional Networks
Connor Shorten
21 Neural Architecture Search
Neural Architecture Search
Connor Shorten
22 Henry AI Labs
Henry AI Labs
Connor Shorten
23 Video Classification with Deep Learning
Video Classification with Deep Learning
Connor Shorten
24 BigGANs in Data Augmentation
BigGANs in Data Augmentation
Connor Shorten
25 Introduction to Deep Learning
Introduction to Deep Learning
Connor Shorten
26 EfficientNet Explained!
EfficientNet Explained!
Connor Shorten
27 Self-Attention GAN
Self-Attention GAN
Connor Shorten
28 Curriculum Learning in Deep Neural Networks
Curriculum Learning in Deep Neural Networks
Connor Shorten
29 Deep Learning Podcast #1 | Edward Dixon | Stochastic Weight Averaging
Deep Learning Podcast #1 | Edward Dixon | Stochastic Weight Averaging
Connor Shorten
30 Deep Compression
Deep Compression
Connor Shorten
31 Skin Cancer Classification with Deep Learning
Skin Cancer Classification with Deep Learning
Connor Shorten
32 Deep Learning Podcast #2 | Edward Peake | Deep Learning in Medical Imaging
Deep Learning Podcast #2 | Edward Peake | Deep Learning in Medical Imaging
Connor Shorten
33 The Lottery Ticket Hypothesis Explained!
The Lottery Ticket Hypothesis Explained!
Connor Shorten
34 SqueezeNet
SqueezeNet
Connor Shorten
35 GauGAN Explained!
GauGAN Explained!
Connor Shorten
36 AutoML with Hyperband
AutoML with Hyperband
Connor Shorten
37 DL Podcast #3 | Yannic Kilcher | Population-Based Search
DL Podcast #3 | Yannic Kilcher | Population-Based Search
Connor Shorten
38 Weakly Supervised Pretraining
Weakly Supervised Pretraining
Connor Shorten
39 Image Data Augmentation for Deep Learning
Image Data Augmentation for Deep Learning
Connor Shorten
40 Unsupervised Data Augmentation
Unsupervised Data Augmentation
Connor Shorten
41 Wide ResNet Explained!
Wide ResNet Explained!
Connor Shorten
RevNet: Backpropagation without Storing Activations
RevNet: Backpropagation without Storing Activations
Connor Shorten
43 GANs with Fewer Labels
GANs with Fewer Labels
Connor Shorten
44 BigBiGAN Unsupervised Learning!
BigBiGAN Unsupervised Learning!
Connor Shorten
45 Self-Supervised Learning
Self-Supervised Learning
Connor Shorten
46 Multi-Task Self-Supervised Learning
Multi-Task Self-Supervised Learning
Connor Shorten
47 Self-Supervised GANs
Self-Supervised GANs
Connor Shorten
48 Population Based Training
Population Based Training
Connor Shorten
49 Show, Attend and Tell
Show, Attend and Tell
Connor Shorten
50 Siamese Neural Networks
Siamese Neural Networks
Connor Shorten
51 WaveGAN Explained!
WaveGAN Explained!
Connor Shorten
52 VAE-GAN Explained!
VAE-GAN Explained!
Connor Shorten
53 Evolution in Neural Architecture Search!
Evolution in Neural Architecture Search!
Connor Shorten
54 AI Research Weekly Update August 18th, 2019
AI Research Weekly Update August 18th, 2019
Connor Shorten
55 Weight Agnostic Neural Networks Explained!
Weight Agnostic Neural Networks Explained!
Connor Shorten
56 AI Research Weekly Update August 25th, 2019
AI Research Weekly Update August 25th, 2019
Connor Shorten
57 Neuroevolution of Augmenting Topologies (NEAT)
Neuroevolution of Augmenting Topologies (NEAT)
Connor Shorten
58 CoDeepNEAT
CoDeepNEAT
Connor Shorten
59 AI Research Weekly Update September 1st, 2019
AI Research Weekly Update September 1st, 2019
Connor Shorten
60 Randomly Wired Neural Networks
Randomly Wired Neural Networks
Connor Shorten
How to Ace a Career Change Interview
Next Up
How to Ace a Career Change Interview
Coursera