Population Based Training

Connor Shorten · Advanced ·📄 Research Papers Explained ·6y ago

Key Takeaways

Explains the Population Based Training algorithm for jointly optimizing parameters and hyperparameters of a Deep Neural Network

Original Description

This video explains the Population Based Training algorithm developed by DeepMind. This algorithm (similar to genetic algorithms) jointly optimizes the parameters and hyperparameters of a Deep Neural Network. The algorithm was applied to Data Augmentation achieving similar results to a computationally exhaustive Reinforcement Learning search technique known as AutoAugment. Thank you for watching! Please Subscribe! Paper Links: https://arxiv.org/abs/1711.09846 https://arxiv.org/abs/1905.05393
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Connor Shorten · Connor Shorten · 47 of 60

← Previous Next →
1 DenseNets
DenseNets
Connor Shorten
 2 DeepWalk Explained
DeepWalk Explained
Connor Shorten
 3 Inception Network Explained
Inception Network Explained
Connor Shorten
 4 StackGAN
StackGAN
Connor Shorten
 5 StyleGAN
StyleGAN
Connor Shorten
 6 Progressive Growing of GANs Explained
Progressive Growing of GANs Explained
Connor Shorten
 7 Improved Techniques for Training GANs
Improved Techniques for Training GANs
Connor Shorten
 8 Word2Vec Explained
Word2Vec Explained
Connor Shorten
 9 Must Read Papers on GANs
Must Read Papers on GANs
Connor Shorten
 10 Unsupervised Feature Learning
Unsupervised Feature Learning
Connor Shorten
 11 Self-Supervised GANs
Self-Supervised GANs
Connor Shorten
 12 Embedding Graphs with Deep Learning
Embedding Graphs with Deep Learning
Connor Shorten
 13 Transfer Learning in GANs
Transfer Learning in GANs
Connor Shorten
 14 ReLU Activation Function
ReLU Activation Function
Connor Shorten
 15 AC-GAN Explained
AC-GAN Explained
Connor Shorten
 16 SimGAN Explained
SimGAN Explained
Connor Shorten
 17 DC-GAN Explained!
DC-GAN Explained!
Connor Shorten
 18 ResNet Explained!
ResNet Explained!
Connor Shorten
 19 Graph Convolutional Networks
Graph Convolutional Networks
Connor Shorten
 20 Neural Architecture Search
Neural Architecture Search
Connor Shorten
 21 Henry AI Labs
Henry AI Labs
Connor Shorten
 22 Video Classification with Deep Learning
Video Classification with Deep Learning
Connor Shorten
 23 BigGANs in Data Augmentation
BigGANs in Data Augmentation
Connor Shorten
 24 Introduction to Deep Learning
Introduction to Deep Learning
Connor Shorten
 25 EfficientNet Explained!
EfficientNet Explained!
Connor Shorten
 26 Self-Attention GAN
Self-Attention GAN
Connor Shorten
 27 Curriculum Learning in Deep Neural Networks
Curriculum Learning in Deep Neural Networks
Connor Shorten
 28 Deep Learning Podcast #1 | Edward Dixon | Stochastic Weight Averaging
Deep Learning Podcast #1 | Edward Dixon | Stochastic Weight Averaging
Connor Shorten
 29 Deep Compression
Deep Compression
Connor Shorten
 30 Skin Cancer Classification with Deep Learning
Skin Cancer Classification with Deep Learning
Connor Shorten
 31 Deep Learning Podcast #2 | Edward Peake | Deep Learning in Medical Imaging
Deep Learning Podcast #2 | Edward Peake | Deep Learning in Medical Imaging
Connor Shorten
 32 The Lottery Ticket Hypothesis Explained!
The Lottery Ticket Hypothesis Explained!
Connor Shorten
 33 SqueezeNet
SqueezeNet
Connor Shorten
 34 GauGAN Explained!
GauGAN Explained!
Connor Shorten
 35 AutoML with Hyperband
AutoML with Hyperband
Connor Shorten
 36 DL Podcast #3 | Yannic Kilcher | Population-Based Search
DL Podcast #3 | Yannic Kilcher | Population-Based Search
Connor Shorten
 37 Weakly Supervised Pretraining
Weakly Supervised Pretraining
Connor Shorten
 38 Image Data Augmentation for Deep Learning
Image Data Augmentation for Deep Learning
Connor Shorten
 39 Unsupervised Data Augmentation
Unsupervised Data Augmentation
Connor Shorten
 40 Wide ResNet Explained!
Wide ResNet Explained!
Connor Shorten
 41 RevNet: Backpropagation without Storing Activations
RevNet: Backpropagation without Storing Activations
Connor Shorten
 42 GANs with Fewer Labels
GANs with Fewer Labels
Connor Shorten
 43 BigBiGAN Unsupervised Learning!
BigBiGAN Unsupervised Learning!
Connor Shorten
 44 Self-Supervised Learning
Self-Supervised Learning
Connor Shorten
 45 Multi-Task Self-Supervised Learning
Multi-Task Self-Supervised Learning
Connor Shorten
 46 Self-Supervised GANs
Self-Supervised GANs
Connor Shorten
 ▶ Population Based Training
Population Based Training
Connor Shorten
 48 Show, Attend and Tell
Show, Attend and Tell
Connor Shorten
 49 Siamese Neural Networks
Siamese Neural Networks
Connor Shorten
 50 WaveGAN Explained!
WaveGAN Explained!
Connor Shorten
 51 VAE-GAN Explained!
VAE-GAN Explained!
Connor Shorten
 52 Evolution in Neural Architecture Search!
Evolution in Neural Architecture Search!
Connor Shorten
 53 AI Research Weekly Update August 18th, 2019
AI Research Weekly Update August 18th, 2019
Connor Shorten
 54 Weight Agnostic Neural Networks Explained!
Weight Agnostic Neural Networks Explained!
Connor Shorten
 55 AI Research Weekly Update August 25th, 2019
AI Research Weekly Update August 25th, 2019
Connor Shorten
 56 Neuroevolution of Augmenting Topologies (NEAT)
Neuroevolution of Augmenting Topologies (NEAT)
Connor Shorten
 57 CoDeepNEAT
CoDeepNEAT
Connor Shorten
 58 AI Research Weekly Update September 1st, 2019
AI Research Weekly Update September 1st, 2019
Connor Shorten
 59 Randomly Wired Neural Networks
Randomly Wired Neural Networks
Connor Shorten
 60 Genetic CNN
Genetic CNN
Connor Shorten

Related Reads

📰
On July 1, 2026, arXiv will spin out from Cornell University, its home for the past 25 years, to become an independent nonprofit organization. Major funding support from Simons Foundation and Schmidt Sciences. Ditching the red for their website. [N]
arXiv is becoming an independent nonprofit organization after 25 years at Cornell University, backed by major funding, which will impact the future of research and academia
Reddit r/MachineLearning
 📰
CS-NRRM™ Official Publications: Paper 1 and Paper 2 Are Now Available
Learn about the CS-NRRM's official publications on a 12-year longitudinal human observation archive and its significance in research and development
Medium · Data Science
 📰
Found a potential mistake in an ICLR 2026 blogpost [D]
Verify a potential mistake in an ICLR 2026 blog post and learn how to effectively report errors in academic publications
Reddit r/MachineLearning
 📰
Rebuttals Move Peer-Review Scores, but Initial-Review Structure Bounds the Movement
Learn how author rebuttals impact peer-review scores and the factors that influence their effectiveness in ICLR 2024-2025, using LLMs for measurement
ArXiv cs.AI
Up next
Indians Under House Arrest in America? 😱 Immigration Crisis Explained | SumanTV Classroom
SumanTV Classroom
Watch →