Foundations

Deep Learning

Neural networks, CNNs, RNNs, transformers, diffusion models and training techniques

2,917
lessons
Skills in this topic
View full skill map →
Neural Network Basics
beginner
Implement a 2-layer net in NumPy and PyTorch
CNN Architectures
intermediate
Build a CNN image classifier in PyTorch
Sequence Models
intermediate
Implement an LSTM text generator
Generative Models
advanced
Train a GAN on image data
Training at Scale
advanced
Use FP16/BF16 mixed precision training
[VLP Tutorial @ CVPR 2022] Image-Text Pre-training Part III
Deep Learning
[VLP Tutorial @ CVPR 2022] Image-Text Pre-training Part III
Microsoft Research Advanced 4y ago
The Unofficial PyTorch Optimization Loop Song
Deep Learning
The Unofficial PyTorch Optimization Loop Song
Daniel Bourke Advanced 4y ago
JAX MD: A Framework for Differentiable Atomistic Physics
Deep Learning ⚡ AI Lesson
JAX MD: A Framework for Differentiable Atomistic Physics
Weights & Biases Advanced 4y ago
BUILDING AN AI-POWERED SURGICAL INTELLIGENCE PLATFORM FOR THE OPERATING ROOM | OMRI BAR
Deep Learning
BUILDING AN AI-POWERED SURGICAL INTELLIGENCE PLATFORM FOR THE OPERATING ROOM | OMRI BAR
PyTorch Advanced 4y ago
TORCHSTUDIO,  A FULL FEATURED IDE FOR PYTORCH | ROBIN LOBEL
Deep Learning
TORCHSTUDIO, A FULL FEATURED IDE FOR PYTORCH | ROBIN LOBEL
PyTorch Advanced 4y ago
Bring your own training completed Pytorch model
Deep Learning
Bring your own training completed Pytorch model
My experiences on the IT "Battlefield" Advanced 4y ago
The Post processing step in Question Answering (TensorFlow)
Deep Learning
The Post processing step in Question Answering (TensorFlow)
HuggingFace Advanced 4y ago
The Post processing step in Question Answering (PyTorch)
Deep Learning
The Post processing step in Question Answering (PyTorch)
HuggingFace Advanced 4y ago
Zero-Shot Detection via Vision and Language Knowledge Distillation
Deep Learning ⚡ AI Lesson
Zero-Shot Detection via Vision and Language Knowledge Distillation
Microsoft Research Advanced 4y ago
Robust Fine-Tuning of Zero-Shot Models
Deep Learning
Robust Fine-Tuning of Zero-Shot Models
Connor Shorten Advanced 4y ago
Applications of Variational Autoencoders and Bayesian Optimization w/ J. M. Hernández Lobato - #510
Deep Learning ⚡ AI Lesson
Applications of Variational Autoencoders and Bayesian Optimization w/ J. M. Hernández Lobato - #510
The TWIML AI Podcast with Sam Charrington Advanced 4y ago
Playing a Neural Network's version of GTA V: GAN Theft Auto
Deep Learning ⚡ AI Lesson
Playing a Neural Network's version of GTA V: GAN Theft Auto
sentdex Advanced 5y ago
Tutorial 2- Fine Tuning Pretrained Model On Custom Dataset Using 🤗 Transformer
Deep Learning
Tutorial 2- Fine Tuning Pretrained Model On Custom Dataset Using 🤗 Transformer
Krish Naik Advanced 5y ago
Tutorial 1-Transformer And Bert Implementation With Huggingface
Deep Learning
Tutorial 1-Transformer And Bert Implementation With Huggingface
Krish Naik Advanced 5y ago
Learning Long-Time Dependencies with RNNs w/ Konstantin Rusch - #484
Deep Learning ⚡ AI Lesson
Learning Long-Time Dependencies with RNNs w/ Konstantin Rusch - #484
The TWIML AI Podcast with Sam Charrington Advanced 5y ago
AI Weekly Update - March 22nd, 2021 (#29)!
Deep Learning
AI Weekly Update - March 22nd, 2021 (#29)!
Connor Shorten Advanced 5y ago
NFNets: High-Performance Large-Scale Image Recognition Without Normalization (ML Paper Explained)
Deep Learning ⚡ AI Lesson
NFNets: High-Performance Large-Scale Image Recognition Without Normalization (ML Paper Explained)
Yannic Kilcher Advanced 5y ago
Build a 1D convolutional neural network, part 4: Training, evaluation, reporting
Deep Learning
Build a 1D convolutional neural network, part 4: Training, evaluation, reporting
Brandon Rohrer Advanced 5y ago
Implement 1D convolution, part 1: Convolution in Python from scratch
Deep Learning
Implement 1D convolution, part 1: Convolution in Python from scratch
Brandon Rohrer Advanced 5y ago
TUTEL-MoE-STACK OPTIMIZATION FOR MODERN DISTRIBUTED TRAINING | RAFAEL SALAS & YIFAN XIONG
Deep Learning
TUTEL-MoE-STACK OPTIMIZATION FOR MODERN DISTRIBUTED TRAINING | RAFAEL SALAS & YIFAN XIONG
PyTorch Advanced 4y ago
What to do when you get an error?
Deep Learning
What to do when you get an error?
HuggingFace Advanced 4y ago
Inside the Token classification pipeline (TensorFlow)
Deep Learning
Inside the Token classification pipeline (TensorFlow)
HuggingFace Advanced 4y ago
Debugging the Training Pipeline (TensorFlow)
Deep Learning
Debugging the Training Pipeline (TensorFlow)
HuggingFace Advanced 4y ago
Inside the Question answering pipeline (TensorFlow)
Deep Learning
Inside the Question answering pipeline (TensorFlow)
HuggingFace Advanced 4y ago
Data processing for Masked Language Modeling
Deep Learning
Data processing for Masked Language Modeling
HuggingFace Advanced 4y ago
Inside the Question answering pipeline (PyTorch)
Deep Learning
Inside the Question answering pipeline (PyTorch)
HuggingFace Advanced 4y ago
Inside the Token classification pipeline (PyTorch)
Deep Learning
Inside the Token classification pipeline (PyTorch)
HuggingFace Advanced 4y ago
Data processing for Causal Language Modeling
Deep Learning
Data processing for Causal Language Modeling
HuggingFace Advanced 4y ago
Data Collators: A Tour
Deep Learning
Data Collators: A Tour
HuggingFace Advanced 4y ago
Debugging the Training Pipeline (PyTorch)
Deep Learning
Debugging the Training Pipeline (PyTorch)
HuggingFace Advanced 4y ago
Three Explorations on Pre-Training: an Analysis, an Approach, and an Architecture
Deep Learning ⚡ AI Lesson
Three Explorations on Pre-Training: an Analysis, an Approach, and an Architecture
Microsoft Research Advanced 4y ago
Introducing Retiarii: A deep learning exploratory-training framework on NNI
Deep Learning
Introducing Retiarii: A deep learning exploratory-training framework on NNI
Microsoft Research Advanced 5y ago
Instantiate a Transformers model (TensorFlow)
Deep Learning
Instantiate a Transformers model (TensorFlow)
HuggingFace Advanced 5y ago
Instantiate a Transformers model (PyTorch)
Deep Learning
Instantiate a Transformers model (PyTorch)
HuggingFace Advanced 5y ago
Batching inputs together (TensorFlow)
Deep Learning
Batching inputs together (TensorFlow)
HuggingFace Advanced 5y ago
Batching inputs together (PyTorch)
Deep Learning
Batching inputs together (PyTorch)
HuggingFace Advanced 5y ago
Test-time Adaptable Neural Networks for Robust Medical Image Segmentation | JRC Workshop 2021
Deep Learning
Test-time Adaptable Neural Networks for Robust Medical Image Segmentation | JRC Workshop 2021
Microsoft Research Advanced 5y ago
Probabilistic Numeric CNNs with Roberto Bondesan - #482
Deep Learning ⚡ AI Lesson
Probabilistic Numeric CNNs with Roberto Bondesan - #482
The TWIML AI Podcast with Sam Charrington Advanced 5y ago
Negative Data Augmentation
Deep Learning
Negative Data Augmentation
Connor Shorten Advanced 5y ago
AI Weekly Update - March 8th, 2021 (#27)!
Deep Learning
AI Weekly Update - March 8th, 2021 (#27)!
Connor Shorten Advanced 5y ago
Vision Transformer - Keras Code Examples!!
Deep Learning
Vision Transformer - Keras Code Examples!!
Connor Shorten Advanced 5y ago
Presenting... Determined AI!
Deep Learning ⚡ AI Lesson
Presenting... Determined AI!
Connor Shorten Advanced 5y ago
Build your own neural network, Exercise 9
Deep Learning
Build your own neural network, Exercise 9
Brandon Rohrer Advanced 5y ago
Build your own neural network, Exercise 8
Deep Learning
Build your own neural network, Exercise 8
Brandon Rohrer Advanced 5y ago
Build your own neural network, Exercise 7
Deep Learning
Build your own neural network, Exercise 7
Brandon Rohrer Advanced 5y ago
Build your own neural network, Exercise 6
Deep Learning
Build your own neural network, Exercise 6
Brandon Rohrer Advanced 5y ago
Build your own neural network, Exercise 5
Deep Learning
Build your own neural network, Exercise 5
Brandon Rohrer Advanced 5y ago
Build your own neural network, Exercise 4
Deep Learning ⚡ AI Lesson
Build your own neural network, Exercise 4
Brandon Rohrer Advanced 5y ago
📚 Continue on Coursera External links · Free to audit
1 / 3 View all →
Deep Learning with Keras and Practical Applications
📚 External: Coursera ↗
Self-paced
Deep Learning with Keras and Practical Applications
Opens on Coursera ↗
Advanced CNNs, Transfer Learning, and Recurrent Networks
📚 External: Coursera ↗
Self-paced
Advanced CNNs, Transfer Learning, and Recurrent Networks
Opens on Coursera ↗
Programming Generative AI: Unit 2
📚 External: Coursera ↗
Self-paced
Programming Generative AI: Unit 2
Opens on Coursera ↗
Practical Deep Learning with Python
📚 External: Coursera ↗
Self-paced
Practical Deep Learning with Python
Opens on Coursera ↗
Probabilistic Deep Learning with TensorFlow 2
📚 External: Coursera ↗
Self-paced
Probabilistic Deep Learning with TensorFlow 2
Opens on Coursera ↗
Deep Learning: Train Neural Networks and Deploy with Docker
📚 External: Coursera ↗
Self-paced
Deep Learning: Train Neural Networks and Deploy with Docker
Opens on Coursera ↗