Equivariant Neural Networks | Part 1/3 - Introduction

DeepFindr · Beginner ·📐 ML Fundamentals ·3y ago
▬▬ Papers / Resources ▬▬▬ Fabian Fuchs Equivariance: https://fabianfuchsml.github.io/equivariance1of2/ Deep Learning for Molecules: https://dmol.pub/dl/Equivariant.html Naturally Occuring Equivariance: https://distill.pub/2020/circuits/equivariance/ 3Blue1Brown Group Theory: https://www.youtube.com/watch?v=mH0oCDa74tE&t=552s&ab_channel=3Blue1Brown Group Equivariant CNNs: https://arxiv.org/abs/1602.07576 Equivariance vs Data Augmentation: https://arxiv.org/pdf/2202.03990.pdf ▬▬ Used Music ▬▬▬▬▬▬▬▬▬▬▬ Music from #Uppbeat (free for Creators!): https://uppbeat.io/t/yokonap/birds License code: WXV…
Watch on YouTube ↗ (saves to browser)

Chapters (20)

Introduction
0:45 Equivariance and Invariance
3:03 CNNs are translation equivariant
4:00 Math notation
4:25 Visual intuition
5:08 Symmetries
6:22 Why are CNNs not rotation equivariant?
7:14 Inductive biases reduce the flexibility
8:10 What's wrong with data augmentations?
9:32 Motivations for Equivariant Neural Networks
9:55 You've unlocked a checkpoint.
10:07 Naturally occuring equivariance
10:50 Group Equivariant Convolutional Neural Networks
11:37 Group Theory (on a high level)
12:41 An example and the matrix notation
13:50 Group axioms
14:32 Cayley tables
15:33 Examples for groups
16:38 Applications of Equivariant Neural Networks
18:30 Final Checkpoint :)

Playlist

Uploads from DeepFindr · DeepFindr · 47 of 57

← Previous Next →
1 Understanding Graph Neural Networks | Part 1/3 - Introduction
Understanding Graph Neural Networks | Part 1/3 - Introduction
DeepFindr
 2 Understanding Graph Neural Networks | Part 2/3 - GNNs and it's Variants
Understanding Graph Neural Networks | Part 2/3 - GNNs and it's Variants
DeepFindr
 3 Understanding Graph Neural Networks | Part 3/3 - Pytorch Geometric and Molecule Data using RDKit
Understanding Graph Neural Networks | Part 3/3 - Pytorch Geometric and Molecule Data using RDKit
DeepFindr
 4 Node Classification on Knowledge Graphs using PyTorch Geometric
Node Classification on Knowledge Graphs using PyTorch Geometric
DeepFindr
 5 Understanding Convolutional Neural Networks | Part 1 / 3 - The Basics
Understanding Convolutional Neural Networks | Part 1 / 3 - The Basics
DeepFindr
 6 Understanding Convolutional Neural Networks | Part 2 / 3 - Wonders of the world CNN with PyTorch
Understanding Convolutional Neural Networks | Part 2 / 3 - Wonders of the world CNN with PyTorch
DeepFindr
 7 Understanding Convolutional Neural Networks | Part 3 / 3 - Transfer Learning and Explainable AI
Understanding Convolutional Neural Networks | Part 3 / 3 - Transfer Learning and Explainable AI
DeepFindr
 8 How to use edge features in Graph Neural Networks (and PyTorch Geometric)
How to use edge features in Graph Neural Networks (and PyTorch Geometric)
DeepFindr
 9 Explainable AI explained! | #1 Introduction
Explainable AI explained! | #1 Introduction
DeepFindr
 10 Explainable AI explained! | #2 By-design interpretable models with Microsofts InterpretML
Explainable AI explained! | #2 By-design interpretable models with Microsofts InterpretML
DeepFindr
 11 Explainable AI explained! | #3 LIME
Explainable AI explained! | #3 LIME
DeepFindr
 12 Explainable AI explained! | #4 SHAP
Explainable AI explained! | #4 SHAP
DeepFindr
 13 Explainable AI explained! | #5 Counterfactual explanations and adversarial attacks
Explainable AI explained! | #5 Counterfactual explanations and adversarial attacks
DeepFindr
 14 Explainable AI explained! | #6 Layerwise Relevance Propagation with MRI data
Explainable AI explained! | #6 Layerwise Relevance Propagation with MRI data
DeepFindr
 15 Understanding Graph Attention Networks
Understanding Graph Attention Networks
DeepFindr
 16 GNN Project #1 - Introduction to HIV dataset
GNN Project #1 - Introduction to HIV dataset
DeepFindr
 17 GNN Project #2 - Creating a Custom Dataset in Pytorch Geometric
GNN Project #2 - Creating a Custom Dataset in Pytorch Geometric
DeepFindr
 18 GNN Project #3.1 - Graph-level predictions
GNN Project #3.1 - Graph-level predictions
DeepFindr
 19 GNN Project #3.2 - Graph Transformer
GNN Project #3.2 - Graph Transformer
DeepFindr
 20 GNN Project #4.1 - Graph Variational Autoencoders
GNN Project #4.1 - Graph Variational Autoencoders
DeepFindr
 21 GNN Project #4.2 - GVAE Training and Adjacency reconstruction
GNN Project #4.2 - GVAE Training and Adjacency reconstruction
DeepFindr
 22 GNN Project #4.3 - One-shot molecule generation - Part 1
GNN Project #4.3 - One-shot molecule generation - Part 1
DeepFindr
 23 GNN Project #4.3 - Code explanation
GNN Project #4.3 - Code explanation
DeepFindr
 24 Machine Learning Model Deployment with Python (Streamlit + MLflow) | Part 1/2
Machine Learning Model Deployment with Python (Streamlit + MLflow) | Part 1/2
DeepFindr
 25 Machine Learning Model Deployment with Python (Streamlit + MLflow) | Part 2/2
Machine Learning Model Deployment with Python (Streamlit + MLflow) | Part 2/2
DeepFindr
 26 How to explain Graph Neural Networks (with XAI)
How to explain Graph Neural Networks (with XAI)
DeepFindr
 27 Explaining Twitch Predictions with GNNExplainer
Explaining Twitch Predictions with GNNExplainer
DeepFindr
 28 Python Graph Neural Network Libraries (an Overview)
Python Graph Neural Network Libraries (an Overview)
DeepFindr
 29 Friendly Introduction to Temporal Graph Neural Networks (and some Traffic Forecasting)
Friendly Introduction to Temporal Graph Neural Networks (and some Traffic Forecasting)
DeepFindr
 30 Traffic Forecasting with Pytorch Geometric Temporal
Traffic Forecasting with Pytorch Geometric Temporal
DeepFindr
 31 Fraud Detection with Graph Neural Networks
Fraud Detection with Graph Neural Networks
DeepFindr
 32 Fake News Detection using Graphs with Pytorch Geometric
Fake News Detection using Graphs with Pytorch Geometric
DeepFindr
 33 Recommender Systems using Graph Neural Networks
Recommender Systems using Graph Neural Networks
DeepFindr
 34 How to handle Uncertainty in Deep Learning #1.1
How to handle Uncertainty in Deep Learning #1.1
DeepFindr
 35 How to handle Uncertainty in Deep Learning #1.2
How to handle Uncertainty in Deep Learning #1.2
DeepFindr
 36 How to handle Uncertainty in Deep Learning #2.1
How to handle Uncertainty in Deep Learning #2.1
DeepFindr
 37 How to handle Uncertainty in Deep Learning #2.2
How to handle Uncertainty in Deep Learning #2.2
DeepFindr
 38 Converting a Tabular Dataset to a Graph Dataset for GNNs
Converting a Tabular Dataset to a Graph Dataset for GNNs
DeepFindr
 39 Converting a Tabular Dataset to a Temporal Graph Dataset for GNNs
Converting a Tabular Dataset to a Temporal Graph Dataset for GNNs
DeepFindr
 40 How to get started with Data Science (Career tracks and advice)
How to get started with Data Science (Career tracks and advice)
DeepFindr
 41 Causality and (Graph) Neural Networks
Causality and (Graph) Neural Networks
DeepFindr
 42 Diffusion models from scratch in PyTorch
Diffusion models from scratch in PyTorch
DeepFindr
 43 Self-/Unsupervised GNN Training
Self-/Unsupervised GNN Training
DeepFindr
 44 Contrastive Learning in PyTorch - Part 1: Introduction
Contrastive Learning in PyTorch - Part 1: Introduction
DeepFindr
 45 Contrastive Learning in PyTorch - Part 2: CL on Point Clouds
Contrastive Learning in PyTorch - Part 2: CL on Point Clouds
DeepFindr
 46 State of AI 2022 - My Highlights
State of AI 2022 - My Highlights
DeepFindr
 ▶ Equivariant Neural Networks | Part 1/3 - Introduction
Equivariant Neural Networks | Part 1/3 - Introduction
DeepFindr
 48 Equivariant Neural Networks | Part 2/3 - Generalized CNNs
Equivariant Neural Networks | Part 2/3 - Generalized CNNs
DeepFindr
 49 Equivariant Neural Networks | Part 3/3 - Transformers and GNNs
Equivariant Neural Networks | Part 3/3 - Transformers and GNNs
DeepFindr
 50 Personalized Image Generation (using Dreambooth) explained!
Personalized Image Generation (using Dreambooth) explained!
DeepFindr
 51 Vision Transformer Quick Guide - Theory and Code in (almost) 15 min
Vision Transformer Quick Guide - Theory and Code in (almost) 15 min
DeepFindr
 52 LoRA explained (and a bit about precision and quantization)
LoRA explained (and a bit about precision and quantization)
DeepFindr
 53 Dimensionality Reduction Techniques | Introduction and Manifold Learning (1/5)
Dimensionality Reduction Techniques | Introduction and Manifold Learning (1/5)
DeepFindr
 54 Principal Component Analysis (PCA) | Dimensionality Reduction Techniques (2/5)
Principal Component Analysis (PCA) | Dimensionality Reduction Techniques (2/5)
DeepFindr
 55 Multidimensional Scaling (MDS) | Dimensionality Reduction Techniques (3/5)
Multidimensional Scaling (MDS) | Dimensionality Reduction Techniques (3/5)
DeepFindr
 56 t-distributed Stochastic Neighbor Embedding (t-SNE) | Dimensionality Reduction Techniques (4/5)
t-distributed Stochastic Neighbor Embedding (t-SNE) | Dimensionality Reduction Techniques (4/5)
DeepFindr
 57 Uniform Manifold Approximation and Projection (UMAP) | Dimensionality Reduction Techniques (5/5)
Uniform Manifold Approximation and Projection (UMAP) | Dimensionality Reduction Techniques (5/5)
DeepFindr
K-Means Clustering Explained Simply 🤖
Next Up
K-Means Clustering Explained Simply 🤖
Analytics Vidhya