Ishan Misra: Self-Supervised Deep Learning in Computer Vision | Lex Fridman Podcast #206
Ishan Misra is a research scientist at FAIR working on self-supervised visual learning. Please support this podcast by checking out our sponsors:
- Onnit: https://lexfridman.com/onnit to get up to 10% off
- The Information: https://theinformation.com/lex to get 75% off first month
- Grammarly: https://grammarly.com/lex to get 20% off premium
- Athletic Greens: https://athleticgreens.com/lex and use code LEX to get 1 month of fish oil
EPISODE LINKS:
Ishan's twitter: https://twitter.com/imisra_
Ishan's website: https://imisra.github.io
Ishan's FAIR page: https://ai.facebook.com/people/ishan-mis…
Watch on YouTube ↗
(saves to browser)
Chapters (25)
Introduction
2:27
Self-supervised learning
11:02
Self-supervised learning is the dark matter of intelligence
14:54
Categorization
23:28
Is computer vision still really hard?
27:12
Understanding Language
36:51
Harder to solve: vision or language
43:36
Contrastive learning & energy-based models
47:37
Data augmentation
51:57
Fixed audio spike by lowering sound with pen tool
1:00:10
Real data vs. augmented data
1:03:54
Non-contrastive learning energy based self supervised learning methods
1:07:32
Unsupervised learning (SwAV)
1:10:14
Self-supervised Pretraining (SEER)
1:15:21
Self-supervised learning (SSL) architectures
1:21:21
VISSL pytorch-based SSL library
1:24:15
Multi-modal
1:31:43
Active learning
1:37:22
Autonomous driving
1:48:49
Limits of deep learning
1:52:57
Difference between learning and reasoning
1:58:03
Building super-human AI
2:05:51
Most beautiful idea in self-supervised learning
2:09:40
Simulation for training AI
2:13:04
Video games replac
Playlist
Uploads from Lex Fridman · Lex Fridman · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Ido Portal: Movement
Lex Fridman
Ryan Hall: Value of Competition | Take It Uneasy Podcast
Lex Fridman
Ryan Hall: Moral Victory
Lex Fridman
Ryan Hall: Best Martial Art for Self Defense | Take It Uneasy Podcast
Lex Fridman
Ryan Hall: Principles of Jiu Jitsu | Take It Uneasy Podcast
Lex Fridman
Jimmy Pedro: Judo | Take It Uneasy Podcast
Lex Fridman
Foundations of Deep Learning (Hugo Larochelle, Twitter)
Lex Fridman
TensorFlow Tutorial (Sherry Moore, Google Brain)
Lex Fridman
Nuts and Bolts of Applying Deep Learning (Andrew Ng)
Lex Fridman
Sequence to Sequence Deep Learning (Quoc Le, Google)
Lex Fridman
Torch Tutorial (Alex Wiltschko, Twitter)
Lex Fridman
Theano Tutorial (Pascal Lamblin, MILA)
Lex Fridman
Deep Reinforcement Learning (John Schulman, OpenAI)
Lex Fridman
Deep Learning for Speech Recognition (Adam Coates, Baidu)
Lex Fridman
Deep Learning for Natural Language Processing (Richard Socher, Salesforce)
Lex Fridman
Foundations of Unsupervised Deep Learning (Ruslan Salakhutdinov, CMU)
Lex Fridman
Deep Learning for Computer Vision (Andrej Karpathy, OpenAI)
Lex Fridman
Foundations and Challenges of Deep Learning (Yoshua Bengio)
Lex Fridman
MIT 6.S094: Introduction to Deep Learning and Self-Driving Cars
Lex Fridman
MIT 6.S094: Deep Reinforcement Learning for Motion Planning
Lex Fridman
MIT 6.S094: Convolutional Neural Networks for End-to-End Learning of the Driving Task
Lex Fridman
MIT 6.S094: Recurrent Neural Networks for Steering Through Time
Lex Fridman
MIT 6.S094: Deep Learning for Human-Centered Semi-Autonomous Vehicles
Lex Fridman
Chris Gerdes (Stanford) on Technology, Policy and Vehicle Safety - MIT Self-Driving Cars
Lex Fridman
Sertac Karaman (MIT) on Motion Planning in a Complex World - MIT Self-Driving Cars
Lex Fridman
MIT Sloan: Intro to Machine Learning (in 360/VR)
Lex Fridman
MIT 6.S094: Deep Learning
Lex Fridman
MIT Self-Driving Cars (2018)
Lex Fridman
MIT 6.S094: Deep Reinforcement Learning
Lex Fridman
MIT 6.S094: Computer Vision
Lex Fridman
MIT 6.S094: Deep Learning for Human Sensing
Lex Fridman
MIT AGI: Artificial General Intelligence
Lex Fridman
MIT AGI: Building machines that see, learn, and think like people (Josh Tenenbaum)
Lex Fridman
Ray Kurzweil: Future of Intelligence | MIT 6.S099: Artificial General Intelligence (AGI)
Lex Fridman
Sacha Arnoud, Director of Engineering, Waymo - MIT Self-Driving Cars
Lex Fridman
Lisa Feldman Barrett: How the Brain Creates Emotions | MIT Artificial General Intelligence (AGI)
Lex Fridman
Stephen Wolfram: Computational Universe | MIT 6.S099: Artificial General Intelligence (AGI)
Lex Fridman
Emilio Frazzoli, CTO, nuTonomy - MIT Self-Driving Cars
Lex Fridman
Sterling Anderson, Co-Founder, Aurora - MIT Self-Driving Cars
Lex Fridman
MIT AGI: Cognitive Architecture (Nate Derbinsky)
Lex Fridman
MIT Advanced Vehicle Technology Study (MIT-AVT)
Lex Fridman
MIT-AVT: Data Collection Device (for Large-Scale Semi-Autonomous Driving)
Lex Fridman
Max Tegmark: Life 3.0 | Lex Fridman Podcast #1
Lex Fridman
Geoffrey Hinton: What are you excited about in deep learning?
Lex Fridman
Ilya Sutskever: OpenAI Meta-Learning and Self-Play | MIT Artificial General Intelligence (AGI)
Lex Fridman
Christof Koch: Consciousness | Lex Fridman Podcast #2
Lex Fridman
Comfortably Numb Solo | Pink Floyd Cover by Lex Fridman
Lex Fridman
Steven Pinker: AI in the Age of Reason | Lex Fridman Podcast #3
Lex Fridman
Yoshua Bengio: Deep Learning | Lex Fridman Podcast #4
Lex Fridman
Black Belt Speech | Lex Fridman
Lex Fridman
Vladimir Vapnik: Statistical Learning | Lex Fridman Podcast #5
Lex Fridman
Guido van Rossum: Python | Lex Fridman Podcast #6
Lex Fridman
Jeff Atwood: Stack Overflow and Coding Horror | Lex Fridman Podcast #7
Lex Fridman
Eric Schmidt: Google | Lex Fridman Podcast #8
Lex Fridman
Stuart Russell: Long-Term Future of Artificial Intelligence | Lex Fridman Podcast #9
Lex Fridman
Pieter Abbeel: Deep Reinforcement Learning | Lex Fridman Podcast #10
Lex Fridman
Juergen Schmidhuber: Godel Machines, Meta-Learning, and LSTMs | Lex Fridman Podcast #11
Lex Fridman
Tuomas Sandholm: Poker and Game Theory | Lex Fridman Podcast #12
Lex Fridman
Deep Learning Basics: Introduction and Overview
Lex Fridman
Deep Learning State of the Art (2019)
Lex Fridman
DeepCamp AI