Can You Recover Sound From Images?
Skills:
CV Basics50%
Is it possible to reconstruct sound from high-speed video images?
Part of this video was sponsored by LastPass: http://bit.ly/2SmRQkk
Special thanks to Dr. Abe Davis for revisiting his research with me: http://abedavis.com
This video was based on research by Dr. Abe Davis and colleagues. I found out about this work years ago and was fascinated by the way he was able to capture vibration information in image-only video. I always imagined the motions of objects would be visible as when recording a tuning fork in slow motion - so deriving sound from high speed images seemed a feasible task. But the reality is much more difficult.
Sound vibrations only cause objects to wiggle by about a micrometer. This is much smaller than a pixel, so the algorithm must understand the characteristics of the image. A move in one direction should cause some pixels to lighten slightly, while others darken - and this behavior is correlated along the edges of the image. So noise can be reduced because it's random over the image and there are enough places to sample that you can get it to cancel out.
Something I'm wondering now is - would it be possible to capture sound in a single image? I'm thinking it would have to be an image of a large object or space because the wavelengths of typical sounds are quite long. Maybe a high frequency sound could be imaged in a suitable medium...
Animations by Alan Chamberlain
Music from http://epidemicsound.com "Seaweed"
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from Veritasium · Veritasium · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Scientific Notation - Explained!
Veritasium
I'm Atoms (Scientific Cover of Jason Mraz's I'm Yours)
Veritasium
Scientific Notation - Example
Veritasium
What is a Force?
Veritasium
Khan Academy and the Effectiveness of Science Videos
Veritasium
Supercooled Water - Explained!
Veritasium
Galileo the Scientific Parrot
Veritasium
Radiation vs Radioactive Atoms
Veritasium
What Is Electricity? (Are You Gonna Be My Girl?)
Veritasium
Why Is Ice Slippery?
Veritasium
Impress Her With Nanodiamonds
Veritasium
Chain Drop Experiment
Veritasium
What Colour Is Most Attractive?
Veritasium
States of Matter
Veritasium
Slinky Drop Answer
Veritasium
Slinky Drop
Veritasium
Atomic Rant
Veritasium
What Is The Magnus Force?
Veritasium
A Human Being Is A Part Of The Whole
Veritasium
Spinning Tube Trick Explained
Veritasium
Where Do Trees Get Their Mass?
Veritasium
Why Do You Make People Look Stupid?
Veritasium
Gyroscopic Precession
Veritasium
How Does A Slinky Fall?
Veritasium
Spinning Disk Trick Solution
Veritasium
Does a Falling Slinky Defy Gravity?
Veritasium
Northern Lights From 100,000 ft!
Veritasium
The First Meeting of EDUtubers! ft. CGPGrey, Vsauce, Smarter Every Day, Numberphile +more
Veritasium
Free Higgs!
Veritasium
How Can Trees Be Taller Than 10m?
Veritasium
What Now For The Higgs Boson?
Veritasium
How Trees Bend the Laws of Physics
Veritasium
Paralysed Rats Made To Walk Again
Veritasium
What Could Survive An Atomic Bomb?
Veritasium
Heisenberg's Uncertainty Principle Explained
Veritasium
Why Do Venomous Animals Live In Warm Climates?
Veritasium
Veritasium Trailer
Veritasium
What Can Frogs See That We Can't?
Veritasium
World's Roundest Object!
Veritasium
Epic Slow-Mo Drum Implosions!
Veritasium
Empty Space is NOT Empty
Veritasium
Your Mass is NOT From the Higgs Boson
Veritasium
How Does a Transistor Work?
Veritasium
Bullet Block Explained!
Veritasium
How We’re Fooled By Statistics
Veritasium
Facebook Fraud
Veritasium
The Most Common Cognitive Bias
Veritasium
Anti-Gravity Wheel?
Veritasium
Anti-Gravity Wheel Explained
Veritasium
Why Trees Are Taller Than They Need To Be
Veritasium
Misconceptions About the Universe
Veritasium
Why Women Are Stripey
Veritasium
What is NOT Random?
Veritasium
Explained: 5 Fun Physics Phenomena
Veritasium
Climate Change is Boring
Veritasium
13 Misconceptions About Global Warming
Veritasium
CapitolTV's DISTRICT VOICES - District 5: Electric Sparks From Falling Water
Veritasium
Sparks from Falling Water: Kelvin's Thunderstorm
Veritasium
The Most Persistent Myth
Veritasium
The Most Radioactive Places on Earth
Veritasium
More on: CV Basics
View skill →Related AI Lessons
⚡
⚡
⚡
⚡
Ethical Concerns in Artificial Intelligence: What We Must Consider
Medium · Machine Learning
Ethical Concerns in Artificial Intelligence: What We Must Consider
Medium · Data Science
Ethical Concerns in Artificial Intelligence: What We Must Consider
Medium · Python
Transplantation vs.
Medium · AI
🎓
Tutor Explanation
DeepCamp AI