OpenAI Sora Just Supercharged Filmmaking!
Key Takeaways
OpenAI Sora is a text-to-video AI that enables users to create videos from text prompts, with potential applications in filmmaking, music, and product design. The tool has both virtues and limitations, including the ability to create new animal species and showcase artist sculptures, but also struggles with character consistency in storytelling.
Full Transcript
open AI Sora is a brilliant new text to video AI where you write something and out comes a video of it with this everyone will be able to become a movie director and I was really curious to see what brilliant creative people can do with it luckily that is exactly what happened and the results are stunning to say the least buckle up because we are going to talk about the virtues and the limitations of the current system dear fellow Scholars this is 2minute papers with Dr Caro what I absolutely love about Sora is that it can do things that you could normally not do for instance make up new animal species now hold on to your papers fellow Scholars and enjoy the giraff flamingo in the savann its natural habitat probably looking for its next prey to be merciless ly licked to death or the mighty Flying Pig elegantly gliding across the skies with the Finesse of a belly dancer or how about the bunny armadillo a true warrior protected by an unbreakable shell armor unless you strike the unprotected areas which is most of the bunny of course or the brilliant Fox Crow a canning assassin lurking on the trees with an undefined find number of Limbs and any combination of two different species that are guaranteed to not make any sense you can try them all this would otherwise be impossible or at the very least prohibitively expensive to produce not anymore this was incredible I love this one and now we will get to see what an amazing sculptor can do with Sora this showcases the work of an artist who starts out with ideas that were generated by an AI and then getting his hands dirty and bringing these sculptures into the World by actually creating them so cool musicians will absolutely love this technology because they will be able to rapidly create visuals for their soundscapes and see how they complement each other it will also be a great deal of help with rapid product design I love how well the text came out on this one or you can design a futuristic city as well and have a Peak at what that might look like this is going to be an incredible tool to supercharge the creativity of all the brilliant people around the world and all this will be possible very soon likely this year and don't forget over time the costs are going to decrease so much so that you will be able to do all of this instantly and do it even better than this right with the phone in your pocket for nearly free What A Time To Be Alive Now limitations so far this tool is excellent if you wish to create not necessarily a fully consistent story but essentially a montage of visual footage now I hear you asking okay caroy but why is that well check out this one called a head this is a project about carefully trying to overcome one of the main current limitations of Sora and that is character consistency this means that when we create a new character it is very challenging to get exactly the same character back in the next scene telling the story of someone but without being able to portray that someone would be a necessity but that's impossible or at least very challenging so what is the solution well Airhead you see this character has so few features that it is relatively easy to reproduce and what does a brilliant artist do with that of course Embrace that limitation and turn it into a really cool story loving it and interestingly this may be the first AI based movie where I find myself enjoying the storytelling and not not looking at the technology that is an incredible breakthrough why is that you see I remember at Catal co-founder of Pixar saying that he created his first animated movie and was delighted by the fact that the people were criticizing the story he said that is fantastic no one is talking about the technology they are talking about the story this means that he has succeeded and and we might have the same for Sora today now I cannot get enough of Sora and I hope you are excited too I have another video coming on it which I've learned a lot from it is about beauty creativity and horror trust me you are not ready for the horror part subscribe and hit the Bell icon if you're interested in watching it it is coming very soon also I will fly to San Francisco for the first time ever and I will speak at the fully connected event there are still tickets available and I am super excited to meet you fellow Scholars there last time we did it this happened the link is in the video description see you there experiment tracking model evaluation and production monitoring for your deep learning projects and llm apps this is what weights and biases does and it is the best everyone is using it try it out now at wb. SLP papers or click the link in the description below
Original Description
❤️ Check out Weights & Biases and sign up for a free demo here: https://wandb.me/papers
The conference:
https://wandb.ai/site/resources/events/fully-connected
First impressions from creatives: https://openai.com/blog/sora-first-impressions
📝 My paper on simulations that look almost like reality is available for free here:
https://rdcu.be/cWPfD
Or this is the orig. Nature Physics link with clickable citations:
https://www.nature.com/articles/s41567-022-01788-5
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Alex Balfanz, Alex Haro, B Shang, Benji Rabhan, Bret Brizzee, Gaston Ingaramo, Gordon Child, Jace O'Brien, John Le, Kyle Davis, Lukas Biewald, Martin, Michael Albrecht, Michael Tedder, Owen Skarpness, Richard Putra Iskandar, Richard Sundvall, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: https://www.patreon.com/TwoMinutePapers
Thumbnail background design: Felícia Zsolnai-Fehér - http://felicia.hu
Károly Zsolnai-Fehér's research works: https://cg.tuwien.ac.at/~zsolnai/
Twitter: https://twitter.com/twominutepapers
#openai #sora
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from Two Minute Papers · Two Minute Papers · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Fluid Simulations with Blender and Wavelet Turbulence | Two Minute Papers #1
Two Minute Papers
Capturing Waves of Light With Femto-photography | Two Minute Papers #2
Two Minute Papers
Artificial Neural Networks and Deep Learning | Two Minute Papers #3
Two Minute Papers
Blender Rendering - Top 7 LuxRender Features
Two Minute Papers
Simulating Breaking Glass | Two Minute Papers #4
Two Minute Papers
Time Lapse Videos From Community Photos | Two Minute Papers #5
Two Minute Papers
AI Learns Van Gogh's Art
Two Minute Papers
Hydrographic Printing | Two Minute Papers #7
Two Minute Papers
Announcing LuxRender 1.5
Two Minute Papers
Digital Creatures Learn To Walk | Two Minute Papers #8
Two Minute Papers
Manipulating Photorealistic Renderings | Two Minute Papers #9
Two Minute Papers
Adaptive Fluid Simulations | Two Minute Papers #10
Two Minute Papers
Building Bridges With Flying Machines | Two Minute Papers #11
Two Minute Papers
Reconstructing Sound From Vibrations | Two Minute Papers #12
Two Minute Papers
Creating Photographs Using Deep Learning | Two Minute Papers #13
Two Minute Papers
Adaptive Cloth Simulations | Two Minute Papers #14
Two Minute Papers
Synthesizing Sound From Collisions | Two Minute Papers #15
Two Minute Papers
Metropolis Light Transport | Two Minute Papers #16
Two Minute Papers
3D Printing a Glockenspiel | Two Minute Papers #17
Two Minute Papers
Modeling Colliding and Merging Fluids | Two Minute Papers #18
Two Minute Papers
Recurrent Neural Network Writes Music and Shakespeare Novels | Two Minute Papers #19
Two Minute Papers
Gradients, Poisson's Equation and Light Transport | Two Minute Papers #20
Two Minute Papers
Real-Time Facial Expression Transfer | Two Minute Papers #21
Two Minute Papers
Automatic Lecture Notes From Videos | Two Minute Papers #22
Two Minute Papers
Be a Part of Two Minute Papers on Patreon!
Two Minute Papers
Recurrent Neural Network Writes Sentences About Images | Two Minute Papers #23
Two Minute Papers
How Does Deep Learning Work? | Two Minute Papers #24
Two Minute Papers
Cryptography, Perfect Secrecy and One Time Pads | Two Minute Papers #25
Two Minute Papers
Terrain Traversal with Reinforcement Learning | Two Minute Papers #26
Two Minute Papers
Multiple-Scattering Microfacet BSDFs with the Smith Model
Two Minute Papers
Google DeepMind's Deep Q-Learning & Superhuman Atari Gameplays | Two Minute Papers #27
Two Minute Papers
Are We Living In a Computer Simulation? | Two Minute Papers #28
Two Minute Papers
Artificial Superintelligence [Audio only] | Two Minute Papers #29
Two Minute Papers
Automatic Parameter Control for Metropolis Light Transport | Two Minute Papers #30
Two Minute Papers
Randomness and Bell's Inequality [Audio only] | Two Minute Papers #31
Two Minute Papers
OpenAI - Non-profit AI company by Elon Musk and Sam Altman
Two Minute Papers
How Do Genetic Algorithms Work? | Two Minute Papers #32
Two Minute Papers
Painting with Fluid Simulations | Two Minute Papers #33
Two Minute Papers
Peer Review #1 [Audio only] | Two Minute Papers
Two Minute Papers
Neural Programmer-Interpreters Learn To Write Programs | Two Minute Papers #34
Two Minute Papers
9 Cool Deep Learning Applications | Two Minute Papers #35
Two Minute Papers
Designing Cities and Furnitures With Machine Learning | Two Minute Papers #36
Two Minute Papers
Designing 3D Printable Robotic Creatures | Two Minute Papers #37
Two Minute Papers
3D Printing Objects With Caustics | Two Minute Papers #38
Two Minute Papers
Interactive Editing of Subsurface Scattering | Two Minute Papers #39
Two Minute Papers
Simulating Viscosity and Melting Fluids | Two Minute Papers #40
Two Minute Papers
What Do Virtual Objects Sound Like? | Two Minute Papers #41
Two Minute Papers
How DeepMind Conquered Go With Deep Learning (AlphaGo) | Two Minute Papers #42
Two Minute Papers
Breaking Deep Learning Systems With Adversarial Examples | Two Minute Papers #43
Two Minute Papers
Extrapolations and Crowdfunded Research (Experiment) | Two Minute Papers #44
Two Minute Papers
Biophysical Skin Aging Simulations | Two Minute Papers #45
Two Minute Papers
What is Impostor Syndrome? | Two Minute Papers #46
Two Minute Papers
Should You Take the Stairs at Work? (For Weight Loss) | Two Minute Papers #47
Two Minute Papers
Artistic Manipulation of Caustics | Two Minute Papers #48
Two Minute Papers
Deep Learning Program Learns to Paint | Two Minute Papers #49
Two Minute Papers
Interactive Photo Recoloring | Two Minute Papers #50
Two Minute Papers
How To Get Started With Machine Learning? | Two Minute Papers #51
Two Minute Papers
Awesome Research For Everyone! - Two Minute Papers Channel Trailer
Two Minute Papers
10 More Cool Deep Learning Applications | Two Minute Papers #52
Two Minute Papers
How DeepMind's AlphaGo Defeated Lee Sedol | Two Minute Papers #53
Two Minute Papers
More on: Multimodal LLMs
View skill →Related Reads
📰
📰
📰
📰
A lightweight workflow for keeping up with AI conference papers
Dev.to · Daniel
Why CitedEvidence Believes Great Researchers Read Less Than You Think
Medium · AI
How to Write a Literature Review That Actually Argues Something
Medium · Machine Learning
I Built a Personal Paper Engine to Stop Losing Research Papers
Dev.to · Ethan
🎓
Tutor Explanation
DeepCamp AI