Deepfake Movements with 1 image ONLY [Liquid Warping GAN]

bycloud · Intermediate ·📄 Research Papers Explained ·5y ago

Key Takeaways

The video demonstrates the use of Liquid Warping GAN, a deepfake technology that can transfer motion from a reference video to a single image of a person, with potential applications in game development, character animation, and try-on clothes functionality. The technology is based on a recent AI research paper and has been open-sourced, allowing users to experiment with it.

Full Transcript

lately we have been seeing some pretty hilarious memes that are made from ais looking back one of the earliest memeable ai was definitely from deep fix and now more and more ais are being used comedically and they are just too much fun giving me a good rub remember the first order motion model that i covered a few months ago it does a super good job at deep faking with only one source image however it only works on human faces in their demo they did show some horse motion transfer or human movement transfer but it was not as good as the facial motions transfer so on to the latest ai news three weeks ago an ai research paper called liquid warping again was published and just a few days ago they have open sourced their codes and first of all their official demo looks too good to be true it looks insanely good at motion capturing mapping 3d bodies image and painting and many other details i have shown to be difficult to completely function on its own and to blend all these into one we would probably expect something not as functional but after they released their codes i am absolutely convinced it is just inconceivably good at motion transferring even if it is only limited to just one single person so you basically can take any full body shot of anyone that has a defined body part and use a reference video to perform motion transfer with just one single command but a fairly lengthy one other than the incredible meme potential this ai can be used in places such as game development character animation and it even can be used for trying on clothes with its appearance transfer function which sounds amazing if it is developed even further looking at my results they are just hilarious if not enough information about a person's body is presented the ai would instead paste the front body on their back which creates such monstrosity this is also called novel view synthesis where the ai would generate new information about the perspectives that are not presented in the input like the side view of a person or the back side this is similar to how pifu hd generates the 3d model but since it is just model generation not skin generation they use the front image instead but in this case the author can't generate new information of the skin from the back so they just apply the same image from the front however this can be easily improved as the author made it so the ai can take in both the front sight and the backside image information and generate a full 3d model for motion transfer so now it wouldn't have the problem of having a double-sided phase this would definitely be really beneficial if this can be extracted as a 3d model too even though the generated output does look a bit too rounded which looks like some of that 2000s game graphics for characters but hey this only takes like three minutes to render and 20 years ago people still needed to animate this themselves which can take way longer than five minutes the official demo did also provide a 1080p version which shows how it is not limited like fom to just 500x500 pixels and compared to their previous work this is a huge step up and a big milestone for them and this would also mean we will soon have some better technologies and memes for us to enjoy not gonna lie it is only a matter of time before a meme with this ai takes over the internet so if you want to play around with this ai yourself i'll link my installation tutorial that's on my spam channel down in the description this video is sponsored by infinite red infinite red consulting handles your mobile web and ai needs if you are looking for someone to build your app visit with the link down in the description if you have any questions about the installation or want to share your results you can head over to my discord channel and big shout out to mark finn and many other patreons that support me on patreon follow me on twitter if you haven't and i'll see you all in the next one

Original Description

This is basically deepfake movements/motions with just 1 image, and it is so damn good at doing so. Side note, I put Fortnite dances ironically, I am just that shameless. 1:45 should say "my result" instead of "official demo", for those who are confused lol Trump Doing Chika Dance https://youtu.be/fy3mPJIaPdw Liquid Warping GAN/iPERCore [Project Page] https://www.impersonator.org/work/impersonator-plus-plus.html [Paper] https://arxiv.org/pdf/2011.09055.pdf [GitHub] https://github.com/iPERDance/iPERCore [Installation Tutorial] https://youtu.be/LHLfCg8kJsA [Colab (run it online)] https://colab.research.google.com/drive/1bwUnj-9NnJA2EMr7eWO4I45UuBtKudg_?usp=sharing Chika Dance IRL source: www.bilibili.com/video/av42596764 Today's Sponsor is Infinite Red Infinite Red consulting handles your mobile, web, and AI needs Check it out here: https://bit.ly/2UwddmM This video is supported by the kind Patrons: 🙏Marc Schwyn, Mazen Alotaibi, Sascha Henrichs, Jake Disco, Peter Davidowicz Support me on Patreon if you hope to see more: https://www.patreon.com/bycloud [Discord] https://discord.gg/NhJZGtH [Twitter] https://twitter.com/bycloudai [Patreon] https://www.patreon.com/bycloud [Music] Steaminwaffles - Stay By Me [Profile Art] https://twitter.com/bynicalcynical
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from bycloud · bycloud · 31 of 60

1 Can Deepfake work on Anime?
Can Deepfake work on Anime?
bycloud
2 AI that Can Copy Voices
AI that Can Copy Voices
bycloud
3 Live Action Is Terrible So AI Turned It Back Into Anime
Live Action Is Terrible So AI Turned It Back Into Anime
bycloud
4 2 AIs Enhance Anime to 4K 240FPS, but is it good?
2 AIs Enhance Anime to 4K 240FPS, but is it good?
bycloud
5 IRL to Anime With Cartoonization AI
IRL to Anime With Cartoonization AI
bycloud
6 How Does AI Generated Songs Sound Like? [OpenAI Jukebox]
How Does AI Generated Songs Sound Like? [OpenAI Jukebox]
bycloud
7 AI Makes Any Images Cinematic [3D Photo Inpainting]
AI Makes Any Images Cinematic [3D Photo Inpainting]
bycloud
8 AI Generates Anime Faces, And It's Getting Even Better [StyleGAN2]
AI Generates Anime Faces, And It's Getting Even Better [StyleGAN2]
bycloud
9 Tech Behind The Meme: Dame Da Ne AI - Single Image Deepfake
Tech Behind The Meme: Dame Da Ne AI - Single Image Deepfake
bycloud
10 AI Generates New Light Source for Images [PaintingLight]
AI Generates New Light Source for Images [PaintingLight]
bycloud
11 Depixelizing Doom Guy? Mona Lisa in Real Life? The "Upscaling" AI: PULSE
Depixelizing Doom Guy? Mona Lisa in Real Life? The "Upscaling" AI: PULSE
bycloud
12 Image Completion AI - Predict Pixels Just Like Text Predictions [Image-GPT]
Image Completion AI - Predict Pixels Just Like Text Predictions [Image-GPT]
bycloud
13 AI Generates 3D Human Model from 2D Image [PIFuHD - FacebookAI]
AI Generates 3D Human Model from 2D Image [PIFuHD - FacebookAI]
bycloud
14 AI Assisted Masking - Save Your Precious Time Right Now [AE Rotobrush 2]
AI Assisted Masking - Save Your Precious Time Right Now [AE Rotobrush 2]
bycloud
15 This AI Reconstruct Real Life Objects From Just Images [NeRF]
This AI Reconstruct Real Life Objects From Just Images [NeRF]
bycloud
16 Image Restoration AI - Upscale and Restore Faces with DFDNet
Image Restoration AI - Upscale and Restore Faces with DFDNet
bycloud
17 Best Image Colorization AI 2020
Best Image Colorization AI 2020
bycloud
18 Image Decomposition AI - Edit Highlights and Textures Easily [Appearance Eraser]
Image Decomposition AI - Edit Highlights and Textures Easily [Appearance Eraser]
bycloud
19 Deepfake With Audio Only [Wav2Lip]
Deepfake With Audio Only [Wav2Lip]
bycloud
20 Copy IRL, Paste on your PC [AR Cut & Paste]
Copy IRL, Paste on your PC [AR Cut & Paste]
bycloud
21 This AI Transform Faces into Hyper-Realistic Cartoon Characters [Toonify]
This AI Transform Faces into Hyper-Realistic Cartoon Characters [Toonify]
bycloud
22 This AI Restores Old Photos with Damages Automatically!
This AI Restores Old Photos with Damages Automatically!
bycloud
23 Anime Filter with AI - Snapchat vs. TikTok
Anime Filter with AI - Snapchat vs. TikTok
bycloud
24 AI Reduces Bandwidth Problems for Video Calls [NVIDIA Maxine]
AI Reduces Bandwidth Problems for Video Calls [NVIDIA Maxine]
bycloud
25 AI Motion Capture - Track Your Hands & Body WITHOUT Bodysuit [FrankMocap]
AI Motion Capture - Track Your Hands & Body WITHOUT Bodysuit [FrankMocap]
bycloud
26 AI Converts Cartoon Characters To Real Life [Pixel2Style2Pixel]
AI Converts Cartoon Characters To Real Life [Pixel2Style2Pixel]
bycloud
27 AI Sky Replacement with SkyAR
AI Sky Replacement with SkyAR
bycloud
28 Better Than DAIN? NEW BEST Tool for Boosting Video's FPS with AI [RIFE/Flowframes]
Better Than DAIN? NEW BEST Tool for Boosting Video's FPS with AI [RIFE/Flowframes]
bycloud
29 AI That Paints Anything Stroke By Stroke
AI That Paints Anything Stroke By Stroke
bycloud
30 What Happens When AI Robots Design Themselves
What Happens When AI Robots Design Themselves
bycloud
Deepfake Movements with 1 image ONLY [Liquid Warping GAN]
Deepfake Movements with 1 image ONLY [Liquid Warping GAN]
bycloud
32 ANYTHING can be a "Green Screen" Now [Real-Time High-Resolution Background Matting]
ANYTHING can be a "Green Screen" Now [Real-Time High-Resolution Background Matting]
bycloud
33 AI Transform any Image into Sketch or Line Art [ArtLine]
AI Transform any Image into Sketch or Line Art [ArtLine]
bycloud
34 AI That Could Soon Replace Vector Artists [DALL-E]
AI That Could Soon Replace Vector Artists [DALL-E]
bycloud
35 Photoshop Detector AI Is Useless
Photoshop Detector AI Is Useless
bycloud
36 The Future Of Online Shopping
The Future Of Online Shopping
bycloud
37 How The Future of Image Search Would Look Like
How The Future of Image Search Would Look Like
bycloud
38 Everyone Can Make 3D Animations Easily Now! [Monster Mash]
Everyone Can Make 3D Animations Easily Now! [Monster Mash]
bycloud
39 3D Video Stabilization with AI [NSFF]
3D Video Stabilization with AI [NSFF]
bycloud
40 OpenAI’s Sarcastic Chat Bot [GPT-3 API Beta]
OpenAI’s Sarcastic Chat Bot [GPT-3 API Beta]
bycloud
41 You Describe & AI Photoshops Faces For You [StyleCLIP]
You Describe & AI Photoshops Faces For You [StyleCLIP]
bycloud
42 You Only Need Audio To Deepfake Now! Might look slightly cursed tho [PCAVS]
You Only Need Audio To Deepfake Now! Might look slightly cursed tho [PCAVS]
bycloud
43 This AI Transfers Anime Back Into Sketch [Anime2Sketch]
This AI Transfers Anime Back Into Sketch [Anime2Sketch]
bycloud
44 AI Learns To Play CS:GO By Watching Humans Play!
AI Learns To Play CS:GO By Watching Humans Play!
bycloud
45 How AI Fixes The Horrendous CR7 Statue
How AI Fixes The Horrendous CR7 Statue
bycloud
46 Best Vocal Isolation & Instrumental Extraction 2021 [lalal.ai vs Spleeter]
Best Vocal Isolation & Instrumental Extraction 2021 [lalal.ai vs Spleeter]
bycloud
47 Face Enhance AI Restores Extremely Blurry Faces [GPEN]
Face Enhance AI Restores Extremely Blurry Faces [GPEN]
bycloud
48 AI That Only Needs 1 Image To Deepfake [SimSwap]
AI That Only Needs 1 Image To Deepfake [SimSwap]
bycloud
49 The Amazing AI Behind the TikTok JoJo Pose Challenge [BoostMonocularDepth + 3DP]
The Amazing AI Behind the TikTok JoJo Pose Challenge [BoostMonocularDepth + 3DP]
bycloud
50 StyleGAN3!? - What AI Actually Sees When Generating Faces [Alias-Free GAN]
StyleGAN3!? - What AI Actually Sees When Generating Faces [Alias-Free GAN]
bycloud
51 AI generated art goes brrrrr [VQGAN+CLIP]
AI generated art goes brrrrr [VQGAN+CLIP]
bycloud
52 AI That Doodles Any Given Description
AI That Doodles Any Given Description
bycloud
53 Best AI Motion Capture 2021 - OpenPose vs DeepMotion
Best AI Motion Capture 2021 - OpenPose vs DeepMotion
bycloud
54 Anime Image Enhance AI Has Gone To The Next Level [Real-ESRGAN]
Anime Image Enhance AI Has Gone To The Next Level [Real-ESRGAN]
bycloud
55 This Video's Voice Is Entirely Made From Audio Deepfake
This Video's Voice Is Entirely Made From Audio Deepfake
bycloud
56 I Can’t Sing So I Cloned My Voice w/ AI To Cover Goodbye Sengen (English Cover)
I Can’t Sing So I Cloned My Voice w/ AI To Cover Goodbye Sengen (English Cover)
bycloud
57 Best Background Removal - AIs Removes BG Without Green Screen And It's Amazing. [RVM]
Best Background Removal - AIs Removes BG Without Green Screen And It's Amazing. [RVM]
bycloud
58 How I Deepfaked VTuber Gawr Gura with AI
How I Deepfaked VTuber Gawr Gura with AI
bycloud
59 AI Magic Removal - Removes ANYTHING & Inpaints For You [LaMa]
AI Magic Removal - Removes ANYTHING & Inpaints For You [LaMa]
bycloud
60 I Did NOT Expect AI Anime Filter To Be This Good [AnimeGANv2]
I Did NOT Expect AI Anime Filter To Be This Good [AnimeGANv2]
bycloud

The Liquid Warping GAN technology can transfer motion from a reference video to a single image of a person, with potential applications in game development, character animation, and try-on clothes functionality. The technology is based on a recent AI research paper and has been open-sourced, allowing users to experiment with it. The video demonstrates the installation and usage of the technology, as well as its limitations and potential improvements.

Key Takeaways
  1. Install the Liquid Warping GAN code
  2. Prepare a reference video and a single image of a person
  3. Run the motion transfer command
  4. Analyze the output and adjust parameters as needed
  5. Experiment with different input images and reference videos
  6. Explore potential applications in game development, character animation, and try-on clothes functionality
💡 The Liquid Warping GAN technology can generate realistic motion transfer results from a single image, but may require additional input images or adjustments to parameters to achieve optimal results.

Related AI Lessons

I Spent Weeks Looking for a Research Gap Before I Realized I Was Searching the Wrong Way
Learn how to effectively find research gaps by changing your approach, a crucial skill for AI researchers and academics
Medium · AI
ICMI 2026 Reviews [D]
Learn how to interpret ICMI 2026 reviews and improve your paper's acceptance chances
Reddit r/MachineLearning
Workshop submission for main conference paper under review [D]
Learn how to navigate submitting a paper to a non-archival workshop before the final decision of a main conference like ECCV
Reddit r/MachineLearning
Kept context-switching between arxiv, OpenReview, GitHub, and HuggingFace for every paper, so I built this. Chrome extension + website with everything inline, plus citation graph + SPECTER2 neighbors. 3M papers, free, feedback welcome [P]
Streamline your research with a new Chrome extension and website that integrates 3M papers from arxiv, OpenReview, GitHub, and HuggingFace, including citation graphs and SPECTER2 neighbors, and provide feedback to improve it
Reddit r/MachineLearning
Up next
Beyond Big Vendors: ERP Systems Explained #shorts
Digital Transformation with Eric Kimberling
Watch →