Tech Behind The Meme: Dame Da Ne AI - Single Image Deepfake

Key Takeaways

I think we all know that animating is something really costly both financially and physically in most anime animators do those reusable frames to make the characters look like they are talking or have a steel frame and just have audio and imagine having the need to have a high studio level equipment just to recreate a CGI character in motion and the near future this can probably be a cheaper and viable alternative for more indie films to make Hollywood level CGI or anime studios to reduce their budget even more you've probably have heard of this AI but if you haven't is called the first-order motion model for image animation it can perform not only just faces but also any motions that are trained upon like the running voices we just saw in this fashion spin I don't know how to exactly describe this motion modeling hmm best thing about this a is that you only need one input and it can gather all the information it needs the AI will then animate the input which is the source image based on the driving video which is a video that the source image is going to imitate two minute papers has a really clear explanation video already so I'll probably just skip this part and if you want to check it out I'll link it in the description so why exactly is this in any form better than deep fakes in comparison deep fakes AI normally needs a lot of source images to determine how a person looks like then generate them moving or speaking which is more accurate for sure but it takes way too much time than this new AI the new AI currently is not in high quality but the results considering only just taking in one source image is actually mind-blowing for real human faces it can generate their teeth easily when they open their mouth which was not in the source image - this is probably achieved through training model really well and it also uses in painting techniques to generate extra information like the side of the heads or the background that was not present before moving on from human faces for specific animate characters it can easily make them talk like actual people instead of speaking like a robot with the same mouth movement over and over again even though the results here are not all great but keep in mind the model was trained for human faces and that you sell anime faces so it sometimes has difficulties picking up the traits that normal human faces won't have like the lack of details on the mouth and at this one I got a bit more creative I attested out on some mango drawings the results are still kind of imperfect but this really does show how well the AI can pick up faces and animate them well it is not like I have been always successful with all my samples so far so don't have your hopes up too much when you are testing this AI yourself on the other hand this really does look like some anime games animations it literally looks like it's taken out from the game before a bigger surprise well not really since this AI already works perfectly on real human faces it works really well on some cinematic characters like from League of Legends or even World of Warcraft not only that The Witcher Keanu Reeves from cyberpunk 2017 2017 2077 Laura Croft and lesion from Rainbow six all also have really impressive results oh and there's Trevor well that's about it for today's testing if you want to try out the AI yourself I'll link the collab down in the description if you got any questions or quirky ideas that you want to share join my disk or I created it recently follow me on Twitter if you haven't and I'll see you all next time