Anime Filter with AI - Snapchat vs. TikTok

Key Takeaways

as far as i know we have been pretty mediocre at generating anime faces based on real life human faces and not even considering giving results in real time for example the faces eyes hairs are overly disproportionate and with a simple change of the camera angle your face would just become a reincarnation of picasso art not long ago i remember selfie to anime was a big trend and it has the best results for converting a human selfie into an anime character so basically you get to see how you would look like when you're drawing in an anime style but recently this has been taken to a new level as snapchat an app that is heavily infested by filters has implanted dysfunction and with a better twist it is a really marketable ai like the image restoration which can be used to generate profits for companies so i am not as surprised that they took this idea from the open source realm and decided to invest it themselves the project selfie to anime that i've mentioned 30 seconds ago has probably motivated the creation of these filters which is based on the ai paper called you get tit which stands for unsupervised generative attentional networks with adapted layer instance normalization for image to image translation nice another long name paper so basically what it does is that this ai is trained to perform image translation for example style again transferring facial features to another face but in you got tit's case it's slightly different and it uses gan to help them to learn and for those who don't know what gen is the ai just basically gets slapped on the butt for doing something not as good so they will do better next time so here comes the problem you see selfie to anime is a great concept but practically it does not work as well as you can see in these results and previously so snapchat joined the competition recently and not to mention tick tock a while ago way before snapchat and they definitely show a clear superiority in a whole concept of converting real-life faces to anime and here comes our favorite question which one is better but before we dive into this great philosophical question where i can claim that to a certain extent this is better than that let's give an overview of the basic differences the first thing that i noticed that makes these two really different from you got tit is all the important facial features like the eyes are more applied on like a filter instead of being generated while i do not know the exact details about how they have achieved to make these filters but i highly doubt that this is a work of ai to be able to consistently generate eyes without it going everywhere i think this is achieved either using their filter techniques along with some basic ai facial generations and the implementation of you got tits and maybe something else the filter techniques is more obvious for the tik tok filter as you can see all the eyes have the same type of eyebrows as you see in sayakano for snapchat it feels like it has the same generated style as you got to it and to be honest i speculate that the anime filter is from you got tit because i think that it inherited the problems that it has to make a fair comparison in a performance test i first tested them on the same set of pictures ranging from different ethnicity drawings different color of will smith it is rather fascinating looking at these results pause the video if you want to give a closer look but overall i can see a trend of snapchat filters really struggles at picking up beard and bald head it keeps on deciding to give both people hair i mean that's really nice and all but not what you're supposed to do sir on the other hand tech talk does show a trend of having less diversity on how people would look like even though the eyes look really nice but you can see that the colors are mostly the same and this gives like an overall less sense of uniqueness when they all have the same pupil color this is not as satisfying because one of the more important features in anime faces is the eye it is the eye color that would separate a character from being normal and being a psychopath onto the movement aspects the accuracy of generating hair is really good on tick tock but i doubt that's generated it could have been generated but i think that it is too accurate to be generated so i would say it's more like an outline filter within the anime filter but for snapchat the hair is pretty obvious that it is generated and it even ignores when the hair is too long this is probably ignored due to the limitations in training the ai model also when there are obstructions blocking the faces tech talk manages to reduce the distortion while snapchat just can't handle the change and overall i think tiktok's anime filter maintains a better consistency at following faces tracking the mouse movements and not constantly changing the look like how snapchat would make you grow more hair if you move too much i think that in videos snapchat slightly lose the edge on this and i'm guessing that it is transforming the faces frame by frame so it is hard to maintain its consistency and tech talk is slightly better in this context but for a more authentic and genuine anime phase transformation i would say snapchat does it better even though tech talk is still better in some other aspects and this video is sponsored by infinite red infinite red consulting handles your mobile web and ai needs if you are looking for someone to build your app visit and reach out at infinite.red and lastly thank you guys for watching as always join my discord if you are interested in discussing anything and participate in the community check out my patreon and my twitter if you haven't and i'll see you all next time