This Video's Voice Is Entirely Made From Audio Deepfake

Key Takeaways

a while ago adobe had a really promising voice manipulation software in the making and it was definitely way ahead of its time just take a look at this and uh i kissed my dogs and my wife okay so let's uh let's do something here okay copy paste let's do it copy taste oh yeah it's done let's listen to it and uh i kissed my wife and my wife oops but for some odd reason there were no official news releases or even announcements made after this extremely concerning public reveal fast forward to now you are listening to a video that's entirely made from ai vocal synthesis for reference this is my normal voice the i simply cloned my voice by training with my audios and transcripts from a few of my older videos and now this ai can actually speak normally and even sing for me which would typically be impossible to achieve i can become an m some of them do assuming i'm a human i gotta do together through your superhuman innovative and i made a problem so that anything you say is saying of immediately to you and that's anything more than after demonstrating under given [ __ ] he's a feeling by of a dating never evading and i hope the haters are forever waiting for the day that they can afford to be celebrated because another way to get them out of it make up evaded music you make elevator music sing some slick japanese or just be some dumb hoppy pasta what the [ __ ] did you just [ __ ] say about me little [ __ ] which is also pretty fun and scary at the same time and these are all done through this research paper called talk net talk net came out in mid 2020 and it is able to reproduce singing by mimicking tones from another person with a reference audio while it can still perform without a reference audio too but it doesn't sound so good so my ai vocal cord is capable of singing without damaging any ears now but this singing thing isn't perfect either notably when some part of the singing that queer is dragging on vocals my voice goes everywhere this could be because there isn't any singing in the data set or just simply because the audio reference for the ai to copy the style of was not clean enough and don't have enough training data so just imagine how well if we have a really well trained ai model it would be crazy i definitely struggle the most when it comes to making the ai pronounce while or dragon will this is because the current ai talking net uses a type of pronouncing notation called our puppet our puppet is a set of phonetic transcription codes so it tells you how an english word is spoken in american english since this ai model is trained in english as long as i make the alphabet similar to the pronunciation of other languages i can make the ai sing in japanese too so this is how harumachi is possible this actually also applies to singing as some syllables are separated instead of spoken like a word so you will see some really odd combination of inputs to produce the actual singing like pronunciation you can see in the comparison here and yes in dropping my first ever song covered by my ai vocal cord check out the full song link in the description i also put the input lyrics in the actual lyrics side by side too as it is sometimes really funny what input i choose in order to get the ai to sing some words accurately well these voice cloning ais were already really believable if you played it through a phone call a few years ago having this clear audio is definitely going to break the internet and it can definitely be clearer than what you are hearing right now so i'm pretty worried for my grandparents meanwhile singing still has a long way to go due to some actual ethical concerns with the peers i collaborated with for this video i would not be publicly teaching people how to use this ai but shout out to justin john for helping me with making this video and if you really want to learn it you can join my discord and ask there on the other hand as of september 9th facebook ai just released a jaw-dropping speech synthesis ai that does not require a transcript to train and it sounds even more real than this current voice it has some really impressive results but the codes are not released yet here have a listen when an aristocracy carries on the public affairs it's verification there may be in science and from the last video i talked about how you can deep fake videos in real time and it has definitely troubled a lot of people even though the current votes cloning can't really perform live but if you look closely at the adobe video it's literally a real time voice editing demo performed on a stage in 2016. 2016 is five years ago by the way let that sink in it's literally way ahead of its time but let's not fear the technology instead we should be prepared and strengthened against it early on because the future will always inevitably come and sometimes there is no point struggling against it so if you want to learn more about ai today's sponsor skillshare has the right place for use skillshare is an online learning community with thousands of inspiring classes for creators you can freely explore new skills deep in existing passions and have fun with your creativity right now you probably have a lot of questions on what exactly is ai machine learning or whatever this mystical and futuristic technology is fear not there is actually this class called demystifying artificial intelligence understanding machine learning by christian heilman which provides a really great introduction on the topic of ai the lessons aren't that long either so you can easily go through them during your free time what's even better is that they are currently also providing a limited time offer of one month free premium trial instead of the usual two weeks which provides you plenty of time to go through these short lessons and even if you are done with that class you can also check out their other more in-depth machine learning and ai courses or other amazing ad-free and high-quality creative classes like photography illustrations and video editing the first 1000 people to click the link in the description will get a one month free trial of skillshare so you can start exploring your creativity today lastly thank you for watching a big shout out to andrew and many other patreons and members that support my work through patreon and youtube if you have any questions feel free to join my discord too follow my twitter if you haven't and i'll see you all in the next one [Music]