AI That Paints Anything Stroke By Stroke

Key Takeaways

when we used to talk about how ai imitates painting styles it was more like oh so we get this picture train an ai and make this to have a similar style to that picture but what we are talking about today is way beyond that level of simplicity how previous ai research papers approached this problem was always about how they can manipulate these image pixels to get them to imitate real life brush patterns painting patterns or illustration strokes but that is always pretty difficult to achieve because if you generalize a kind of style distortion like how the oil paint brushes are always thick and heavy it may still be difficult to translate that into another scenery or sky where it would just look unnatural and odd but how this new ai research paper generated their answer to this problem is rather simple yet it was never properly used okay let's think logically for a second if us humans want to produce a portrait artwork like the mona lisa but in oil paint how would we do it how would you do it a starts by drawing line by line stroke by stroke b distort the scene with max level light magic and take a photo of it if you ever thought about choosing b then you better follow me on twitter as your punishment but yes exactly we draw stroke by stroke to create an artwork it always has been so how should artificial intelligence machines that are programmed to simulate human intelligence supposed to produce a realistic oil painting of mona lisa it makes a lot of sense drawing a stroke by stroke instead of distorting the pixels to look like an oil painting right so it's just like how marcus did it but it's just copying a pre-existing artwork instead while i am still as impressed as that old guy back there because it looks way more realistic and good now but what is on the canvas that i am so impressed about let me show you this ai is called stylized neural painting and it is able to generate styles ranging from oil paintings marker pen style painting 8-bit artwork to watercolor painting of any input of your choice the only downside to this is that the strokes are limited to how hardcore your gpu can run so from the officials demo you can see some pretty great renders of stylized artworks to mix in some of my results they all look rather quirky and i think it's a really spectacular set that i've always wanted to see but hey there's an even bigger surprise to this ai since this ai is designed to formulate strokes and predict how it can match the input image it uses this method called parameter searching that aims to maximize the similarity between the input image and the ongoing canvas that the ai is painting on so not only can this ai create real world like textures and color transitions of these pictures but it can also do it live yes live so today my title of the video actually meant what it was supposed to mean it can draw and it can show you how the strokes are being overlapped and creating the final result that is similar to what image you chose as the reference you are able to see how different styles start differently on the canvas a bit r starts with large squares and slowly builds on top of the squares the oil painting starts off with a few large brushes and slowly cover the entire canvas with smaller strokes to create the details the marker pen style starts with some wild solid shapes that looks like it'll produce some kind of geometrical art but slowly creating more details by adding more curves and filling more colors on top of the canvas [Music] and most importantly there is also this style transfer option where you can transfer one image's style to another i wouldn't say the technique is perfect but i think that this still gives a pretty solid result for transferring styles compared to older techniques everything just looks fascinating i think this is why i am in love with ai and this is definitely worth the time of constantly digging through papers to find the newest gold that i can share with you all and a few more papers down the line this technique can probably be refined to produce really good paintings from just images and have clear details which this ai still cannot achieve there is more info in the official documentation so you can check it out from the project page if you want to learn more about the technical aspects of this ai's architecture i'll also link an installation tutorial down in the description if you want to run it yourself or if you want to run it online i'll link the collab down in the description too and this video is sponsored by infinite red infinite rare consulting handles your mobile web and ai needs if you are looking for someone to build your app visit with a link down in the description if you have any questions join my discord channel and you can easily seek help there on the tech support channel big shout out to mark schwinn and many other patreons that support me on patreon follow me on twitter if you haven't and i'll see you in the next one