AESTHETIC GRADIENTS: Free Dreambooth Training In Stable Diffusion? Is It Good?

Key Takeaways

in this video I'm gonna show you how you can install a brand new addition to stable diffusion called aesthetic gradients so what are aesthetic gradients well it's basically a technique that you can use to apply a certain style or aesthetic to your images for example in a comment here and I determine a picture in my case I generated a portrait of a Georgia manor house on the street and it gives me this but if I come in here and I choose this aesthetic embedding file and then click on generate it gives me this which kind of looks like a little bit like a church why does it look like a church well that's because I used an embedding file that was trained on 8 images of churches during winter and that is why when we apply this little embedding file on our image our Georgian house started to look like a church so SDC gradients allows you to kind of change your image but without using any words here in your prompt and instead you use small embedding files now to install this is actually fairly simple what you're gonna do is click the link in the description down below and you're gonna download this embeddings archive which is basically a bunch of embedding style that I downloaded and put together in an archive just so that it's easier for you then you're gonna right click and click on extract then I'm gonna assume that you have indeed super stable diffusion 2.0 installed and that you follow my video If you haven't I highly suggest that you watch this video first before watching this one because you need to have Python and get installed so once you have everything installed you're gonna go with your super stable diffusion 2.0 folder stable diffusion web UI here you're gonna click on your folder URL and type CMD and press enter and here you're gonna copy and paste the command and you will find in the description down below and then you're gonna press on enter now I'm not gonna do it because obviously I've already done it and what this will do is that you basically create in your extensions folder a brand new folder called aesthetic gradient now what you want to do is go back into your embeddings folder double click select all of these Ctrl C super stable diffusion 2.0 stable diffusion web UI then go to extensions aesthetic gradients and then you go to in static embeddings and this is where you're gonna paste all of those files then we just copy it just press Ctrl V and paste them right here obviously I'm not going to do it because everything is already done and then you're gonna go back and launch stable diffusion and if you've done everything correctly you should have two new options here you're gonna have a brand new tab called create aesthetic embedding and here you're gonna have a new open for click aesthetic and if you click on it it's going to show you a bunch of new options now before I explain everything here let's actually create a brand new aesthetic embedding you're gonna click here on this new tab and what I'm gonna do is I'm actually gonna create a new static embedding based on me Journey images so here for the name I'm just going to choose mid Journey The Source directory is where your images are located so in my case they are right here Ctrl C Ctrl V here the batch size um actually the batch Size Doesn't really do anything there is a lot of people that said that even if you increase or decrease the batch size that's not gonna do anything but apparently it's just gonna use a little bit more RAM so if it works for you you can just leave it at default then you're gonna click on create images embedding and there you go it is done it was only done in one single second yes I'm not kidding this was actually done in one second so then let's actually go back here I'm gonna put a prompt of Christina Hendricks obviously choose the simply the steps the CFG scale and here we're finally gonna start using our stating gradients now I'm gonna be very honest with you this is one of those videos that I did not really want to make in the beginning because aesthetic gradients does not work the way you want them to because they are very random but it's a set of subscribers told me that still be very interesting for the community to know how everything works I decided to make this video anyway but the thing is is that aesthetic gradients are extremely extremely random and they certainly do not work the way you want them to so if you think that you're just gonna take an image an existing image and then apply a new style over it just like that well unfortunately that's not going to be the case and I'm gonna show you later the results of my analysis so here I'm just gonna generate a new image and there you go this is the final result looks really really good we need to use the exact same seed so we're gonna click on this button right here to reuse the scene that we used to create this image then we're going to scroll down and here we're gonna finally choose our aesthetic embedding file and play around with the settings so first of all I'm gonna say it very clearly all of these settings right here the learning rate interpolation the aesthetic text slurp angle is negative text you should not use these settings because they are just absolutely insanely random I have have no idea what these do I did a lot of tests using these I'm going to show you later that was absolutely horrible I have no idea how this actually works or what these options actually do so the first thing you want to do is you're going to choose your embedding file right here so since we create a mid Journey we're gonna select it right here now for the aesthetic weight and aesthetic steps what's kind of strange is that well these are supposed to be two different options but sometimes with so many static embeddings they sometimes do the exact same thing now in theory the aesthetic weight is basically the amount of influence the invading file is gonna have on the final image so the higher the value the less the final image is gonna look like our base image and the aesthetic steps the higher the value the closer we're gonna get to the aesthetic embedding file style did you get any of that yeah me neither because again in reality sometimes the they basically do the exact same thing you might have an aesthetic way that is extremely low that you think oh it's just gonna look like the base image and then you're just going to increase the aesthetic steps but basically in the end the aesthetic steps basically completely changes the final image and it doesn't look like the base image at all so you really need for each embedding files to play around with these two settings there is not a universal settings that works for every embedding files and that is extremely infuriating but usually what works for me especially with faces is that you want to have a low aesthetic weight maybe around like 0.2 or 0.3 and then you want to increase the aesthetic steps to have a higher influence from the style but anyway I'm gonna show you everything later so that you can see clearly in the board and here I'm gonna click on generate and this is the final result so as you can see this is the image before and this is the image after using give me Journey style do you see any difference there is a difference indeed but which one do you actually prefer that's the question and if I come in here and I'm just going to increase the aesthetic weight maybe to like 0.5 and then click on generate this is the final result so as you can see the higher the weight the more influence we get from the aesthetic gradient but also the character starts to look less and less like the bass image because this woman certainly does not look like Christina Hendricks and here's a little graph that I created so that you can clearly see the influence of weight in steps of aesthetic gradients on your image as you can see this was our base image right here and here as we go from left to right the more weight you put in and here from up and down the more steps I use so as I said earlier the more weight I use the less it looks like our base image and at the end it doesn't even look like a person anymore but the style is indeed a little bit more present and here the more step apps we get and the closer we get to that mid-journey style and that's why I think the sweet spot is kinda using a low aesthetic weight but a higher aesthetic steps when it comes to faces at least when I use the mid Journey style now these images here are a bunch of tests that I did using all of these options right here slurp interpolation HTC texture images serve angle is negative text and you can see basically each time what I did so that you can see if you are interested in using these options or not but basically I have no idea what these images do I use this image as a base and each time it made a brand new image that was basically completely different from the image that I used in the beginning so these options right here for me are a complete mystery I have no idea how they actually work what kind of results you can expect if you use them now although ICT gradients are kind of like a heated Miss with well pretty much everything unfortunately there is actually a one case scenario that is actually pretty good and that I would actually recommend you to try and use because it could potentially make your final images look better and that is when you use aesthetic gradients in cognition with dreambooth for example this is a base image that I created with renera this is something that I created in my previous Dreamboat video this is the base image and I created a brand new aesthetic embedding using the exact same images that I used to train in dreambooth and then I apply the aesthetic gradient to that image and basically what this does and this is something again that I noticed if you really do plan on using it on faces you should definitely try to use and lower aesthetic weight something between 0.2 and 0.3 and with a very high aesthetic steps because this in turn gives you pretty good results when in the end you actually get very interesting and very aesthetically pleasing images using the aesthetic gradients file so here's another example here is the base image that I created simply using the base stable diffusion parameters and then I applied the aesthetic gradient on that image and it gave me this and here the more weight I applied the stronger the effect was but after a while unfortunately as I said the higher the weight the less it's gonna look like your base image so for faces there is definitely a sweet spot where it basically keeps the previous image but recreates it in a little better style a little bit more aesthetically pleasing and for this if I remember correctly I used 0.3 in weight and 50 steps to create this image from this one and here's another example again with the same exact parameters base image and with aesthetic gradients which I don't know if this one is better than the base image but it just gives you kind of like a different style and this is really for me where aesthetic gradients should really be used this should really be used in combination with dream Booth because this will allow you to create and generate different images that are maybe more aesthetically pleasing than the base image without actually changing anything in the prompt so would highly advise you to kind of play around with the settings a little bit in the archive that I gave you do you have a bunch of eventings that you can use and apply to your images and if you want to try the aesthetic ingredients I highly suggest you try it out in combination with dreambooth you could actually get some pretty cool images but otherwise this DC grenades is kind of like a hit and miss I'm not gonna lie and again if you want to have access to this board everything will be in the description down below and there you have it folks now you should have this new aesthetic gradients option installed on your own stable diffusion and you're ready to use thank you so much to my patreon supporters for supporting my videos you guys are absolutely awesome thank you so much for watching don't forget to subscribe and smash the like button for the YouTube algorithm and I'll see you guys next time bye bye