Style2Image in ControlNet (T2I)

Key Takeaways

what if you had these two images and you could merge them into this let me show you how that works Hello friends today we're going to take a new look at control net because there's been a development with something called T2i while it is Standalone it can be imported into controller and it allows for some very creative uses especially the model's style which we're gonna check out today and we'll figure out if T2i is great or just okay by the way what do you call a factory that just produces okay products a satisfactory all the link is going to be in the description below first you're gonna go to hugging face download the models here I recommend starting with the style the color and if you want to play around try the other ones as well and when you download the them put them inside your table Fusion folder extensions sdweb UI control net models and they're gonna go in here now you do need Jammer files for this but they're going to be automatically downloaded so don't worry about that make sure that you have the latest control net version going into extensions here web UI control and if you don't have that you can install it from available here load from find it and list uninstall since we have it we're going to check for updates you can see here web UI control net is behind so I'm just going to make sure all these buttons are checked and press apply and restart UI now it's installing and stable Fusion is restarting now we're gonna need at least two control models so if you don't have two here you're gonna need to go into your settings you're gonna scroll down to find control net and you're going to change multi control net Max model's amounts change that to two or more and then you need to restart well actually you need to apply settings and then restart okay once you have everything set up we're going to take the images that we're going to use you can either generate them yourself or get them from wherever so we're going to have our input image here I'm going to enable control it we're going to change this to depth you can uh use canny as well works well and I take the style which is going to be in the second one here and first we're just going to take this this drawing so we have a realistic image here and we have a drawing I'm going to enable and we want our photography to turn into this anime style take clip vision and then style here make sure you enable and now you can run this with no prompts you can also run it with prompts and if you do make sure they don't use too long prompts but because if you use two long prompts you're gonna have a bad time and issues are going to stray from what you're trying to achieve so as we can see here the original composition or the woman here has turned into an anime style or Ghibli style image and this can be adapted so depending on how much or how little you want to the style you can change the guidance start of either the photo or this image here so let's say we want less of this then you're going to up the start which basically means for 0.5 or 50 percent we're just gonna run the photo and then this is going to come in for the remaining 50 so this is not going to be as much and as you can see here we're not as flat as in this style this is sort of a mix between both of them and we take something in between let's say 0.25 we're getting more of this style now it's turned black and white but as you can see from my next Generation here that was based on that seat you can also do it the other way around so let's say we want more of the anime picture you can start the photo later which will get the painted image more so here we can see more of the style you can even get lots of the background here as well and this can be done in many different ways and with many different images Let's uh try another image here just to quickly show you so you could basically take your own images or friends images take another one here doesn't really matter which one you take as long as you don't mess with the prompt too much this will work for you and if it doesn't you can play around with the guidance start here now you can do it the other way around too and let's say that we have this image as our depth map and we want to turn this into something let's say we want to turn that into a more realistic photo instead when I reset the guide and start and here we can see that we're getting more of a realistic Vibe now it's not fully realistic obviously but it's it's closer to that style you can do it in many ways say we get this all the woman here and we're gonna up the start here a bit so the woman the old woman is gonna run for 15 first so here you can see the old woman with this as a base you can still recognize this image from this and this image to this it's a cool way to merge Styles and it works particularly well with people actually so I think this would be the main use case I've played a lot with it and for other use cases it's a very inconsistent in my opinion see if we have anything else do you think we could age this woman with this one here let's see here so that works quite well and I think we're actually gonna delay the start of the old woman how about that that's pretty powerful isn't it what do you guys think let me know what you think in the comments below hey thanks for watching like And subscribe if you wanna or don't I'm not your boss have a good one see ya