InstantID for Automatic 1111

Key Takeaways

instant ID for automatic 1111 is here and it is amazing hello my friends how are you doing today I'm going to show you how to set everything up and how to get it running with the right settings as fast as possible also fair warning this is using the inside face technology so you can't use this in a commercial way let's get started here you can see the initial image that I'm using and some amazing different style results using this face the amazing thing about that is that it sticks to the face and is independent of the style very different from IP adapter which could also do a face but would stick to the style at the same time this gives us a lot more freedom so the first thing you need to do is to go inside of automatic 1111 to your extensions Tab and then click here on check for updates the most important thing here is to update the control net extension you click click here on apply and restart and this will download everything for you that needs to be updated you might have an error message at that point which means close the CMD or command line window for automatic 1111 and simply start it again this should resolve the problem then when we go back here to our text to image when you scroll down to control net in this case it's going to be a little bit more complicated because we need to use two control Nets at the same time now down here you can select the pre-processor and of course also the model so in the first control net it is really important that you select the instant ID phase embedding and then for the model select IP adapter instant ID sdxl in the second control net what you want to do is to select the instant ID face key points and then for the model the control instant ID sdxl yes this is only for sdxl at the moment however you also need both of these models for this you want to go to the GitHub page I have linked below the video here the project is described you want to scroll down a little bit and you can see here there is two links for download when you click on them they will directly start the download however the files have the wrong name so for the first link you need to use the first name given here for the second link you need to use the second name given here this is important so that control net actually understands these models and can use them in the right way this has to go as it says here into your automatic 1111 folder in there into the models folder in there into the control net folder after you have downloaded this you want to click here on the refresh button to actually load these models or start automatic 1111 all together again new now the first time you're going to use this this is going to download the pre-processor models for you so it's going to take a little bit time because it's about like 2 300 mbes an additional download now let's talk about the image we need for this the face should be clearly visible it should not be cut off or overlaid by anything in the picture so you can actually see the face well and I would also suggest to have a rather high resolution image with nice details in there but you can also try a lower resolution I set mine to a on by one crop with 2,000 pixels on each side probably too large but at least I get some good quality from that load the image into both the first and the second control net and then on the GitHub page it actually says down here 512 for the pre-processor res resolution I set mine 2024 I didn't get any negative effects from that and it also didn't take longer and it is the resolution for sdxl so I don't see anything negative about that for the rendering I would suggest to you if you want to experiment with this and have the images render faster to use a turbo model for sdxl that is rendering faster I suggest to use the turbo diffusion XL turbo model this renders very nice Styles in very few steps and gives you a faster render time so that you can experiment more with the model so download that into your models folder into the stable diffusion folder it's as you can see here 6.62 GB and of course it's going to be an sdxl model load that inside of automatic 1111 set the vae to automatic if you don't have this setting it is already at automatic write your prompt and of course your negative prompt I kept it pretty precise and short here first of all because it is easier to apply style to the image but secondly also because sdxl doesn't need super long prompts anymore it understands what you want to create now for the settings because we are working here with a turbo model I'm going with the DPM Plus+ SD Caris sampler I'm only using eight steps which saves you a lot of time and and then for the CFG scale I'm using a lower CFG scale which is also suggested by the GitHub page for instant ID of only four you can see here for the result working pretty well with the anime style of this image now let's talk about the control net settings because there might be a head scratcher for you if you don't adjust anything at all you might always get a photo image and not have the style applied so what I would suggest to you is to both in the first and second control net set the control weight to 0.5 play around with the control weight but 0.5 I found is a good balance between giving enough freedom for the style but also having enough Precision for the face another thing you want to play around with is the end control step this means the last step that the control net is applied you can play around with this in the first or the second control or in both control Nets and just see what kind of results you get from that so let me know in the comments what you think follow me on Twitter for daily AI news updates leave a like if you enjoyed this video and see you soon bye oh you're still here so uh This is the End screen there's other stuff you can watch like this or that's really cool and yeah I hope I see you soon uh leave a like if you haven't yet and well um yeah