Stable Diffusion InstructPix2Pix - Image Editing with Text Instructions

Key Takeaways

coders welcome to one little coder in this video we are going to learn about something called instruct picks to picks instruct pix2pics is a new hot trending methodology using stable diffusion where you can do image to image or in painting without using any mask but purely using text instructions for example if you see this picture if this is your input picture you can simply say swap the swan flowers with roses and you can get this and the same goes with all the other images you can have a picture of Eiffel Tower and then you can say add fireworks to the sky and then it would add fireworks to the sky this is an extremely powerful method and you can do a lot of things with this thing and this model is available on hugging face this model has got its own ckpt so this is the hugging face page if you go click the files and versions you can see the ckpt you can see safe tensors which means means you can use it in your favorite UI possible like whatever stable division UI that you use you can use this thing but it's not more about how to User it's about how efficiently you can give the instructions and that makes that would make this more effective so to make it easier for you I've got the easiest way to try instruct picks to picks if you want to code and if you want to try it yourself you can of course do it before that a quick shout out to Tim Brooks so thank you so much Tim Brooks for making this amazing implementation and then making it open source now I'm going to show you the same instruct picks to picks on playground.ai so now I'm going to go into the playground.ai playground AI sorry playgroundai.com and I'm going to show you how you can make this possible so first go to the home page after you go to the homepage click create and once you click create it's going to give you certain informations one of the thing is like the text based editing is available so it says like you can use simple instructions like add sunglasses or change eye color and then you can do it click try now and that will let you take an input image so I'm going to take an input image so this is an image that I got from pixels this is a wedding couple sitting probably on a wedding day but I'm going to say make it look like a desert not the fruit I'm going to say make it look like a dessert and let us see what it does it it has changed it look looking like a dessert so basically replace the ocean or whatever the water body that they've got and then it has turned it into a desert and you can see some tips here so you can add remove or you can you know use tiles and then you can change it into something like you can in fact like change the object that is present in here for example instead of dessert you can say make it snow and you can click generate and that is going to try to add snow to this image and you can see um like what kind of results that you get like you can see that how the picture this is like I mean like imagine the possibilities that it has got for in fact like wedding photography like you can take one picture and then make so many changes to it I'm going to I'm going to try may make them ghosts goes and I'm going to click generate and then you can see how it changes like when you see make them ghost you would see how Okay in this case it did it didn't like properly do it because uh maybe it didn't look at the face but you can actually see how it does these changes I'm going to upload another image I'm going to click cancel and I'm going to upload another image I'm going to click import image and I'm going to add the Batman image I've got a Batman image here somewhere I'm going to add the Batman image and I'm going to say um make it a fire make it a fire make it fire anyways uh if you upload this image this is I think poster from the darknet Rices you can see how with fire now the light effect changes and all those things okay once again like you can say make him make him a ghost and then you can generate it so the amount of styles that you can do like you can change their clothing you can you can change the style you don't have to necessarily do the masking yourself and it's not just like the particular part that you do masking so the potential is quite enormously you can see when it has made it ghost you can see everything around it how the color has changed I can say make him wear a suit and I can generate again so the like a lot of things that you can do um once again like the one that I'm showing you playgroundair.com is the easiest this is this is definitely not how a Batman make him a ghost is better make him a ghost um so the one that I'm showing you is playground ai.com the easiest way for you to play with instruct pics to picks but if you want pics to picks uh on your own local machine then again like I said you can use it via diffusers you can use it um you can use it with ckpt you can use it with safe tensors if you have any questions let me know in the comment section otherwise I hope you enjoyed this quick introduction to instruct picks to picks I'll come back with a detailed video about how to use instruct pics to picks in your favorite GUI