9 ADVANCED ComfyUI nodes.

Sebastian Kamph · Beginner ·🎨 Image & Video AI ·3mo ago

Key Takeaways

The video demonstrates 9 advanced ComfyUI nodes for image AI tasks, including detail demon sampler, RIFE, reference latent, K sampler, Paint crop, Paint stitch, Mask editor, in-painting node, and conditioning zero out node. These nodes are used for various tasks such as image generation, video interpolation, latent space manipulation, and workflow optimization.

Full Transcript

I'm going to show you nine advanced nodes in ComfyUI I use a lot. Now, whether you are a professional or a beginner, these are going to be useful for you. Oh, and do you know which days are the strongest? Saturdays and Sundays, of course. The rest are weekdays. Let's start off with something real amazing. Look at this image. What if you could just increase the detail like this? Just look at this. We're just going to bunch of more stuff into this. A lot of more details. Is it details as you want? I don't know. That's up to you. The point is more details. So, what we got going on here is the detail demon sampler. And when you are generating, you can connect it to your sampler. So, you would need a sampler that takes a sampler input. Here I just have a Z image turbo workflow connected as a group here. So, what you do is you connect this detail demon sampler and it's a part of the detail demon custom node. And then you connect the sampler K sampler select into it like Euler here. And then you're setting your detail amount. I'm currently having it set to 0.8. It goes up and down. You can go crazy with it. And that's going to increase sort of the noise in the image as you uh keep generating. You can change when it starts and when it ends in terms of the generation. So, here, let me see, we have how many steps? Where's the steps? Eight steps. So, it would probably start point two about uh let me see, one or two steps in and then it would stop before the final one one or two steps there, right? So, this is really really cool. And the comparison here is with and without the detail demon. So, this would be your generation. Here's uh the prompt which you can barely see. Let me make that bigger if you are interested in that. We essentially have this anime style illustration. And what the detail demon does is it gives you more details. So, you can see that coming in everywhere. We got some more stuff in the character here, on the clothing, in the background. We got more stuff all over the place. Really cool. Really powerful. Next up, we got something called RIFE and it's frame interpolation and there are a bunch of nodes to choose from. I have selected three here. So, we have RIFE by VFI. We have RIFE by the frame interpolation node packs. So, the names here are the node packs and these are the node names. Here we have fill nodes and what RIFE does, it it interpolates between video frames. So, for example, if we have a video of this car, you can see it's stuttering forward like this. No bueno. This is not good at all. And you might have generations that look like this. Example, if you're doing one generation at 16 frames per second, you might want to increase your frames per second. So, what you do generally is you run a RIFE pass. Then it interpolates between the frames creating smoother motion. So, if you're using video at all, make sure that you try out some RIFE interpolation. Really simple. Really powerful. And it doesn't take a lot of resources, either. You don't need any fancy stuff. And this has actually been around for a long long time. So, it's really nothing new in terms of AI magic going on here. Next up, we got reference latent. What is this? Well, most of the time you're sending a prompt through the conditioning here. So, we have a man and you're sending that into the positive prompt. Well, in some workflows and some models, they can accept more data in the conditioning. So, you can send images into the reference latent. So, what we're doing is we're loading an image and then we are encoding it into the latent space and sending that into the conditioning here through the reference latent. So, this is a really powerful way to send image references into your prompts. Now, not all models do this, but a a lot of the new ones can. So, this is the reference latent. You have probably seen it in a bunch of new workflows. Really powerful. Really cool. So, that's essentially what it does. Sends an image with your prompt. There are a bunch of K samplers out there. And this is the K sampler advanced. There are other versions. There's the K sampler advanced efficient, which essentially does the same thing. You can use the clown sampler. Let me see. Clown shark sampler. We can also do the same thing. Steps to run here. But the idea of the K sampler advanced is that you're adding started step and ended step. Why do we need this? Well, for example, you could chain these. So, you could start the generation here. Let's say that we're running 20 steps. And then you could end at 10 steps as an example. And here you could start this at step 10. You can keep this at 10,000 or or 999 or whatever. But just for education's sake, I'm going to put this to 20. So, what you see here is that the first K sampler runs the first 10 steps. And the second K sampler starts at the 10 step and runs the last two steps. So, each sampler runs 10 steps each. Now, if you do this, you need to make sure that you enable return with leftover noise. So, when the data here is sent over, there's actually some noise to work with. And also to make sure that when you end this, if this is your final sample, that you have this set this at disable. Now, why would you want to do this? Well, let's say for example, you have one model where you have amazing prompt understanding, but the detail is kind of bad. So, you can start your generation in the left one, get perfect prompt understanding, and then you can have a second sampler in the second model that's maybe great at details, but not as good as prompt understanding. Because now the image is essentially half finished. And now you can finish it up with a different model if you prefer. So, it's a very cool way to experiment with dividing your generation up into different parts. This is also fairly common when it comes to one workflows where you have a high and a low model. And this is essentially doing a similar thing. This is probably one of my most favorite node packs. You have in paint crop and in paint stitch. What does it do? Well, if you have an image, let's say you have an image like this, my beautiful face and beautiful hat, and then you have masked something out. So, what I've done is I have gone into the mask editor and then I have selected this part here and I'm sending the image and the mask into in paint crop. Now, what it does is it crops into my mask and the surrounding areas. And I can select here the size. I'm selecting 1024 by 1024. And I have extended a little bit outside of the mask by a factor of 1.2. So, I'm essentially cropping in to this part. Now, why would I want to do that? Well, if I want to in paint, for example, I'm now sending this image out and here I can do changes to this part only of the image and then we're stitching that image back here, the in painted image. And it essentially gets copy pasted here back into the full image. Now, why are we doing this? We do this so we can work with really big images. This is a 2,500 by 3,000 almost 400 pixel image. And also so we can change parts in the image without changing everything. If you've been using none of an auto pro or another image model that's multimodal, most of the time when you ask him for a small change, changes everything in the image. And this way you can crop in, in paint, change, whatever, stitch it back into the original and keep working. Now, if you wanted to in paint, you would need a sampler and you would ask sampler to do a specific change to this part of the image. And that would be here. So, this where you would build out your in painting workflow. But the main part is using an in paint crop and in paint stitch. And I just love this node. It's amazing. This is one of the more simpler nodes that we're going to be touching upon today. So, this is uh it's actually two nodes. It's the string multiline and concatenate. And these are core comfy nodes. And the string multiline is essentially just a way to input text as a string. So, we have first part of text here. And they have second part of text here, and then we're concatenating, we're putting them together. We're selecting a delimiter, so what's happening between string A and string B, and I've selected a dot, and I've also selected a space, as you can see here. So, it's happening because you can see there's no dot here. There's no dot in the beginning here. It's actually adding the dot and the space. So, first part of the text here, second part here. So, why would you want to do this? Well, for example, if you want to build out advanced prompts coming from somewhere else, if you want to set specific file names or instructions for anything, this is a very powerful way to do that. You can connect multiple of these together. Now, in the core comfy node, there is only two strings that can be connected. Now, you can chain multiple of these to have more, but there are also other concatenate nodes. Uh here's one, for example, from walls node. So, here you have four inputs. You can even clean white spaces, remove white spaces. So, there are a lot of text concatenate nodes, but essentially it puts text together. There are also image concatenate nodes, if you are into that. This next one here is the all-in-one aux preprocessor. And it's from this node pack, comfy UI control net aux. Now, what it does, it takes an input and an output, and it let let's you select a preprocessor from a huge list here. And what it does, you can see here. So, I have an input again. This is the same image we used before, and we're now selecting different control net preprocessors. So, here we have a depth preprocessor. Here, for example, we have a line art. Down here, we have a canny. Uh there's even an open pose here. So, this is a great node to just have all these preprocessors available. There is one drawback, and that is if you're loading, for example, canny here, which is a comfy core preprocessor, you are not getting the threshold settings, so some of the more advanced settings of these preprocessors. So, bear that in mind. These all-in-one preprocessors are very easy to use, but you might be missing some of the more important features if you need to do any changes. And now, these control net preprocessors are used for control net workflows, video-to-video workflows, anytime you need to uh have an input and change that into something else. Very, very powerful. Up next, we have the conditioning zero out. There's nothing going on here. There's no settings. It's just a node where you connect the conditioning and output the conditioning. So, what does it do? Well, usually when you're running a case sample like this, you're having two prompt boxes, a positive and negative. Let's say you have a negative, bad, blurry, whatever negative, all right? And you would connect that to the negative. Now, some workflows don't accept the negative prompt, especially if you set your CFG to one, which essentially makes your negative prompt useless. But, this process is still being done. Is it going to take a lot of your computer resources? No. But, you can effectively cancel that out by using a conditioning zero out and connect that to the negative. Now, what that does, it it takes every- anything that goes on in here in terms of conditioning, and it just puts it to zero, and then it sends out nothing into the negative. So, while a very small increase, it is a little bit beneficial to your system resources, especially for the first run. It's also kind of convenient in your workflow, just having it clean, instead of having a bunch of prompt boxes that aren't being used. Thanks for watching. If you haven't seen my top 11 favorite nodes, you can check them out in the video here. As always, have a good one. See you.

Original Description

These are 9 advanced nodes i use in ComfyUI regularly. Exclusive guides and content here https://www.patreon.com/sebastiankamph Great cloud solution for Comfy with free unlimited workflow building https://floyo.ai Chat with me in our community discord: https://discord.gg/dFB7zuXyFY
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Sebastian Kamph · Sebastian Kamph · 0 of 60

← Previous Next →
1 How to install stable diffusion tutorial (automatic1111)
How to install stable diffusion tutorial (automatic1111)
Sebastian Kamph
2 Inpainting in Stable diffusion for beginners.
Inpainting in Stable diffusion for beginners.
Sebastian Kamph
3 OpenAI NEW Whisper is AMAZING!
OpenAI NEW Whisper is AMAZING!
Sebastian Kamph
4 Tutorial - Free AI Game assets in Stable diffusion. Episode 1: Sword
Tutorial - Free AI Game assets in Stable diffusion. Episode 1: Sword
Sebastian Kamph
5 Game assets in Stable diffusion. Ep 2: Jewelry
Game assets in Stable diffusion. Ep 2: Jewelry
Sebastian Kamph
6 Stable diffusion Animation tutorial with AUTOMATIC AUDIO SYNC. Make your own AI music video!
Stable diffusion Animation tutorial with AUTOMATIC AUDIO SYNC. Make your own AI music video!
Sebastian Kamph
7 Stable diffusion img2img tutorial.
Stable diffusion img2img tutorial.
Sebastian Kamph
8 Stable diffusion tutorial - AI Game assets. Episode 3: Treasure chest
Stable diffusion tutorial - AI Game assets. Episode 3: Treasure chest
Sebastian Kamph
9 Stable diffusion animation tutorial. Deforum ALL settings explained. Make your own AI video!
Stable diffusion animation tutorial. Deforum ALL settings explained. Make your own AI video!
Sebastian Kamph
10 Dreambooth tutorial for stable diffusion. Quick, free and easy!
Dreambooth tutorial for stable diffusion. Quick, free and easy!
Sebastian Kamph
11 Dreambooth to CKPT. NEW VERSION! Dreambooth locally on potato pc.
Dreambooth to CKPT. NEW VERSION! Dreambooth locally on potato pc.
Sebastian Kamph
12 Stable diffusion tutorial. ULTIMATE guide - everything you need to know!
Stable diffusion tutorial. ULTIMATE guide - everything you need to know!
Sebastian Kamph
13 AI music video. Neffex - Winning
AI music video. Neffex - Winning
Sebastian Kamph
14 Stable diffusion video input tutorial. How I made this music video singing animation.
Stable diffusion video input tutorial. How I made this music video singing animation.
Sebastian Kamph
15 Stable diffusion color grading tutorial. Quick trick!
Stable diffusion color grading tutorial. Quick trick!
Sebastian Kamph
16 Prompt Editing and Alternating Words in Stable Diffusion.
Prompt Editing and Alternating Words in Stable Diffusion.
Sebastian Kamph
17 Stable diffusion gui most important setting. Live render preview.
Stable diffusion gui most important setting. Live render preview.
Sebastian Kamph
18 NEW Voice2img prototype! This AI assistant is using Stable diffusion!
NEW Voice2img prototype! This AI assistant is using Stable diffusion!
Sebastian Kamph
19 Prompts and FREE ONLINE stable diffusion. OpenArt AI tutorial
Prompts and FREE ONLINE stable diffusion. OpenArt AI tutorial
Sebastian Kamph
20 Stable diffusion Halloween concept art tutorial.
Stable diffusion Halloween concept art tutorial.
Sebastian Kamph
21 Stable diffusion GTA 6 style image tutorial. Quick and EASY!
Stable diffusion GTA 6 style image tutorial. Quick and EASY!
Sebastian Kamph
22 Stable diffusion prompt tutorial. NEW PROMPT BOOK released!
Stable diffusion prompt tutorial. NEW PROMPT BOOK released!
Sebastian Kamph
23 Stable diffusion GTA 6 style image tutorial. Quick and EASY!
Stable diffusion GTA 6 style image tutorial. Quick and EASY!
Sebastian Kamph
24 How to install Deforum locally. Stable diffusion animation.
How to install Deforum locally. Stable diffusion animation.
Sebastian Kamph
25 Dreambooth in Automatic1111. Cpu only & gpu option.
Dreambooth in Automatic1111. Cpu only & gpu option.
Sebastian Kamph
26 Nvidia's NEW text to image AI eDiff-I. Will it dethrone Stable diffusion?
Nvidia's NEW text to image AI eDiff-I. Will it dethrone Stable diffusion?
Sebastian Kamph
27 NEW VR in Stable diffusion? The future is now!
NEW VR in Stable diffusion? The future is now!
Sebastian Kamph
28 Motion capture workflow implementation with Stable diffusion
Motion capture workflow implementation with Stable diffusion
Sebastian Kamph
29 Don't make these 7 mistakes in Stable diffusion.
Don't make these 7 mistakes in Stable diffusion.
Sebastian Kamph
30 Stable diffusion up to 50% faster? I'll show you.
Stable diffusion up to 50% faster? I'll show you.
Sebastian Kamph
31 Stable diffusion 2.0 Released
Stable diffusion 2.0 Released
Sebastian Kamph
32 Top 5 Stable diffusion tips for newcomers.
Top 5 Stable diffusion tips for newcomers.
Sebastian Kamph
33 3 AMAZING Stable diffusion models that will change your life!
3 AMAZING Stable diffusion models that will change your life!
Sebastian Kamph
34 Best NEW AI tool? InvokeAI tutorial for Stable diffusion.
Best NEW AI tool? InvokeAI tutorial for Stable diffusion.
Sebastian Kamph
35 Monetize your AI art on Creative Fabrica with CF Spark.
Monetize your AI art on Creative Fabrica with CF Spark.
Sebastian Kamph
36 NEW Stable diffusion 2.1 RELEASED!
NEW Stable diffusion 2.1 RELEASED!
Sebastian Kamph
37 Stable diffusion 2.1 is GREAT. At this one thing. 2.1 install tutorial.
Stable diffusion 2.1 is GREAT. At this one thing. 2.1 install tutorial.
Sebastian Kamph
38 Your face in AI images? The EASY way.
Your face in AI images? The EASY way.
Sebastian Kamph
39 3 FANTASTIC Stable diffusion models you don't know about!
3 FANTASTIC Stable diffusion models you don't know about!
Sebastian Kamph
40 Unstable diffusion JUST GOT BANNED! 😲
Unstable diffusion JUST GOT BANNED! 😲
Sebastian Kamph
41 The end of AI Art? Lawsuit against Stable diffusion
The end of AI Art? Lawsuit against Stable diffusion
Sebastian Kamph
42 Stable diffusion TIER LIST. Best GUI ranked.
Stable diffusion TIER LIST. Best GUI ranked.
Sebastian Kamph
43 Google's ChatGPT rival Bard. Is it better?
Google's ChatGPT rival Bard. Is it better?
Sebastian Kamph
44 7 Secrets in ChatGPT (Don't tell your boss!)
7 Secrets in ChatGPT (Don't tell your boss!)
Sebastian Kamph
45 How to ChatGPT? Chat GPT explained!
How to ChatGPT? Chat GPT explained!
Sebastian Kamph
46 How to ChatGPT in 20 seconds!
How to ChatGPT in 20 seconds!
Sebastian Kamph
47 Midjourney 4C Features
Midjourney 4C Features
Sebastian Kamph
48 NEW ControlNet for Stable diffusion RELEASED! THIS IS MIND BLOWING!
NEW ControlNet for Stable diffusion RELEASED! THIS IS MIND BLOWING!
Sebastian Kamph
49 Revealing my Workflow to Perfect AI Images.
Revealing my Workflow to Perfect AI Images.
Sebastian Kamph
50 LIVE Pose in Stable Diffusion's ControlNet.
LIVE Pose in Stable Diffusion's ControlNet.
Sebastian Kamph
51 Control Light in AI Images
Control Light in AI Images
Sebastian Kamph
52 Multi-ControlNet tutorial.
Multi-ControlNet tutorial.
Sebastian Kamph
53 Control Text in AI Images
Control Text in AI Images
Sebastian Kamph
54 Full AI Art Workflow. ControlNet & Stable diffusion.
Full AI Art Workflow. ControlNet & Stable diffusion.
Sebastian Kamph
55 ControlNet Guidance tutorial. Fixing hands?
ControlNet Guidance tutorial. Fixing hands?
Sebastian Kamph
56 Illuminati Model with Noise Offset & Weekly AI Art Challenge
Illuminati Model with Noise Offset & Weekly AI Art Challenge
Sebastian Kamph
57 Paint&Text2Image - MultiDiffusion Region Control.
Paint&Text2Image - MultiDiffusion Region Control.
Sebastian Kamph
58 Style2Image in ControlNet (T2I)
Style2Image in ControlNet (T2I)
Sebastian Kamph
59 Gen-1 AI Animation is WILD
Gen-1 AI Animation is WILD
Sebastian Kamph
60 Famous Scenes Remade by ControlNet AI
Famous Scenes Remade by ControlNet AI
Sebastian Kamph

This video teaches how to use 9 advanced ComfyUI nodes for image AI tasks, including image generation, video interpolation, and workflow optimization. By following the steps outlined in the video, viewers can learn how to use these nodes to improve their image AI workflows. The video also provides tips on how to optimize workflows using the conditioning zero out node.

Key Takeaways
  1. Connect detail demon sampler to sampler
  2. Set detail amount to 0.8
  3. Run RIFE pass for smoother motion
  4. Load image and encode into latent space
  5. Send image reference into prompt through reference latent
  6. Enable return with leftover noise
  7. Disable return with leftover noise for final sample
  8. Crop into a mask and surrounding areas
  9. Select size and extend outside of mask
  10. Send image and mask into Paint crop
💡 The conditioning zero out node can be used to simplify workflows and reduce prompt boxes, making it a useful tool for optimizing image AI workflows.

Related Reads

📰
I Couldn't Find a Good Image Metadata Tool, So I Built One
Learn how to build a custom image metadata tool to solve real-world problems and improve workflow efficiency
Dev.to · Robin Hood
📰
Building a Browser-Based Image Resizer with Step-Down Scaling and Crop
Learn to build a browser-based image resizer with step-down scaling and crop using interactive tools and social media presets
Dev.to · Arhan Ahmad
📰
Comment créer des images professionnelles sans Photoshop avec l'IA
Create professional images without Photoshop using AI with Photopea and an AI agent
Dev.to · Mohamed Amine Ben Mallessa
📰
Single-image diffusion models now train-free and neural network-free
Train-free single-image diffusion models generate high-quality images without neural networks or training
Dev.to AI
Up next
I Let Google Omni AI Edit My Videos
Creator Magic
Watch →