Turn MoCaps into 3D-Controlnets into ComfyUI Images/Videos
This tutorial explains how to grab Motion-Captures from your Webcam or any video file, using the free BlendARMocap add-on for Blender by cgtinker with Google Mediapipe, and turn them into 3D-animated Controlnets, using the OpenPoseBone tool by toyxyz. No further equipment needed.
In the second part of the tutorial, we will go through the process of creating images and animations with these Controlnets, using the FaceID Plus-V2 IP-adapter for consistent faces, the Openpose Controlnet nodes, AnimateDiff and some some other nodes to enhance and stabilize the images and animations. You can downlo…
Watch on YouTube ↗
(saves to browser)
Chapters (11)
Intro
0:50
OpenPose Tool
2:24
Install BlendAR Mocap add-on
4:13
Creating Motion Captures with your Webcam or from a Video
6:44
Create a Rigify Rig and transfer the Motion Capture to the rig
8:57
Map the animated rig to the Controlnet meshes
10:26
Adjust the Camera settings and render the Controlnets
12:03
Loading the ComfyUI workflows, dealing with workflow issues
13:33
Image Workflow explained
14:31
Animation Workflow explained
15:55
Outro
DeepCamp AI