Creating an uber-realistic video animation from an avatar with Stable Diffusion
This tutorial will guide you through the process of creating an avatar with ReadyPlayerMe, animating it in Mixamo, building a 3d scene around it in Blender and feeding this scene into StableDiffusion Automatic1111 to create a video animation, using an uber-realistic custom model with the Deforum and ControlNet extensions.
To watch some more great music videos created with StableDiffusion, Unreal Engine and Blender, visit our YouTube music channel:
https://www.youtube.com/@-vero-
----------------------------
Chapters:
00:00 Intro
00:20 Creating an avatar with ReadyPlayerMe
01:45 Preparing the avatar for uploading it to Mixamo
03:00 Animating the avatar in Mixamo and importing it into Blender
05:41 Importing a 3d background scene from Sketchfab into blender and render the scene
10:19 Preparing Automatic1111 for a hyper-realistic render
12:13 Using the Deforum and ControlNet extension for rendering the animation
14:47 Creating the final video
Link to the ReadyPlayerMe website for creating free 3d avatars:
https://readyplayer.me/
Link to the Mixamo website:
https://www.mixamo.com/
Link to Sketchfab for downloading free 3d models:
https://sketchfab.com/feed
Downloading custom models for Stable Diffusion:
https://civitai.com/
Deforum Extension - download and infos:
https://github.com/deforum-art/deforum-for-automatic1111-webui
Controlnet Extension - download and infos:
https://github.com/Mikubill/sd-webui-controlnet
Downloading models for the Controlnet extension:
https://huggingface.co/lllyasviel/ControlNet/tree/main/models
Download Blender:
https://www.blender.org/download/
-----------------------------------------
Local installation guide for Automatic1111 on a Windows-PC:
https://stable-diffusion-art.com/install-windows/
and on a Mac with Apple Silicon:
https://stable-diffusion-art.com/install-mac/
Some great Youtube channels, covering Stable Diffusion:
https://www.youtube.com/@OlivioSarikas
https://www.youtube.com/@NerdyRodent
https://www.youtube.com/
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
More on: AI Video Generation
View skill →Related AI Lessons
⚡
⚡
⚡
⚡
What makes an AI image workflow useful for real commercial output?
Dev.to AI
How to Write Better AI Image Prompts for Midjourney (With Examples That Actually Work)
Medium · ChatGPT
Image to Video AI: The Complete Workflow Playbook That Actually Produces Results
Medium · AI
Image Harvest v1.0.2: Internationalization, Free Pro Trial & Quality-of-Life Improvements
Dev.to · kyriewen
Chapters (8)
Intro
0:20
Creating an avatar with ReadyPlayerMe
1:45
Preparing the avatar for uploading it to Mixamo
3:00
Animating the avatar in Mixamo and importing it into Blender
5:41
Importing a 3d background scene from Sketchfab into blender and render the scene
10:19
Preparing Automatic1111 for a hyper-realistic render
12:13
Using the Deforum and ControlNet extension for rendering the animation
14:47
Creating the final video
🎓
Tutor Explanation
DeepCamp AI