Creating an uber-realistic video animation from an avatar with Stable Diffusion

Render Realm · Beginner ·🎨 Image & Video AI ·3y ago
This tutorial will guide you through the process of creating an avatar with ReadyPlayerMe, animating it in Mixamo, building a 3d scene around it in Blender and feeding this scene into StableDiffusion Automatic1111 to create a video animation, using an uber-realistic custom model with the Deforum and ControlNet extensions. To watch some more great music videos created with StableDiffusion, Unreal Engine and Blender, visit our YouTube music channel: https://www.youtube.com/@-vero- ---------------------------- Chapters: 00:00 Intro 00:20 Creating an avatar with ReadyPlayerMe 01:45 Preparing the avatar for uploading it to Mixamo 03:00 Animating the avatar in Mixamo and importing it into Blender 05:41 Importing a 3d background scene from Sketchfab into blender and render the scene 10:19 Preparing Automatic1111 for a hyper-realistic render 12:13 Using the Deforum and ControlNet extension for rendering the animation 14:47 Creating the final video Link to the ReadyPlayerMe website for creating free 3d avatars: https://readyplayer.me/ Link to the Mixamo website: https://www.mixamo.com/ Link to Sketchfab for downloading free 3d models: https://sketchfab.com/feed Downloading custom models for Stable Diffusion: https://civitai.com/ Deforum Extension - download and infos: https://github.com/deforum-art/deforum-for-automatic1111-webui Controlnet Extension - download and infos: https://github.com/Mikubill/sd-webui-controlnet Downloading models for the Controlnet extension: https://huggingface.co/lllyasviel/ControlNet/tree/main/models Download Blender: https://www.blender.org/download/ ----------------------------------------- Local installation guide for Automatic1111 on a Windows-PC: https://stable-diffusion-art.com/install-windows/ and on a Mac with Apple Silicon: https://stable-diffusion-art.com/install-mac/ Some great Youtube channels, covering Stable Diffusion: https://www.youtube.com/@OlivioSarikas https://www.youtube.com/@NerdyRodent https://www.youtube.com/
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related AI Lessons

What makes an AI image workflow useful for real commercial output?
Learn how to create a useful AI image workflow for commercial output, focusing on repeatability, versatility, and clarity
Dev.to AI
How to Write Better AI Image Prompts for Midjourney (With Examples That Actually Work)
Learn to write effective AI image prompts for Midjourney with actionable examples and techniques
Medium · ChatGPT
Image to Video AI: The Complete Workflow Playbook That Actually Produces Results
Learn a step-by-step workflow for image-to-video AI that produces results, from preparation to delivery
Medium · AI
Image Harvest v1.0.2: Internationalization, Free Pro Trial & Quality-of-Life Improvements
Learn about Image Harvest v1.0.2, a Chrome extension with internationalization, free pro trial, and quality-of-life improvements, and how to utilize it for privacy-first image extraction
Dev.to · kyriewen

Chapters (8)

Intro
0:20 Creating an avatar with ReadyPlayerMe
1:45 Preparing the avatar for uploading it to Mixamo
3:00 Animating the avatar in Mixamo and importing it into Blender
5:41 Importing a 3d background scene from Sketchfab into blender and render the scene
10:19 Preparing Automatic1111 for a hyper-realistic render
12:13 Using the Deforum and ControlNet extension for rendering the animation
14:47 Creating the final video
Up next
Krea 2 makes Diffusion FUN Again!
MattVidPro
Watch →