Creating a morphing animation with Stable Diffusion, using any video you like
Skills:
Image Generation Basics90%
This quick tutorial describes how to create a morphing animation out of an existing video, using StableDiffusion Automatic1111, Deforum Video-input and ControlNet. Deforum doesn't feature prompt interpolation from a video input out of the box, but with a little bit of math it can be easily achieved. If you have any questions, don't hesitate asking!
I will also use this method for a new music-video, which will be published on Friday, March 31 2023, so also visit our music-channel on Youtube:
https://www.youtube.com/@-vero-
Chapters:
00:00 Introduction
00:35 Downloading a free video from Pixabay, that we will use as a basis
01:10 Short overview of the Standard functions in Automatic1111 for video creation
02:03 Explaining the Deforum Interpolation and Video-input mode
03:22 Developing an interpolation method for Deforum Video-input
06:23 Adjusting the Deforum settings and rendering the video
07:56 Final Steps
Some useful links:
Local installation guide for Automatic1111 on a Windows-PC:
https://stable-diffusion-art.com/install-windows/
and on a Mac with Apple Silicon:
https://stable-diffusion-art.com/install-mac/
Deforum Extension - download and infos:
https://github.com/deforum-art/deforum-for-automatic1111-webui
Controlnet Extension - download and infos:
https://github.com/Mikubill/sd-webui-controlnet
Link to Pixabay for free high quality images:
https://pixabay.com/
ffmpeg, a powerful open source command-line tool for manipulating images and videos:
https://ffmpeg.org/download.html
docs: https://ffmpeg.org/ffmpeg.html
Some great Youtube channels, covering Stable Diffusion:
https://www.youtube.com/@OlivioSarikas
https://www.youtube.com/@NerdyRodent
https://www.youtube.com/@sebastiankamph
https://www.youtube.com/@promptmuse
#stablediffusion #automatic1111 #deforum #tutorial #ffmpeg
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
More on: Image Generation Basics
View skill →Related AI Lessons
⚡
⚡
⚡
⚡
What makes an AI image workflow useful for real commercial output?
Dev.to AI
How to Write Better AI Image Prompts for Midjourney (With Examples That Actually Work)
Medium · ChatGPT
Image to Video AI: The Complete Workflow Playbook That Actually Produces Results
Medium · AI
Image Harvest v1.0.2: Internationalization, Free Pro Trial & Quality-of-Life Improvements
Dev.to · kyriewen
Chapters (7)
Introduction
0:35
Downloading a free video from Pixabay, that we will use as a basis
1:10
Short overview of the Standard functions in Automatic1111 for video creation
2:03
Explaining the Deforum Interpolation and Video-input mode
3:22
Developing an interpolation method for Deforum Video-input
6:23
Adjusting the Deforum settings and rendering the video
7:56
Final Steps
🎓
Tutor Explanation
DeepCamp AI