Creating a morphing animation with Stable Diffusion, using any video you like
Skills:
Image Generation Basics90%
Key Takeaways
Creates a morphing animation from a video using Stable Diffusion and Deforum
Original Description
This quick tutorial describes how to create a morphing animation out of an existing video, using StableDiffusion Automatic1111, Deforum Video-input and ControlNet. Deforum doesn't feature prompt interpolation from a video input out of the box, but with a little bit of math it can be easily achieved. If you have any questions, don't hesitate asking!
I will also use this method for a new music-video, which will be published on Friday, March 31 2023, so also visit our music-channel on Youtube:
https://www.youtube.com/@-vero-
Chapters:
00:00 Introduction
00:35 Downloading a free video from Pixabay, that we will use as a basis
01:10 Short overview of the Standard functions in Automatic1111 for video creation
02:03 Explaining the Deforum Interpolation and Video-input mode
03:22 Developing an interpolation method for Deforum Video-input
06:23 Adjusting the Deforum settings and rendering the video
07:56 Final Steps
Some useful links:
Local installation guide for Automatic1111 on a Windows-PC:
https://stable-diffusion-art.com/install-windows/
and on a Mac with Apple Silicon:
https://stable-diffusion-art.com/install-mac/
Deforum Extension - download and infos:
https://github.com/deforum-art/deforum-for-automatic1111-webui
Controlnet Extension - download and infos:
https://github.com/Mikubill/sd-webui-controlnet
Link to Pixabay for free high quality images:
https://pixabay.com/
ffmpeg, a powerful open source command-line tool for manipulating images and videos:
https://ffmpeg.org/download.html
docs: https://ffmpeg.org/ffmpeg.html
Some great Youtube channels, covering Stable Diffusion:
https://www.youtube.com/@OlivioSarikas
https://www.youtube.com/@NerdyRodent
https://www.youtube.com/@sebastiankamph
https://www.youtube.com/@promptmuse
#stablediffusion #automatic1111 #deforum #tutorial #ffmpeg
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
More on: Image Generation Basics
View skill →Related Reads
📰
📰
📰
📰
Teaching Kiro to Paint: A Stateful Image-Editing Skill Built on Gemini's Interactions API and MCP
Dev.to AI
I Tried to Replace My Image Workflow with an AI Photo Generator. Three Times It Failed. Once It Didn't.
Dev.to AI
The Best Free AI Image Generators Better Than ChatGPT and Gemini
Dev.to AI
50+ Sequential Images, One Prompt in Codex
Medium · ChatGPT
Chapters (7)
Introduction
0:35
Downloading a free video from Pixabay, that we will use as a basis
1:10
Short overview of the Standard functions in Automatic1111 for video creation
2:03
Explaining the Deforum Interpolation and Video-input mode
3:22
Developing an interpolation method for Deforum Video-input
6:23
Adjusting the Deforum settings and rendering the video
7:56
Final Steps
🎓
Tutor Explanation
DeepCamp AI