Creating a morphing animation with Stable Diffusion, using any video you like

Render Realm · Beginner ·🎨 Image & Video AI ·3y ago
This quick tutorial describes how to create a morphing animation out of an existing video, using StableDiffusion Automatic1111, Deforum Video-input and ControlNet. Deforum doesn't feature prompt interpolation from a video input out of the box, but with a little bit of math it can be easily achieved. If you have any questions, don't hesitate asking! I will also use this method for a new music-video, which will be published on Friday, March 31 2023, so also visit our music-channel on Youtube: https://www.youtube.com/@-vero- Chapters: 00:00 Introduction 00:35 Downloading a free video from Pixabay, that we will use as a basis 01:10 Short overview of the Standard functions in Automatic1111 for video creation 02:03 Explaining the Deforum Interpolation and Video-input mode 03:22 Developing an interpolation method for Deforum Video-input 06:23 Adjusting the Deforum settings and rendering the video 07:56 Final Steps Some useful links: Local installation guide for Automatic1111 on a Windows-PC: https://stable-diffusion-art.com/install-windows/ and on a Mac with Apple Silicon: https://stable-diffusion-art.com/install-mac/ Deforum Extension - download and infos: https://github.com/deforum-art/deforum-for-automatic1111-webui Controlnet Extension - download and infos: https://github.com/Mikubill/sd-webui-controlnet Link to Pixabay for free high quality images: https://pixabay.com/ ffmpeg, a powerful open source command-line tool for manipulating images and videos: https://ffmpeg.org/download.html docs: https://ffmpeg.org/ffmpeg.html Some great Youtube channels, covering Stable Diffusion: https://www.youtube.com/@OlivioSarikas https://www.youtube.com/@NerdyRodent https://www.youtube.com/@sebastiankamph https://www.youtube.com/@promptmuse #stablediffusion #automatic1111 #deforum #tutorial #ffmpeg
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related AI Lessons

What makes an AI image workflow useful for real commercial output?
Learn how to create a useful AI image workflow for commercial output, focusing on repeatability, versatility, and clarity
Dev.to AI
How to Write Better AI Image Prompts for Midjourney (With Examples That Actually Work)
Learn to write effective AI image prompts for Midjourney with actionable examples and techniques
Medium · ChatGPT
Image to Video AI: The Complete Workflow Playbook That Actually Produces Results
Learn a step-by-step workflow for image-to-video AI that produces results, from preparation to delivery
Medium · AI
Image Harvest v1.0.2: Internationalization, Free Pro Trial & Quality-of-Life Improvements
Learn about Image Harvest v1.0.2, a Chrome extension with internationalization, free pro trial, and quality-of-life improvements, and how to utilize it for privacy-first image extraction
Dev.to · kyriewen

Chapters (7)

Introduction
0:35 Downloading a free video from Pixabay, that we will use as a basis
1:10 Short overview of the Standard functions in Automatic1111 for video creation
2:03 Explaining the Deforum Interpolation and Video-input mode
3:22 Developing an interpolation method for Deforum Video-input
6:23 Adjusting the Deforum settings and rendering the video
7:56 Final Steps
Up next
Krea 2 makes Diffusion FUN Again!
MattVidPro
Watch →