Creating a morphing animation with Stable Diffusion, using any video you like

Render Realm · Beginner ·🎨 Image & Video AI ·3y ago

Key Takeaways

Creates a morphing animation from a video using Stable Diffusion and Deforum

Original Description

This quick tutorial describes how to create a morphing animation out of an existing video, using StableDiffusion Automatic1111, Deforum Video-input and ControlNet. Deforum doesn't feature prompt interpolation from a video input out of the box, but with a little bit of math it can be easily achieved. If you have any questions, don't hesitate asking! I will also use this method for a new music-video, which will be published on Friday, March 31 2023, so also visit our music-channel on Youtube: https://www.youtube.com/@-vero- Chapters: 00:00 Introduction 00:35 Downloading a free video from Pixabay, that we will use as a basis 01:10 Short overview of the Standard functions in Automatic1111 for video creation 02:03 Explaining the Deforum Interpolation and Video-input mode 03:22 Developing an interpolation method for Deforum Video-input 06:23 Adjusting the Deforum settings and rendering the video 07:56 Final Steps Some useful links: Local installation guide for Automatic1111 on a Windows-PC: https://stable-diffusion-art.com/install-windows/ and on a Mac with Apple Silicon: https://stable-diffusion-art.com/install-mac/ Deforum Extension - download and infos: https://github.com/deforum-art/deforum-for-automatic1111-webui Controlnet Extension - download and infos: https://github.com/Mikubill/sd-webui-controlnet Link to Pixabay for free high quality images: https://pixabay.com/ ffmpeg, a powerful open source command-line tool for manipulating images and videos: https://ffmpeg.org/download.html docs: https://ffmpeg.org/ffmpeg.html Some great Youtube channels, covering Stable Diffusion: https://www.youtube.com/@OlivioSarikas https://www.youtube.com/@NerdyRodent https://www.youtube.com/@sebastiankamph https://www.youtube.com/@promptmuse #stablediffusion #automatic1111 #deforum #tutorial #ffmpeg
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related Reads

📰
Teaching Kiro to Paint: A Stateful Image-Editing Skill Built on Gemini's Interactions API and MCP
Build a stateful image-editing skill using Gemini's Interactions API and MCP to generate and edit images with Kiro
Dev.to AI
📰
I Tried to Replace My Image Workflow with an AI Photo Generator. Three Times It Failed. Once It Didn't.
Learn from an experiment replacing an image workflow with an AI photo generator, and discover the challenges and one success story
Dev.to AI
📰
The Best Free AI Image Generators Better Than ChatGPT and Gemini
Discover free AI image generators that outperform ChatGPT and Gemini for specific workflows, offering superior photorealism and graphic design capabilities
Dev.to AI
📰
50+ Sequential Images, One Prompt in Codex
Learn to generate sequential images with Codex using a single prompt and understand the limitations of this approach
Medium · ChatGPT

Chapters (7)

Introduction
0:35 Downloading a free video from Pixabay, that we will use as a basis
1:10 Short overview of the Standard functions in Automatic1111 for video creation
2:03 Explaining the Deforum Interpolation and Video-input mode
3:22 Developing an interpolation method for Deforum Video-input
6:23 Adjusting the Deforum settings and rendering the video
7:56 Final Steps
Up next
Logo Animations with AI 🤩 your Brand / Shop Promotions with AI 🚀 AI Videos Free #ai #aivideo
Raj Photo Editing and Much More
Watch →