Infinity - Jaymes Young (But every lyric is an AI animation) - 4K

Prompt Engineer · Intermediate ·🎨 Image & Video AI ·3y ago

Key Takeaways

The video demonstrates the use of Deforum Stable Diffusion to create an AI animation for the song 'Infinity' by Jaymes Young, with each lyric generating a unique image.

Full Transcript

[Music] oh oh [Music] baby this love I'll Never Let It Die can't be touched by no one I like to see them try I've lost control I'm gonna make this last forever don't tell me it's impossible [Music] cause I love you for Infinity [Music] foreign [Music] [Applause] [Music] foreign [Music] [Music] foreign [Music] [Music] we are the gods now cause I love you for Infinity cause I love you for Infinity [Music] foreign [Music] foreign [Music] [Applause]

Original Description

I spent a bunch of time figuring out how to use Deforum Stable Diffusion to get a better animation effect. This was the first test video of my new process, I'm not super happy with the images that were generated as most of them don't match the lyrics very much. This was more of a test of a variety of different upscalers and frame rates, and figuring out how to get somewhat stable animations from Deforum. Attributions: I created all the visuals myself, but the audio is entirely attributed to Jaymes Young. This would not have been possible without the amazing open-source project Stable Diffusion https://github.com/CompVis/stable-dif... With the amazing open-source extension Stable Diffusion Web UI https://github.com/sd-webui/stable-di... And another amazing open-source extension Deforum Diffusion https://github.com/HelixNGC7293/DeforumStableDiffusionLocal Upscaling was done with Topaz VEAI (It's just so much faster than RealESRGAN and needs less tweaking) https://www.topazlabs.com/video-enhance-ai Flowframes was used to get a smoother transition between frames https://nmkd.itch.io/flowframes
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Prompt Engineer · Prompt Engineer · 4 of 35

1 Lemon Tree - An AI's Dream
Lemon Tree - An AI's Dream
Prompt Engineer
2 The Emerald Sword - Unofficial music video made with Stable Diffusion AI
The Emerald Sword - Unofficial music video made with Stable Diffusion AI
Prompt Engineer
3 Brandy (You're a fine girl) - But every lyric is an AI generated image
Brandy (You're a fine girl) - But every lyric is an AI generated image
Prompt Engineer
Infinity - Jaymes Young (But every lyric is an AI animation) - 4K
Infinity - Jaymes Young (But every lyric is an AI animation) - 4K
Prompt Engineer
5 Come Fly With Me - But every lyric is an AI generated video
Come Fly With Me - But every lyric is an AI generated video
Prompt Engineer
6 Dancing in the Moonlight - Unofficial Music Video (AI Generated Animation)
Dancing in the Moonlight - Unofficial Music Video (AI Generated Animation)
Prompt Engineer
7 Ed Sheeran, Pokémon - Celestial [AI Animated Lyric Video]
Ed Sheeran, Pokémon - Celestial [AI Animated Lyric Video]
Prompt Engineer
8 Last Christmas - Unofficial Music Video (Stable Diffusion Animation)
Last Christmas - Unofficial Music Video (Stable Diffusion Animation)
Prompt Engineer
9 Without Me (Eminem) - Unofficial Animated Music Video
Without Me (Eminem) - Unofficial Animated Music Video
Prompt Engineer
10 INSANE - Unofficial Music video (Stable Diffusion Animation)
INSANE - Unofficial Music video (Stable Diffusion Animation)
Prompt Engineer
11 Wellerman (Sea Shanty) - Unofficial Animated Music Video
Wellerman (Sea Shanty) - Unofficial Animated Music Video
Prompt Engineer
12 The Evolution of Art
The Evolution of Art
Prompt Engineer
13 Believer (Imagine Dragons) - Unofficial Animated Music Video
Believer (Imagine Dragons) - Unofficial Animated Music Video
Prompt Engineer
14 Overwhelmed - Unofficial Animated Music Video
Overwhelmed - Unofficial Animated Music Video
Prompt Engineer
15 The Ultimate Showdown of Ultimate Destiny - AI Animation from Lyrics
The Ultimate Showdown of Ultimate Destiny - AI Animation from Lyrics
Prompt Engineer
16 Blur (Stellar) - AI Animation From Song Lyrics
Blur (Stellar) - AI Animation From Song Lyrics
Prompt Engineer
17 Darude - Sandstorm 10 Hour Seamless Loop (Stable Diffusion Animation)
Darude - Sandstorm 10 Hour Seamless Loop (Stable Diffusion Animation)
Prompt Engineer
18 Hell's Comin' With Me - Poor Man's Poison (Stable Diffusion Animation)
Hell's Comin' With Me - Poor Man's Poison (Stable Diffusion Animation)
Prompt Engineer
19 Let it Snow! (Dean Martin) - Stable Diffusion Animation
Let it Snow! (Dean Martin) - Stable Diffusion Animation
Prompt Engineer
20 Miracle - Caravan Palace (Stable Diffusion Animation)
Miracle - Caravan Palace (Stable Diffusion Animation)
Prompt Engineer
21 Everything Matters - Aurora (Stable Diffusion Animation)
Everything Matters - Aurora (Stable Diffusion Animation)
Prompt Engineer
22 Heat Waves -  AI Music Animation (Vaporwave Aesthetic)
Heat Waves - AI Music Animation (Vaporwave Aesthetic)
Prompt Engineer
23 All Star - Smashmouth (Stable Diffusion Animation)
All Star - Smashmouth (Stable Diffusion Animation)
Prompt Engineer
24 Ghost Division - Sabaton (AI Music Video Animation)
Ghost Division - Sabaton (AI Music Video Animation)
Prompt Engineer
25 Sunflowers - Pogo - Unofficial Music Video
Sunflowers - Pogo - Unofficial Music Video
Prompt Engineer
26 The Race For Space - Public Service Broadcasting (AI Music Video)
The Race For Space - Public Service Broadcasting (AI Music Video)
Prompt Engineer
27 Flowers - Miley Cyrus (Animated Music Video)
Flowers - Miley Cyrus (Animated Music Video)
Prompt Engineer
28 Crazy - Gnarls Barkley (AI Animation)
Crazy - Gnarls Barkley (AI Animation)
Prompt Engineer
29 Castle On The Hill (Ed Sheeran) - AI Animation from Lyrics
Castle On The Hill (Ed Sheeran) - AI Animation from Lyrics
Prompt Engineer
30 How Far I'll Go (From Moana) - AI Animated Music Video
How Far I'll Go (From Moana) - AI Animated Music Video
Prompt Engineer
31 Counting Stars (OneRepublic) - Animated Music Video
Counting Stars (OneRepublic) - Animated Music Video
Prompt Engineer
32 Viva La Vida (Coldplay) - AI Music Video
Viva La Vida (Coldplay) - AI Music Video
Prompt Engineer
33 Green Day - Boulevard of Broken Dreams [Animated]
Green Day - Boulevard of Broken Dreams [Animated]
Prompt Engineer
34 Baby I'm Yours [AI Animated]
Baby I'm Yours [AI Animated]
Prompt Engineer
35 Come Alive Diana (Everything Everything) - AI Music Video
Come Alive Diana (Everything Everything) - AI Music Video
Prompt Engineer

This video showcases the use of Deforum Stable Diffusion to create an AI animation for a music video, with a focus on generating images based on song lyrics. The creator shares their process and results, highlighting the potential for improvement in image quality and animation effects.

Key Takeaways
  1. Choose a song with meaningful lyrics
  2. Set up Deforum Stable Diffusion for image generation
  3. Configure animation settings for a music video
  4. Test and refine the animation process
  5. Experiment with different image generation models
💡 Using AI to generate images based on lyrics can create a unique and engaging music video experience, but requires experimentation and refinement to achieve high-quality results.

Related Reads

📰
How I Built an AI Pet Portrait Generator That Turns Photos Into Art
Learn how to build an AI pet portrait generator that turns photos into art using deep learning techniques and Python libraries
Dev.to · William Li
📰
I Put Google’s Squoosh Codecs in the Browser — and Cut My Image Bill Before the Upload Even…
Learn how to use Google's Squoosh codecs in the browser to compress images before upload and reduce costs
Medium · Programming
📰
I Put Google’s Squoosh Codecs in the Browser — and Cut My Image Bill Before the Upload Even…
Learn how to use Google's Squoosh codecs in the browser to compress images before upload, reducing costs and improving performance
Medium · JavaScript
📰
Which AI tools can generate ready-to-use 3D character models for games, animation, or 3D printing?
Learn about AI tools that generate ready-to-use 3D character models for games, animation, or 3D printing and how to evaluate them for different use cases
Reddit r/artificial
Up next
Short.ai Review 2025: Turn Long Videos into Viral Shorts in One Click! 🔥
DroidCrunch
Watch →