Everything Matters - Aurora (Stable Diffusion Animation)

Prompt Engineer · Intermediate ·🎨 Image & Video AI ·3y ago

Key Takeaways

The video demonstrates the use of Stable Diffusion and Deforum Diffusion to generate images from song lyrics and create an animated music video, with upscaling done using Waifu2x.

Original Description

Leave a suggestion in the comments for my next song to animate! I’m releasing new videos every week, subscribe if you’d like to see more. Every lyric of the song was used to generate images, which were then animated. Attributions: I created all the visuals myself, but the audio is entirely attributed to Aurora. This would not have been possible without the amazing open-source project Stable Diffusion https://github.com/CompVis/stable-diffusion And another amazing open-source extension Deforum Diffusion https://github.com/HelixNGC7293/DeforumStableDiffusionLocal Upscaling was done with Waifu2x, specifically with this amazing GUI https://github.com/AaronFeng753/Waifu2x-Extension-GUI The font is by Jovanny Lemonad, called “Frenchpress” https://www.dafont.com/frenchpress.font #aurora #aiart #musicvideo
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Prompt Engineer · Prompt Engineer · 21 of 35

1 Lemon Tree - An AI's Dream
Lemon Tree - An AI's Dream
Prompt Engineer
2 The Emerald Sword - Unofficial music video made with Stable Diffusion AI
The Emerald Sword - Unofficial music video made with Stable Diffusion AI
Prompt Engineer
3 Brandy (You're a fine girl) - But every lyric is an AI generated image
Brandy (You're a fine girl) - But every lyric is an AI generated image
Prompt Engineer
4 Infinity - Jaymes Young (But every lyric is an AI animation) - 4K
Infinity - Jaymes Young (But every lyric is an AI animation) - 4K
Prompt Engineer
5 Come Fly With Me - But every lyric is an AI generated video
Come Fly With Me - But every lyric is an AI generated video
Prompt Engineer
6 Dancing in the Moonlight - Unofficial Music Video (AI Generated Animation)
Dancing in the Moonlight - Unofficial Music Video (AI Generated Animation)
Prompt Engineer
7 Ed Sheeran, Pokémon - Celestial [AI Animated Lyric Video]
Ed Sheeran, Pokémon - Celestial [AI Animated Lyric Video]
Prompt Engineer
8 Last Christmas - Unofficial Music Video (Stable Diffusion Animation)
Last Christmas - Unofficial Music Video (Stable Diffusion Animation)
Prompt Engineer
9 Without Me (Eminem) - Unofficial Animated Music Video
Without Me (Eminem) - Unofficial Animated Music Video
Prompt Engineer
10 INSANE - Unofficial Music video (Stable Diffusion Animation)
INSANE - Unofficial Music video (Stable Diffusion Animation)
Prompt Engineer
11 Wellerman (Sea Shanty) - Unofficial Animated Music Video
Wellerman (Sea Shanty) - Unofficial Animated Music Video
Prompt Engineer
12 The Evolution of Art
The Evolution of Art
Prompt Engineer
13 Believer (Imagine Dragons) - Unofficial Animated Music Video
Believer (Imagine Dragons) - Unofficial Animated Music Video
Prompt Engineer
14 Overwhelmed - Unofficial Animated Music Video
Overwhelmed - Unofficial Animated Music Video
Prompt Engineer
15 The Ultimate Showdown of Ultimate Destiny - AI Animation from Lyrics
The Ultimate Showdown of Ultimate Destiny - AI Animation from Lyrics
Prompt Engineer
16 Blur (Stellar) - AI Animation From Song Lyrics
Blur (Stellar) - AI Animation From Song Lyrics
Prompt Engineer
17 Darude - Sandstorm 10 Hour Seamless Loop (Stable Diffusion Animation)
Darude - Sandstorm 10 Hour Seamless Loop (Stable Diffusion Animation)
Prompt Engineer
18 Hell's Comin' With Me - Poor Man's Poison (Stable Diffusion Animation)
Hell's Comin' With Me - Poor Man's Poison (Stable Diffusion Animation)
Prompt Engineer
19 Let it Snow! (Dean Martin) - Stable Diffusion Animation
Let it Snow! (Dean Martin) - Stable Diffusion Animation
Prompt Engineer
20 Miracle - Caravan Palace (Stable Diffusion Animation)
Miracle - Caravan Palace (Stable Diffusion Animation)
Prompt Engineer
Everything Matters - Aurora (Stable Diffusion Animation)
Everything Matters - Aurora (Stable Diffusion Animation)
Prompt Engineer
22 Heat Waves -  AI Music Animation (Vaporwave Aesthetic)
Heat Waves - AI Music Animation (Vaporwave Aesthetic)
Prompt Engineer
23 All Star - Smashmouth (Stable Diffusion Animation)
All Star - Smashmouth (Stable Diffusion Animation)
Prompt Engineer
24 Ghost Division - Sabaton (AI Music Video Animation)
Ghost Division - Sabaton (AI Music Video Animation)
Prompt Engineer
25 Sunflowers - Pogo - Unofficial Music Video
Sunflowers - Pogo - Unofficial Music Video
Prompt Engineer
26 The Race For Space - Public Service Broadcasting (AI Music Video)
The Race For Space - Public Service Broadcasting (AI Music Video)
Prompt Engineer
27 Flowers - Miley Cyrus (Animated Music Video)
Flowers - Miley Cyrus (Animated Music Video)
Prompt Engineer
28 Crazy - Gnarls Barkley (AI Animation)
Crazy - Gnarls Barkley (AI Animation)
Prompt Engineer
29 Castle On The Hill (Ed Sheeran) - AI Animation from Lyrics
Castle On The Hill (Ed Sheeran) - AI Animation from Lyrics
Prompt Engineer
30 How Far I'll Go (From Moana) - AI Animated Music Video
How Far I'll Go (From Moana) - AI Animated Music Video
Prompt Engineer
31 Counting Stars (OneRepublic) - Animated Music Video
Counting Stars (OneRepublic) - Animated Music Video
Prompt Engineer
32 Viva La Vida (Coldplay) - AI Music Video
Viva La Vida (Coldplay) - AI Music Video
Prompt Engineer
33 Green Day - Boulevard of Broken Dreams [Animated]
Green Day - Boulevard of Broken Dreams [Animated]
Prompt Engineer
34 Baby I'm Yours [AI Animated]
Baby I'm Yours [AI Animated]
Prompt Engineer
35 Come Alive Diana (Everything Everything) - AI Music Video
Come Alive Diana (Everything Everything) - AI Music Video
Prompt Engineer

This video showcases the creative potential of AI in music video production, using Stable Diffusion and Deforum Diffusion to generate images from song lyrics and create an animated video.

Key Takeaways
  1. Use Stable Diffusion to generate images from song lyrics
  2. Apply Deforum Diffusion to animate the generated images
  3. Upscale the animated video using Waifu2x
  4. Choose a font and design style for the video
💡 The combination of Stable Diffusion and Deforum Diffusion can be used to create complex and visually striking animated music videos from song lyrics.

Related Reads

📰
How I Built FoodVision Big: Teaching a Model to Tell 101 Dishes Apart
Learn how to build a model that can identify 101 different dishes from food photos
Medium · Machine Learning
📰
I Built a 100% Free Image Compressor & Resizer That Never Saves Your Files to Disk
Learn how to build a free image compressor and resizer that never saves files to disk, and why it matters for secure and efficient image processing
Dev.to · Mudasir ahmed
📰
The Future of AI Image Processing Tools
Learn how AI image processing tools are revolutionizing image editing and manipulation
Dev.to · mohamed khi
📰
Routing Between Video Models Without Leaking the Abstraction
Learn to route between video models without leaking abstraction, enabling flexible and scalable video generation pipelines
Dev.to · leojxu
Up next
STOP using Midjourney, use this NEW AI instead, AI like Midjourney, FREE TEXT to ART Generator
SuccessPursuitZone
Watch →