Lemon Tree - An AI's Dream

Prompt Engineer · Intermediate ·🎨 Image & Video AI ·3y ago

Key Takeaways

The video showcases a music visualisation created using Stable Diffusion, an open-source project, with audio from the song 'Lemon Tree' by Fools Garden.

Full Transcript

[Music] i'm sitting here in the boring room it's just another rainy sunday afternoon i'm wasting my time i got nothing to do i'm hanging around i'm waiting for you but nothing ever happens and i wonder [Music] i'm driving around in my car i'm driving too fast i'm driving too far i'd like to change my point of view i feel so lonely i'm waiting for you but nothing ever happens and i wonder [Music] i wonder how i wonder why yesterday you told me about the blue blue sky and all that i can see it's just a yellow lemon tree i'm turning my head i bend down turn it down is [Music] taking a shot but there's a heavy cloud inside my head i feel so tired put myself into bed while nothing ever happened isolation is not good for me isolation i don't want to sit on the level trees stepping around in the desert of joy maybe anyhow i'll get another toy and everything will happen and you wonder [Music] i wonder how i wonder why yesterday you told me about the blue blue sky and all that i can see is just another lemon tree i'm turning my is [Music] it's just a yellow lemon tree

Original Description

This is the first test of a new method for creating music visualisations. Attributions: I created the visuals but the audio is entirely attributed to "Fools Garden", a well known German band. This would not have been possible without the amazing open-source project Stable Diffusion https://github.com/CompVis/stable-diffusion With the amazing open-source extension Stable Diffusion Web UI https://github.com/sd-webui/stable-diffusion-webui Flowframes was used to get a smoother transition between frames https://nmkd.itch.io/flowframes
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Prompt Engineer · Prompt Engineer · 1 of 35

← Previous Next →
Lemon Tree - An AI's Dream
Lemon Tree - An AI's Dream
Prompt Engineer
2 The Emerald Sword - Unofficial music video made with Stable Diffusion AI
The Emerald Sword - Unofficial music video made with Stable Diffusion AI
Prompt Engineer
3 Brandy (You're a fine girl) - But every lyric is an AI generated image
Brandy (You're a fine girl) - But every lyric is an AI generated image
Prompt Engineer
4 Infinity - Jaymes Young (But every lyric is an AI animation) - 4K
Infinity - Jaymes Young (But every lyric is an AI animation) - 4K
Prompt Engineer
5 Come Fly With Me - But every lyric is an AI generated video
Come Fly With Me - But every lyric is an AI generated video
Prompt Engineer
6 Dancing in the Moonlight - Unofficial Music Video (AI Generated Animation)
Dancing in the Moonlight - Unofficial Music Video (AI Generated Animation)
Prompt Engineer
7 Ed Sheeran, Pokémon - Celestial [AI Animated Lyric Video]
Ed Sheeran, Pokémon - Celestial [AI Animated Lyric Video]
Prompt Engineer
8 Last Christmas - Unofficial Music Video (Stable Diffusion Animation)
Last Christmas - Unofficial Music Video (Stable Diffusion Animation)
Prompt Engineer
9 Without Me (Eminem) - Unofficial Animated Music Video
Without Me (Eminem) - Unofficial Animated Music Video
Prompt Engineer
10 INSANE - Unofficial Music video (Stable Diffusion Animation)
INSANE - Unofficial Music video (Stable Diffusion Animation)
Prompt Engineer
11 Wellerman (Sea Shanty) - Unofficial Animated Music Video
Wellerman (Sea Shanty) - Unofficial Animated Music Video
Prompt Engineer
12 The Evolution of Art
The Evolution of Art
Prompt Engineer
13 Believer (Imagine Dragons) - Unofficial Animated Music Video
Believer (Imagine Dragons) - Unofficial Animated Music Video
Prompt Engineer
14 Overwhelmed - Unofficial Animated Music Video
Overwhelmed - Unofficial Animated Music Video
Prompt Engineer
15 The Ultimate Showdown of Ultimate Destiny - AI Animation from Lyrics
The Ultimate Showdown of Ultimate Destiny - AI Animation from Lyrics
Prompt Engineer
16 Blur (Stellar) - AI Animation From Song Lyrics
Blur (Stellar) - AI Animation From Song Lyrics
Prompt Engineer
17 Darude - Sandstorm 10 Hour Seamless Loop (Stable Diffusion Animation)
Darude - Sandstorm 10 Hour Seamless Loop (Stable Diffusion Animation)
Prompt Engineer
18 Hell's Comin' With Me - Poor Man's Poison (Stable Diffusion Animation)
Hell's Comin' With Me - Poor Man's Poison (Stable Diffusion Animation)
Prompt Engineer
19 Let it Snow! (Dean Martin) - Stable Diffusion Animation
Let it Snow! (Dean Martin) - Stable Diffusion Animation
Prompt Engineer
20 Miracle - Caravan Palace (Stable Diffusion Animation)
Miracle - Caravan Palace (Stable Diffusion Animation)
Prompt Engineer
21 Everything Matters - Aurora (Stable Diffusion Animation)
Everything Matters - Aurora (Stable Diffusion Animation)
Prompt Engineer
22 Heat Waves -  AI Music Animation (Vaporwave Aesthetic)
Heat Waves - AI Music Animation (Vaporwave Aesthetic)
Prompt Engineer
23 All Star - Smashmouth (Stable Diffusion Animation)
All Star - Smashmouth (Stable Diffusion Animation)
Prompt Engineer
24 Ghost Division - Sabaton (AI Music Video Animation)
Ghost Division - Sabaton (AI Music Video Animation)
Prompt Engineer
25 Sunflowers - Pogo - Unofficial Music Video
Sunflowers - Pogo - Unofficial Music Video
Prompt Engineer
26 The Race For Space - Public Service Broadcasting (AI Music Video)
The Race For Space - Public Service Broadcasting (AI Music Video)
Prompt Engineer
27 Flowers - Miley Cyrus (Animated Music Video)
Flowers - Miley Cyrus (Animated Music Video)
Prompt Engineer
28 Crazy - Gnarls Barkley (AI Animation)
Crazy - Gnarls Barkley (AI Animation)
Prompt Engineer
29 Castle On The Hill (Ed Sheeran) - AI Animation from Lyrics
Castle On The Hill (Ed Sheeran) - AI Animation from Lyrics
Prompt Engineer
30 How Far I'll Go (From Moana) - AI Animated Music Video
How Far I'll Go (From Moana) - AI Animated Music Video
Prompt Engineer
31 Counting Stars (OneRepublic) - Animated Music Video
Counting Stars (OneRepublic) - Animated Music Video
Prompt Engineer
32 Viva La Vida (Coldplay) - AI Music Video
Viva La Vida (Coldplay) - AI Music Video
Prompt Engineer
33 Green Day - Boulevard of Broken Dreams [Animated]
Green Day - Boulevard of Broken Dreams [Animated]
Prompt Engineer
34 Baby I'm Yours [AI Animated]
Baby I'm Yours [AI Animated]
Prompt Engineer
35 Come Alive Diana (Everything Everything) - AI Music Video
Come Alive Diana (Everything Everything) - AI Music Video
Prompt Engineer

This video demonstrates how to create a music visualisation using Stable Diffusion, an open-source project, and showcases the potential of AI-generated content in the music industry. The video highlights the creative possibilities of combining audio with AI-generated visuals. By following this example, viewers can learn how to create their own music visualisations using Stable Diffusion.

Key Takeaways
  1. Choose a song for the music visualisation
  2. Select an open-source project like Stable Diffusion
  3. Experiment with different visualisation settings
  4. Integrate the audio with the AI-generated visuals
  5. Refine and edit the final visualisation
  6. Share the music visualisation on social media or other platforms
💡 The key to creating engaging music visualisations is to experiment with different settings and parameters in the open-source project, and to carefully integrate the audio with the AI-generated visuals.

Related Reads

📰
50+ Sequential Images, One Prompt in Codex
Learn to generate sequential images with Codex using a single prompt and understand the limitations of this approach
Medium · ChatGPT
📰
How can I batch-generate 3D assets from prompts or images using an API, and which 3D generation APIs support batch generation?
Learn to batch-generate 3D assets from prompts or images using APIs for efficient pipeline creation
Reddit r/artificial
📰
How AI Head Swap Works: The Technology Behind Realistic AI Image Replacement
Learn how AI head swap technology works and its applications in image editing
Dev.to AI
📰
How I Built an AI Pet Portrait Generator That Turns Photos Into Art
Learn how to build an AI pet portrait generator that turns photos into art using deep learning techniques and Python libraries
Dev.to · William Li
Up next
What is Diffusion Models Explained with Examples
VLR Software Training
Watch →