Google AI Studio can make SICK Prototypes
Key Takeaways
The video demonstrates how to use Google AI Studio for UI/UX design and prototyping, leveraging its vibe coding prototyping tool and integrating with other tools like Nano Banana and Fast AI responses for image generation and editing, as well as Adobe Premiere for video editing.
Full Transcript
Google recently released a new vibe coding prototyping tool in AI Studio and it's really freaking good. Actually, check out this voicetovideo short story generator that I built with it. All right, here we go. Far beneath the black waves, something ancient stirred, its eyes glowing like twin lanterns in the endless dark. Process this. Ships that sailed above whispered tales of strange songs that pulled sailors overboard, never to be seen again. Process this bar. Beneath the black waves, something ancient stirred, its eyes glowing like twin lanterns in [music] the endless dark. Ships that sailed above whispered tales of strange songs that pulled sailors overboard, never to be seen again. when [music] storms came the creep. >> So if you just go to aistic studio.google.com and click on the builder link, you'll see this page right here and you have like 16 different little modules. And I kind of like this approach especially for vibe coders without a technical background because they can kind of see and conceptualize different capabilities of you know an AI builder essentially um where you can kind of think about how you can link them together to create really interesting AI infused based experiences essentially and that's exactly what I did. I thought to myself, it'd be really cool to have like a microphone where I I'm able to tell a simple story and then after each scene, say a key phrase like process this and then feed it into the image generation model, which would then go ahead after you're done recording, allow you to make edits on the actual image and then be able to take each of the scenes the scene images and then convert them to video with V3. So, there's actually six different uh modules that I used in order to create this. And I would say definitely avoid trying to oneshot a more complex prototype like this. Take it step by step. Don't do what I did. I really just wanted to stress test to see, you know, how good it is and if it could oneshot such a complex app. Spoiler, it can't. you know, it took about 20 or 30 follow-up prompts, but I'll show you all the different things that I used. First, I used Nano Banana. Um, and then this allows you basically to create images and also edit them, and it's really good. It's like the best, you know, in its class at that sort of thing. Um, I also wanted to use fast AI responses right here. So this one is used specifically so that after I say process this, it will take that description and create a more vibrant, you know, image-based description that then gets feed into fed into nano banana up here to generate the scene image. Um, we also use generate images with a prompt here. I What else is there? We got fast AI responses control image aspect ratio. This didn't work as good as I hope it hoped it would as you'll see. Um, generate speech as well. So, in the app, I make it so that it will take my voice over and instead of using my voice, it will use somebody else's voice at the end. Um, and then finally, we have animate images with VO right up here. And I believe that's everything. So once you do this, you'll see up here you have all these little modules attached to your prompt. You don't need to put those up front. You can always add them, you know, after the fact. And then right here, describe your idea. This is where your prompt goes. This is where you say this is exactly what the flow is, etc., etc. And so then you go ahead after, you know, you've specified this and you click build and it will create an initial prototype of your app. Okay, so that was kind of very annoying. I ran into a rate limiting issue because I'm using VO3. So, if you use VO, you're going to run into rate limiting issues if you're trying to build with it because you have to generate so many videos for tests. So, this is actually fast forward like 3 days from what you just saw, the last uh clip of me. And I was able to work with it a little bit more each day until I hit a freaking rate limit. Um, so I actually added um a couple things here like this visual storyboards gen uh the the generation settings. I made it allow us to sp specify like a sort of like a feel for the video and also um to try to create consistent characters which you'll see here in a second. Uh we're have a story about like a sea monster. [gasps] Um so you also say I I added in painting as well where you could edit the image before you get it ported over to actual video. All right, here we go. Far beneath the black waves, something ancient stirred, its eyes glowing like twin lanterns in the endless dark. Process this. Ships that sailed above whispered tales of strange songs that pulled sailors overboard, never to be seen again. Process this. When storms came, the creature rose slowly, scales shimmering like shattered stars, hungry for voices to drag back into the deep. Process this. All right, so first one looks pretty good. Got different colored eyes here. I know the second one I want to actually have a ship um above water with the creature in the distance. Um, so it looks like these actually didn't do too bad of a job. Um, if I come over here to this this one right here and click on edit image, we'll see that let me scale this down just a bit. Um, this whole area, what I want to do is I don't even want to do any of the inpainting stuff like this. I'm going to clear selection. I'm going to have it generate an entirely um new image, but I'm going to use the upload image feature to feature the same reference image um that we uploaded over here and tell it to create a ship like on on the ocean scene at nighttime or something. So, um all right. So, ancient ship on the turbulent seas during nighttime. Sea monster is barely visible in the distance with his head above the water. Let's see what this actually does. Let's hit edit and check it out. Oh, okay. That's not too bad, actually. If I hit edit image, we'll see. Oh, darn. It made it into portrait mode. So freaking frustrating. So, I know like if I were to generate a video with this image right here, it's going to be I it's it's going to have bars to the side and then it'll probably just kind of zoom them out like that. But either way, I I'm cool with this. And let's see if this actually makes a video for us. Actually, let's go back over here, hit edit image, and let's make the eyes um yellow. So, let's ask and see if it it will actually do that. Oh, perfect. It worked. Although, it kind of just changed. Actually, I kind of like that. All right. So, let's do the in painting. Let's do this one. Since these ones are green, just to show a demonstration, I'm going to say make the eyes green. I mean, uh, orange, yellow. Oh, yes, it worked. Okay. All right. Barring the fact that we're not going to get true, you know, 16 by9 for every shot, let's go ahead and actually uh generate the videos. >> Look out. Gods help us. >> It's coming closer. Okay, so I took this into Adobe Premiere. I stitched together the three little video clips. I added a little bit of background music. And this is the result. >> Bar beneath the [music] black waves. Something ancient stirred, its eyes glowing like twin lanterns in [music] the endless dark. Ships that sailed above whispered tales of strange songs that pulled sailors overboard, never to be seen again. When storms came, the creature rose slowly, scales shimmering like shattered stars, hungry for voices [music] to drag back into the deep. I don't know about you. Obviously, it's not Stephen Spielberg. However, the fact that we were able to knock something like a prototype like this out relatively quickly, you know, barring the rate limiting issues is extremely impressive. This is so freaking cool. I would love to take this into like a real productionready app because there would have to be obviously um major updates with the consistency in the workflow. Here's another one that I generated just for the fun of it. The metal door of the abandoned spaceship creeped open and green mist poured out, swirling like it was alive. Inside the [music] control panel, still blinked, even though no one had touched them for over a hundred silent years. Then a voice came through the static, soft, broken, and whispering Jake's name. even though Jake had never been born yet. >> And there you go. So, as you can see, you could use something like Google AI Studio to get a prototype of your idea to see even if it's possible. Now, the next step from there would be to export this code. Perhaps uh you're able to port it over to GitHub if you wish and then you could perhaps work on it further in something like cursor or just start start over, you know, entirely from scratch. So very cool. Pretty impressed with it. It doesn't oneshot these complex apps like this. Definitely would recommend taking them one step at a time, one feature at a time, and work on it on an iterative process to try to avoid all those, you know, the headaches with trying to oneshot a more complex app like this. So, as always, everybody, make sure to subscribe. I'll see you soon and goodbye.
Original Description
https://bit.ly/4bTD5zu 👈 Design & code like me. Use "UI2024" for 25% Off!
Level up your coding skills: https://scrimba.com?via=designcourse (Get 20% off using this link!)
-- Today, I'm showing you a prototype that I built with Google AI Studio's new builder. It's an app that allows you to read a short story, and it will generate a short movie from the text.
The flow is the following:
-- Live voice transcription
-- Each time 'process this' is spoken, it runs that dialogue through another AI that creates a detailed visual description of the scene
-- That description is used to generate a scene image
-- Once finished reading the story, you can edit the images with in-painting via Nano Banana.
-- You can also generate a voiceover in a specified character voice
-- Then, you can generate videos based on the scene images.
Finally, stitch them together in something like Premiere, and you have yourself a little short movie that originated from your voice. Sweet!
0:00 - Intro
0:56 - AI Studio Overview
4:58 - DEMO
8:29 - Example Story 1
9:27 - Example Story 2
https://aistudio.google.com
- - - - - - - - - - - - - - - - - - - - - -
Subscribe for NEW VIDEOS!
Learn UI/UX: https://designcourse.com
My personal FB account: http://fb.com/logodesigner
Coursetro FB: http://fb.com/coursetro
Coursetro's Twitter: http://twitter.com/designcoursecom
Join my Discord! https://discord.gg/a27CKAF
^-Chat with me and others
- - - - - - - - - - - - - - - - - - - - - -
Who is Gary Simon? Well, I'm a full stack developer with 2+ decades experience and I teach people how to design and code. I've created around 100+ courses for big brands like LinkedIn, Lynda.com, Pluralsight and Envato Network.
Now, I focus all of my time and energy on this channel and my website Designcourse.com.
Come to my discord server or add me on social media and say Hi!
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from DesignCourse · DesignCourse · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Photoshop Pen Tool Tutorial (Tattoo Design)
DesignCourse
How to Design the Microsoft Logo in Photoshop
DesignCourse
Photoshop Gradients Video Tutorial
DesignCourse
Your Guide to Layer Styles
DesignCourse
Layer Masks in Photoshop
DesignCourse
iOS App Icon Design Tutorial in Illustrator CS6
DesignCourse
Illustrator CS6 Logo Design Tutorial - Archfold
DesignCourse
Photoshop CS6 3D Tutorial - Magic Tent Illustration
DesignCourse
How to Design a Tshirt Tutorial - Adobe Illustrator
DesignCourse
Types of Logos - Lettermark & Monogram Logo Type
DesignCourse
Banner Design in Photoshop CS6
DesignCourse
How to Design a Logo in Illustrator CC
DesignCourse
Designing a Logo in Photoshop CC
DesignCourse
1. Launch & Market a Web Based Business - Introduction
DesignCourse
2. Launch & Market a Web Based Business - Logo Design
DesignCourse
3. Home Page Mockup in PS : Part 1
DesignCourse
4. Home Page Mockup in PS : Part 2
DesignCourse
5. Home Page Mockup in PS : Part 3
DesignCourse
6. Home Page Mockup in PS : Part 4
DesignCourse
7. Home Page HTML & CSS - Part 1
DesignCourse
8. Home Page HTML & CSS - Part 2
DesignCourse
Using Photoshop to Showcase Mobile Projects
DesignCourse
Flat Icon Design Tutorial in Illustrator CC
DesignCourse
Illustrator CC Logo Design Tutorial - A Logo That "Pops"!
DesignCourse
Logo Design Follow Along 1: Emblem Logo Design
DesignCourse
Showcasing Logos in 3D with Blender
DesignCourse
How to Design an Effective Lettermark Logo
DesignCourse
Squeeze Page Design Tutorial in Photoshop (Part 1)
DesignCourse
Squeeze Page Design Tutorial in Photoshop (Part 2)
DesignCourse
Mobile GUI Element Design in Adobe Photoshop CC (Part 1)
DesignCourse
Mobile GUI Element Design in Adobe Photoshop CC (Part 2)
DesignCourse
Flat Mobile App Design in Photoshop CC - Weather App
DesignCourse
Create Reflective 3D Text in Blender (Beginner)
DesignCourse
Animating a Logo with Adobe After Effects CC (Beginner)
DesignCourse
Design a Game Website Mockup in Photoshop CC (Part 1)
DesignCourse
Design a Game Website Mockup in Photoshop CC (Part 2)
DesignCourse
Photo Manipulation Tutorial in Photoshop CC (Beginner)
DesignCourse
Advertising Illustration Tutorial in Photoshop CC
DesignCourse
Perspective Warp Tool Tutorial in Photoshop CC
DesignCourse
Free Giveaway Contest. (WiseBanner Banner Maker).
DesignCourse
Design an Animated Loading/Download Icon (GIF)
DesignCourse
Contest Winners (WiseBanner)
DesignCourse
Model & Animate a 3D Push Button in Blender (Beginner)
DesignCourse
Mega Tutorial - iPhone Breathalyzer - Project Introduction
DesignCourse
Part 1 - iPhone Breathalyzer - Blender
DesignCourse
Part 2 - iPhone Breathalyzer - Rendering & GUI Design
DesignCourse
Part 3 - iPhone Breathalyzer - UI Animation in After Effects
DesignCourse
Part 4 - iPhone Breathalyzer - Website Design in Photoshop CC
DesignCourse
Part 5 - iPhone Breathalyzer - HTML Part 1
DesignCourse
Part 6 - iPhone Breathalyzer - HTML/CSS Part 2
DesignCourse
Part 7 - iPhone Breathalyzer - HTML/CSS Part 3
DesignCourse
Part 7 - iPhone Breathalyzer - Finishing Touches
DesignCourse
Square Space Logo Maker - C'mon People.
DesignCourse
Design a Bloody Knife in Photoshop CC
DesignCourse
Typographic Poster Design Tutorial in Illustrator (Part 1)
DesignCourse
Typographic Poster Design Tutorial in Illustrator (Part 2)
DesignCourse
Modern Business Card Design in Illustrator CC (Part 1)
DesignCourse
Modern Business Card Design in Illustrator CC (Part 2)
DesignCourse
Parallax Tutorial using Parallax.JS
DesignCourse
Interview: Andrew Price of BlenderGuru.com
DesignCourse
More on: Prompt Craft
View skill →Related Reads
Chapters (5)
Intro
0:56
AI Studio Overview
4:58
DEMO
8:29
Example Story 1
9:27
Example Story 2
🎓
Tutor Explanation
DeepCamp AI