Google AI Studio can make SICK Prototypes

DesignCourse · Beginner ·🖌️ UI/UX Design ·8mo ago

Key Takeaways

The video demonstrates how to use Google AI Studio for UI/UX design and prototyping, leveraging its vibe coding prototyping tool and integrating with other tools like Nano Banana and Fast AI responses for image generation and editing, as well as Adobe Premiere for video editing.

Full Transcript

Google recently released a new vibe coding prototyping tool in AI Studio and it's really freaking good. Actually, check out this voicetovideo short story generator that I built with it. All right, here we go. Far beneath the black waves, something ancient stirred, its eyes glowing like twin lanterns in the endless dark. Process this. Ships that sailed above whispered tales of strange songs that pulled sailors overboard, never to be seen again. Process this bar. Beneath the black waves, something ancient stirred, its eyes glowing like twin lanterns in [music] the endless dark. Ships that sailed above whispered tales of strange songs that pulled sailors overboard, never to be seen again. when [music] storms came the creep. >> So if you just go to aistic studio.google.com and click on the builder link, you'll see this page right here and you have like 16 different little modules. And I kind of like this approach especially for vibe coders without a technical background because they can kind of see and conceptualize different capabilities of you know an AI builder essentially um where you can kind of think about how you can link them together to create really interesting AI infused based experiences essentially and that's exactly what I did. I thought to myself, it'd be really cool to have like a microphone where I I'm able to tell a simple story and then after each scene, say a key phrase like process this and then feed it into the image generation model, which would then go ahead after you're done recording, allow you to make edits on the actual image and then be able to take each of the scenes the scene images and then convert them to video with V3. So, there's actually six different uh modules that I used in order to create this. And I would say definitely avoid trying to oneshot a more complex prototype like this. Take it step by step. Don't do what I did. I really just wanted to stress test to see, you know, how good it is and if it could oneshot such a complex app. Spoiler, it can't. you know, it took about 20 or 30 follow-up prompts, but I'll show you all the different things that I used. First, I used Nano Banana. Um, and then this allows you basically to create images and also edit them, and it's really good. It's like the best, you know, in its class at that sort of thing. Um, I also wanted to use fast AI responses right here. So this one is used specifically so that after I say process this, it will take that description and create a more vibrant, you know, image-based description that then gets feed into fed into nano banana up here to generate the scene image. Um, we also use generate images with a prompt here. I What else is there? We got fast AI responses control image aspect ratio. This didn't work as good as I hope it hoped it would as you'll see. Um, generate speech as well. So, in the app, I make it so that it will take my voice over and instead of using my voice, it will use somebody else's voice at the end. Um, and then finally, we have animate images with VO right up here. And I believe that's everything. So once you do this, you'll see up here you have all these little modules attached to your prompt. You don't need to put those up front. You can always add them, you know, after the fact. And then right here, describe your idea. This is where your prompt goes. This is where you say this is exactly what the flow is, etc., etc. And so then you go ahead after, you know, you've specified this and you click build and it will create an initial prototype of your app. Okay, so that was kind of very annoying. I ran into a rate limiting issue because I'm using VO3. So, if you use VO, you're going to run into rate limiting issues if you're trying to build with it because you have to generate so many videos for tests. So, this is actually fast forward like 3 days from what you just saw, the last uh clip of me. And I was able to work with it a little bit more each day until I hit a freaking rate limit. Um, so I actually added um a couple things here like this visual storyboards gen uh the the generation settings. I made it allow us to sp specify like a sort of like a feel for the video and also um to try to create consistent characters which you'll see here in a second. Uh we're have a story about like a sea monster. [gasps] Um so you also say I I added in painting as well where you could edit the image before you get it ported over to actual video. All right, here we go. Far beneath the black waves, something ancient stirred, its eyes glowing like twin lanterns in the endless dark. Process this. Ships that sailed above whispered tales of strange songs that pulled sailors overboard, never to be seen again. Process this. When storms came, the creature rose slowly, scales shimmering like shattered stars, hungry for voices to drag back into the deep. Process this. All right, so first one looks pretty good. Got different colored eyes here. I know the second one I want to actually have a ship um above water with the creature in the distance. Um, so it looks like these actually didn't do too bad of a job. Um, if I come over here to this this one right here and click on edit image, we'll see that let me scale this down just a bit. Um, this whole area, what I want to do is I don't even want to do any of the inpainting stuff like this. I'm going to clear selection. I'm going to have it generate an entirely um new image, but I'm going to use the upload image feature to feature the same reference image um that we uploaded over here and tell it to create a ship like on on the ocean scene at nighttime or something. So, um all right. So, ancient ship on the turbulent seas during nighttime. Sea monster is barely visible in the distance with his head above the water. Let's see what this actually does. Let's hit edit and check it out. Oh, okay. That's not too bad, actually. If I hit edit image, we'll see. Oh, darn. It made it into portrait mode. So freaking frustrating. So, I know like if I were to generate a video with this image right here, it's going to be I it's it's going to have bars to the side and then it'll probably just kind of zoom them out like that. But either way, I I'm cool with this. And let's see if this actually makes a video for us. Actually, let's go back over here, hit edit image, and let's make the eyes um yellow. So, let's ask and see if it it will actually do that. Oh, perfect. It worked. Although, it kind of just changed. Actually, I kind of like that. All right. So, let's do the in painting. Let's do this one. Since these ones are green, just to show a demonstration, I'm going to say make the eyes green. I mean, uh, orange, yellow. Oh, yes, it worked. Okay. All right. Barring the fact that we're not going to get true, you know, 16 by9 for every shot, let's go ahead and actually uh generate the videos. >> Look out. Gods help us. >> It's coming closer. Okay, so I took this into Adobe Premiere. I stitched together the three little video clips. I added a little bit of background music. And this is the result. >> Bar beneath the [music] black waves. Something ancient stirred, its eyes glowing like twin lanterns in [music] the endless dark. Ships that sailed above whispered tales of strange songs that pulled sailors overboard, never to be seen again. When storms came, the creature rose slowly, scales shimmering like shattered stars, hungry for voices [music] to drag back into the deep. I don't know about you. Obviously, it's not Stephen Spielberg. However, the fact that we were able to knock something like a prototype like this out relatively quickly, you know, barring the rate limiting issues is extremely impressive. This is so freaking cool. I would love to take this into like a real productionready app because there would have to be obviously um major updates with the consistency in the workflow. Here's another one that I generated just for the fun of it. The metal door of the abandoned spaceship creeped open and green mist poured out, swirling like it was alive. Inside the [music] control panel, still blinked, even though no one had touched them for over a hundred silent years. Then a voice came through the static, soft, broken, and whispering Jake's name. even though Jake had never been born yet. >> And there you go. So, as you can see, you could use something like Google AI Studio to get a prototype of your idea to see even if it's possible. Now, the next step from there would be to export this code. Perhaps uh you're able to port it over to GitHub if you wish and then you could perhaps work on it further in something like cursor or just start start over, you know, entirely from scratch. So very cool. Pretty impressed with it. It doesn't oneshot these complex apps like this. Definitely would recommend taking them one step at a time, one feature at a time, and work on it on an iterative process to try to avoid all those, you know, the headaches with trying to oneshot a more complex app like this. So, as always, everybody, make sure to subscribe. I'll see you soon and goodbye.

Original Description

https://bit.ly/4bTD5zu 👈 Design & code like me. Use "UI2024" for 25% Off! Level up your coding skills: https://scrimba.com?via=designcourse (Get 20% off using this link!) -- Today, I'm showing you a prototype that I built with Google AI Studio's new builder. It's an app that allows you to read a short story, and it will generate a short movie from the text. The flow is the following: -- Live voice transcription -- Each time 'process this' is spoken, it runs that dialogue through another AI that creates a detailed visual description of the scene -- That description is used to generate a scene image -- Once finished reading the story, you can edit the images with in-painting via Nano Banana. -- You can also generate a voiceover in a specified character voice -- Then, you can generate videos based on the scene images. Finally, stitch them together in something like Premiere, and you have yourself a little short movie that originated from your voice. Sweet! 0:00 - Intro 0:56 - AI Studio Overview 4:58 - DEMO 8:29 - Example Story 1 9:27 - Example Story 2 https://aistudio.google.com - - - - - - - - - - - - - - - - - - - - - - Subscribe for NEW VIDEOS! Learn UI/UX: https://designcourse.com My personal FB account: http://fb.com/logodesigner Coursetro FB: http://fb.com/coursetro Coursetro's Twitter: http://twitter.com/designcoursecom Join my Discord! https://discord.gg/a27CKAF ^-Chat with me and others - - - - - - - - - - - - - - - - - - - - - - Who is Gary Simon? Well, I'm a full stack developer with 2+ decades experience and I teach people how to design and code. I've created around 100+ courses for big brands like LinkedIn, Lynda.com, Pluralsight and Envato Network. Now, I focus all of my time and energy on this channel and my website Designcourse.com. Come to my discord server or add me on social media and say Hi!
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from DesignCourse · DesignCourse · 0 of 60

← Previous Next →
1 Photoshop Pen Tool Tutorial (Tattoo Design)
Photoshop Pen Tool Tutorial (Tattoo Design)
DesignCourse
2 How to Design the Microsoft Logo in Photoshop
How to Design the Microsoft Logo in Photoshop
DesignCourse
3 Photoshop Gradients Video Tutorial
Photoshop Gradients Video Tutorial
DesignCourse
4 Your Guide to Layer Styles
Your Guide to Layer Styles
DesignCourse
5 Layer Masks in Photoshop
Layer Masks in Photoshop
DesignCourse
6 iOS App Icon Design Tutorial in Illustrator CS6
iOS App Icon Design Tutorial in Illustrator CS6
DesignCourse
7 Illustrator CS6 Logo Design Tutorial - Archfold
Illustrator CS6 Logo Design Tutorial - Archfold
DesignCourse
8 Photoshop CS6 3D Tutorial - Magic Tent Illustration
Photoshop CS6 3D Tutorial - Magic Tent Illustration
DesignCourse
9 How to Design a Tshirt Tutorial - Adobe Illustrator
How to Design a Tshirt Tutorial - Adobe Illustrator
DesignCourse
10 Types of Logos - Lettermark & Monogram Logo Type
Types of Logos - Lettermark & Monogram Logo Type
DesignCourse
11 Banner Design in Photoshop CS6
Banner Design in Photoshop CS6
DesignCourse
12 How to Design a Logo in Illustrator CC
How to Design a Logo in Illustrator CC
DesignCourse
13 Designing a Logo in Photoshop CC
Designing a Logo in Photoshop CC
DesignCourse
14 1. Launch & Market a Web Based Business - Introduction
1. Launch & Market a Web Based Business - Introduction
DesignCourse
15 2. Launch & Market a Web Based Business - Logo Design
2. Launch & Market a Web Based Business - Logo Design
DesignCourse
16 3. Home Page Mockup in PS : Part 1
3. Home Page Mockup in PS : Part 1
DesignCourse
17 4. Home Page Mockup in PS : Part 2
4. Home Page Mockup in PS : Part 2
DesignCourse
18 5. Home Page Mockup in PS : Part 3
5. Home Page Mockup in PS : Part 3
DesignCourse
19 6. Home Page Mockup in PS : Part 4
6. Home Page Mockup in PS : Part 4
DesignCourse
20 7. Home Page HTML & CSS - Part 1
7. Home Page HTML & CSS - Part 1
DesignCourse
21 8. Home Page HTML & CSS - Part 2
8. Home Page HTML & CSS - Part 2
DesignCourse
22 Using Photoshop to Showcase Mobile Projects
Using Photoshop to Showcase Mobile Projects
DesignCourse
23 Flat Icon Design Tutorial in Illustrator CC
Flat Icon Design Tutorial in Illustrator CC
DesignCourse
24 Illustrator CC Logo Design Tutorial - A Logo That "Pops"!
Illustrator CC Logo Design Tutorial - A Logo That "Pops"!
DesignCourse
25 Logo Design Follow Along 1: Emblem Logo Design
Logo Design Follow Along 1: Emblem Logo Design
DesignCourse
26 Showcasing Logos in 3D with Blender
Showcasing Logos in 3D with Blender
DesignCourse
27 How to Design an Effective Lettermark Logo
How to Design an Effective Lettermark Logo
DesignCourse
28 Squeeze Page Design Tutorial in Photoshop (Part 1)
Squeeze Page Design Tutorial in Photoshop (Part 1)
DesignCourse
29 Squeeze Page Design Tutorial in Photoshop (Part 2)
Squeeze Page Design Tutorial in Photoshop (Part 2)
DesignCourse
30 Mobile GUI Element Design in Adobe Photoshop CC (Part 1)
Mobile GUI Element Design in Adobe Photoshop CC (Part 1)
DesignCourse
31 Mobile GUI Element Design in Adobe Photoshop CC (Part 2)
Mobile GUI Element Design in Adobe Photoshop CC (Part 2)
DesignCourse
32 Flat Mobile App Design in Photoshop CC - Weather App
Flat Mobile App Design in Photoshop CC - Weather App
DesignCourse
33 Create Reflective 3D Text in Blender (Beginner)
Create Reflective 3D Text in Blender (Beginner)
DesignCourse
34 Animating a Logo with Adobe After Effects CC (Beginner)
Animating a Logo with Adobe After Effects CC (Beginner)
DesignCourse
35 Design a Game Website Mockup in Photoshop CC (Part 1)
Design a Game Website Mockup in Photoshop CC (Part 1)
DesignCourse
36 Design a Game Website Mockup in Photoshop CC (Part 2)
Design a Game Website Mockup in Photoshop CC (Part 2)
DesignCourse
37 Photo Manipulation Tutorial in Photoshop CC (Beginner)
Photo Manipulation Tutorial in Photoshop CC (Beginner)
DesignCourse
38 Advertising Illustration Tutorial in Photoshop CC
Advertising Illustration Tutorial in Photoshop CC
DesignCourse
39 Perspective Warp Tool Tutorial in Photoshop CC
Perspective Warp Tool Tutorial in Photoshop CC
DesignCourse
40 Free Giveaway Contest.  (WiseBanner Banner Maker).
Free Giveaway Contest. (WiseBanner Banner Maker).
DesignCourse
41 Design an Animated Loading/Download Icon (GIF)
Design an Animated Loading/Download Icon (GIF)
DesignCourse
42 Contest Winners (WiseBanner)
Contest Winners (WiseBanner)
DesignCourse
43 Model & Animate a 3D Push Button in Blender (Beginner)
Model & Animate a 3D Push Button in Blender (Beginner)
DesignCourse
44 Mega Tutorial - iPhone Breathalyzer - Project Introduction
Mega Tutorial - iPhone Breathalyzer - Project Introduction
DesignCourse
45 Part 1 - iPhone Breathalyzer - Blender
Part 1 - iPhone Breathalyzer - Blender
DesignCourse
46 Part 2 - iPhone Breathalyzer - Rendering & GUI Design
Part 2 - iPhone Breathalyzer - Rendering & GUI Design
DesignCourse
47 Part 3 - iPhone Breathalyzer - UI Animation in After Effects
Part 3 - iPhone Breathalyzer - UI Animation in After Effects
DesignCourse
48 Part 4 - iPhone Breathalyzer - Website Design in Photoshop CC
Part 4 - iPhone Breathalyzer - Website Design in Photoshop CC
DesignCourse
49 Part 5 - iPhone Breathalyzer - HTML Part 1
Part 5 - iPhone Breathalyzer - HTML Part 1
DesignCourse
50 Part 6 - iPhone Breathalyzer - HTML/CSS Part 2
Part 6 - iPhone Breathalyzer - HTML/CSS Part 2
DesignCourse
51 Part 7 - iPhone Breathalyzer - HTML/CSS Part 3
Part 7 - iPhone Breathalyzer - HTML/CSS Part 3
DesignCourse
52 Part 7 - iPhone Breathalyzer - Finishing Touches
Part 7 - iPhone Breathalyzer - Finishing Touches
DesignCourse
53 Square Space Logo Maker - C'mon People.
Square Space Logo Maker - C'mon People.
DesignCourse
54 Design a Bloody Knife in Photoshop CC
Design a Bloody Knife in Photoshop CC
DesignCourse
55 Typographic Poster Design Tutorial in Illustrator (Part 1)
Typographic Poster Design Tutorial in Illustrator (Part 1)
DesignCourse
56 Typographic Poster Design Tutorial in Illustrator (Part 2)
Typographic Poster Design Tutorial in Illustrator (Part 2)
DesignCourse
57 Modern Business Card Design in Illustrator CC (Part 1)
Modern Business Card Design in Illustrator CC (Part 1)
DesignCourse
58 Modern Business Card Design in Illustrator CC (Part 2)
Modern Business Card Design in Illustrator CC (Part 2)
DesignCourse
59 Parallax Tutorial using Parallax.JS
Parallax Tutorial using Parallax.JS
DesignCourse
60 Interview: Andrew Price of BlenderGuru.com
Interview: Andrew Price of BlenderGuru.com
DesignCourse

This video teaches you how to use Google AI Studio for UI/UX design and prototyping, and how to integrate it with other tools for image generation and video editing. You'll learn how to create vibrant image-based descriptions, generate video prototypes, and export code for further development.

Key Takeaways
  1. Create images and edit them with Nano Banana
  2. Use Fast AI responses to create vibrant image-based descriptions
  3. Generate images with a prompt
  4. Control image aspect ratio
  5. Generate speech
  6. Create visual storyboards with character consistency
  7. Use inpainting feature to edit images before video generation
  8. Stitch together video clips in Adobe Premiere
  9. Add background music to video
  10. Export code
💡 Google AI Studio's new builder allows for rapid prototyping of UI/UX designs and integrates well with other tools for image generation and video editing.

Related Reads

Chapters (5)

Intro
0:56 AI Studio Overview
4:58 DEMO
8:29 Example Story 1
9:27 Example Story 2
Up next
Add Color Outline Borders to Images in Canva: Step by Step Tutorial for Beginners
Mariah Magazine
Watch →