Accelerate the creative process with text-to-image foundation models

Key Takeaways

foreign [Music] my name is Nelson Gonzalez I'm a product manager at Google cloud and I'd like to welcome you to our session today um when you look at a name like accelerate the creative process with text to image models right two things strike you know one is creative right so we're talking today about creativity and second text to image Foundation models so generative AI so our goal today is to get across those two points we have an exciting session today and let's get started with it so first of all let's continue the introductions um today I'm joined by Zach achill a fellow colleague from Google and Zach Hills from from London and he came all the way from London to be with us today and to share some exciting demos uh I'm also joined today by Vishal sood Chief product officer at Thai phase who is going to talk about some exciting things bringing typeface to creators worldwide and I'm also here today with art from Chief product officer at Omnicom a very well known firm focusing on brand marketing so you're gonna get some great experiences today not only from the Google team but also for our guest presenters Partners customers in terms of an introduction I like to cover five key things we'll cover today so first of all is we start with an intro and um we're gonna talk about imagine on vertex today is Google's generative AI product but first of all we start with a basic Foundation about text to image models General TBI following that we'll do a deep dive of some of the Imagine features right as you heard from Sundar Thomas curian other Executives we had a number of launches this week for Imagine we're very happy about that and we reserve some additional launches that we'll talk about in the session today next we're going to talk about some use cases and art and Vishal are going to talk about some real use cases how they're bringing Innovation to to users globally then oh in nine and you can add many nines after that you know of the users and the usage actually won't be users accessing imagine as Zach and I will share most of our users will utilize imagine leveraging our partners and customers right and and and and and therefore imagine it's Enterprise scale it has an SD SDK where developers can access it in a very simple way so we'll uh zag will take us through that and then uh lastly we want to share some more resources right there's some interesting things happening other sessions so we'll cover that as well so let's get started with the introduction foreign so imagine a praise in this generative AI space specifically related to text to image generation right and maybe if I could ask the audience you know raise your hand if you have used a text to image model it doesn't matter whether it's imagine or not okay well that's that's great I mean there's a new technology I see many hands raised but for those of you that haven't used them I wanted to share a brief overview right Overview at a top level text to image generation uh it is an Innovative technology that starts with your creation your Innovation Simple Text prompt so any Creator can think about a text prompt right like this one here a photo of a cat with bright Galaxy filled eyes right and from that text prompt these models put it into action and they deliver an image as you can see here right so I wanted to accomplish those two things today number one share a brief overview of what we're talking about text to imagination and number two I know many of you were expecting to see a cat picture and here's the cat picture so checkbox um now um next I wanted to you know talk about um imagine right so imagine on vertex AI lets our customers innovate create very high quality images right not only create images which is going from a text to an image but also starting with an image and generating a caption or understanding what the image says and and many more things including video right video descriptions which we announced this week and the key goal for us is to do it at Enterprise scale an Enterprise scale means many things right it means doing this in a responsible way and it also means doing this in a way that enables our customers to to grow right this is a high growth area and we have built a service that is scales you know as much volume as you drive as you create the the images that you need when you need them and this service is here to enable you to do that so that's imagine and and it's called Imaging on vertex because imagine it's a Kiko is a key component of our vertex portfolio right and vertex is our key platform this number is a platform and also vertex AI includes tools to enable data scientists application developers to do many things including generation of images with imagine now today uh I'm pleased to share that um imagine has a number of really exciting features and I wanted to cover at a high level the four key features it does it offers today so the first feature is Generation I shared the cad example earlier right generating an image text to image generation so that's the key code feature the next feature is editing right imagine also enables you to take an image to take a text prompt and to change that image right edit that image and we're going to share some really exciting examples about editing I would say those two generation and editing go kind of like side by side they're very commonly used by many of our customers imagine also includes understanding right semantic understanding of images there's a captioning capability which enables you to submit an image and imagine will deliver a caption for the image it will describe the image generates the description and lastly but not least imagine has a sophisticated visual query answering capability and the model here is that you you as a developer you submit an image you submit a question and the model generates an answer based on the question so you could submit a an image of of my shirt right and you could ask a question is this a long sleeve shirt and it will tell you yes it's a long sleeve shirt you could ask the color of the shirt it will answer all these questions and it all it does all of this without the need for any training is a generative AI model so with that Foundation I'm gonna now deep dive into some of the features of Imagine available today first one is code features right in terms of core features we have the the key generation feature does power but a very high quality model right to generate images we do this in a responsible way so every time you have generative AI uh we we at Google we believe is really critical for generative AI to support the creation of the content in a responsible way so we have a number of approaches user configurable safety filters to enable you to do that a key priority for for models is uh speed so imagine it's a model that you get the outcomes in seconds right and and that's really critical for our Enterprise customers and then we also have a core capability which is what we call upscaling super resolution where after you generate the image you can ask imagine to increase the resolution to 2000 by 2000 pixels or four thousand by four thousand pixels right next capabilities editing right um editing again it starts with an image that you provide and you edit it right you can change the scenery for example and we're pleased today to introduce some new feature we see a common use case is to edit images of products right for e-commerce Etc and there's a new feature we'll talk about a bit later called product image editing then we have a common feature which is Styles right so sometimes in your company your marketing team they may have a particular style you know a set of colors that they want to Leverage is part of the brand or you know you may be designing an ad for a new restaurant we were having dinner a few of us yesterday and we were saying you know if you start up a restaurant you want that that Banner ad for your restaurant to reflect the look and feel of your restaurant so this is the new capability that enables you to do that we also have um a feature related to toning so again for those in the room you may have heard Google research talk about um dream Booth right um and a Google research paper that enabled these models to learn specific objects we call them subjects so you can not only use imagine as is but you can train imagine with subjects that are relevant to your business so we're pleased today to introduce a new feature we call it instant tuning so we're introducing that in this session today and we're very happy about that we're gonna have a brief demo of our Zone and we also have a image understanding as I mentioned earlier with captioning and visual query answering and then finally this week last but not least we introduce digital watermarking and verification sooner introduce the capability and we're very excited about this is a capability that will have many uses and will do a demo for you in a few minutes so with that um I'd like now to deep dive into some of these features and also share some demos so image generation again this is really critical right and the goal here is to make the creative process faster right as the title of the session says so you may be an architect right and in the past you have uh imagine a new building a new residence right and to go from your imagination as an architect to actually getting an image of what you want to build it will take it will take time right now with these capabilities you can create this very fast you can create images as you see here that reflect the goal you have or you could be a fashion designer right designing the next fashionable casual shoes right it's a technology that applies to many different use cases so next what I like to do is uh invite Zach Akil who is going to share a brief demo of generation capabilities I imagine hey so hello everyone my name is Zach and my laptop I need to log into it first uh who wants to see live demos of generative AI excellent I do too and I uh if we switch to the demo now we will see the UI in vertex AI of what the Imagine looks like so all the features that we are talking about today you can actually access and test we like to think of it as testing and prototyping through the UI so this is an excellent way that without you having to write any code if you just want to test the capabilities of it you can go directly into the vertex AI console and play around with it now I like to play sports part of that might be increasing my heart rate that might also be why I like live demos but I think I can push things a bit further and get some audience suggestions for the things I'm going to generate so I visited San Francisco now and I'm curious to know about some foods that people like to eat here so if anybody got any suggestions for foods that San Francisco is known for shout them out clam chowder any others burritos what else I'm writing this down what sourdough is that San Francisco I thought I thought London tomorrow okay gonna go gonna go for clam chowder I like clam chowder okay so what I'm gonna do I'm gonna generate a bowl or let's see clam chowder clam chowder in a wooden Bowl it's always fancier when it's in a wooden Bowl so I'm gonna make sure I'm spelling correctly let's generate a lot of examples and I want to note how fast it's gonna be that is a gamble to say right as I hit enter so we're generating look at that so we've already got our clam chowder generated but let's say I'm generating this for a restaurant that I'm potentially opening and I want to make the scene a bit nicer let's add stuff it's usually a good practice to be as specific and you can be as elaborate with your prompts as possible and I always like to put stuff in the in the background so I'm going to put in with a blurry Bridge in the background okay I like making stuff blurry it makes it look really nice and fancy so again rewriting the prompts look at this oh so now I've got my images that I might use for my menu and so in this we've seen how fast it is to develop uh how you can kind of quickly iterate your ideas and come up with New Image designs and also a thing to note is and again I'm doing this in the UI but everything we're showing there is an SDK and an API for this so if you want this functionality built into your systems and apps you can do exactly that with that I will hand it back to Nelson to talk about the rest of the features thank you Zach super exciting um thank you so that's image generation um another key feature as I mentioned earlier is related to product image editing right we have many companies you know have products right and products usually get shown in websites e-commerce websites right that they're key to attract your customers to let them experience your product an offense what you have is you start off with an email an image of a product like you see here is an image but many times you just want to put the product in a different setting right you want to change the product in a new setting and that requires a couple of really key capabilities number one is scene generation as you can see here right you generate a scene around the product but the other key capability with these models is you want to make sure that the product keeps the appearance right and in this case the product has text has visuals so those are two key factors and we're pleased that our Google shopping team announced this capability earlier this year at Google I O many Merchants that work with Google shopping really like this capability and workplace that through this collaboration between Google cloud and Google shopping we can bring the same features to imagine and is available API SDK is available today and now I'm going to turn it over to Zach for a brief showcase go ahead Zach if we could switch back to the demo okay we're switching back to demos it's going to be a demo Rich session okay so we're back in the UI before we were over here in the generate section we moved over here into the edit section and what we're going to do is we're going to come over here and enable product style image editing that's going to be this feature and you can enable it in the UI but again everything here is API and SDK available as well so you can do all the same stuff with code and then we need to come up with the products we want to generate photos for because we can generate them if we've got a photo of a unique item and one unique item that I think is going to be cool to test is something unique to this event so we've actually got has anyone got the fancy uh Cloud next bottle with the cool like rubber bit hold it up so people can see it people in the back people in the middle so people can see this is the product this is the product so I have taken yeah hold it up look around you can see what it looks like so I've got a photo and let's say we want to create some new versions of this so here it is so I got a photo I took a photo and then what I can do we've got the product style enabled I can enter in prompt and if everyone looks directly up I have just typed this in right now and what I'm doing is I'm I wrote a prompt and a hot tip is I'm going to set this off and a thing to note a best practice when writing prompts especially for doing things regarding like generating new backgrounds for products or images or anything else is rather than just write the prompt because we know the prompt is going to edit the generate the background rather than just Define here's what the background should look like it's a good tip to also reference the subject in the prompt so I'm not just saying I want the background to look like this I'm saying a water bottle on a desk with pencils pens and paper also on the desk with sunlight coming through the window in the background so I've referenced the subject in my prompt I think it's a really key feature and this is it we've now got our fancy product images generated and you can see it's kind of kept the perspective of the background it's generated relative to the object and yeah I think it's gonna be really powerful for people who want to quickly generate new product photos with any products they have that's the demo thank you very much back to Nelson thank you great excellent um so Styles right styles are the key right so we we know that Styles we accomplished two things one is make it really simple to generate images that reflect a particular style and we have seven stars that are predefined but in addition to that right enabling developers users creators to take a few images and launch a customer style so let's see the stars in action with Zach again back to the demo back to the demo uh slides please or on the screen so we're going to jump back into the generate section where we've got our clam chowder still sitting there and let's say Okay I want to open a restaurant in San Francisco so it's got to be hip and happening so we've got some styles that are pre-built into it so it can regenerate this using our pop art style and it's same prompt again it's all showing how quickly you can iterate stuff and now we've got some more cool quirky versions of the same image but with our predefined style that's already built in to imagine so that is an example of how you can use predefined Styles but let's say you've got your own style you've got something from your own company that you want to replicate and an example of this that I think is really cool is actually it's good to know is there anybody in the crowd who's web developers done anything with front ends build DUIs anything like this okay so I've done that as well and one of the common challenges of that is having consistent icons so you might find like a cool icon pack but it's okay we've got a couple of cool icons here but we're missing like an icon for I know a new section of the UI like oh I've got to find a designer to redo that what if you could say start with I think I've got here's some icons here so we've got these icons notice that there's only seven of them so we've got seven icons and we've fed these into imagine to generate a custom style what would you call it model yeah custom style custom style yeah isometric we call them isomet we call these isometrics so we we fed these into imagine it's learned this style so then we can come back into our imagine and generate we'll generate clam chatter but I'll generate a freight truck and then over here we can say use our custom style isometric select it'll say reference this in the prompt or I can just copy it in isometric Style so before we didn't have an icon for our website and now we have these cool icons I actually think it's probably a cool thing to show without this isometric style defined what the trucks look like so here's the icons that we've got generated and here is what would normally come out of imagine if you say a freight truck so it goes to show the power of using this custom style feature especially if you've got the requirement to have you know consistent marketing material things like that in your company so it's really powerful feature especially for developers if you want to generate icons I think but yeah back to Nelson thank you excellent excellent well now it is our pleasure to introduce Vishal suit chip product officer at I phase welcome Michelle [Applause] so hi everyone I'm Vishal uh so sorry yeah I do need to collect slides uh so so Vishal I have lead product at typeface and we are pretty excited and kind of we have a lot of gratitude towards the Imagine team we use their models we also use the text model from vertex Ai and before I talk much about typeface let me just kind of play a video just give you a sneak peek of the demo uh so let's just roll it and then we can talk more about typeface excels at creating visually striking images it falls short in capturing a Brand's unique voice and visual identity typefaces AI is specifically to be designed to help Brands create content that not only looks great but feels like it truly belongs to them and our AI is dedicated solely to your brand so your IP always remains private and secure so how does it work we absorb everything about your brand from image samples to messaging to Brand guidelines then we train custom AI this is unique as your brand itself now any employee can turn their creative ideas into compelling images and copy in just a second all while staying on brand and personalized to your audience profiles gone are the days when on-brand content creation was limited to a select few we get it you need more than just one-off content pieces that's why typeface has a wide range of templates create 10 times more personalized content across all your channels campaigns and audience segments everything from digital ads to SEO optimized blog posts to localized web pages to more this is typeface the only AI designed for Enterprises so your brand can truly tell your story your way [Music] oh thank you for that so let me kind of quickly brief what you just saw so you saw an Enterprise SAS application that can learn your products it can learn your voice and it can now create outputs which are multimodal in nature so a Google responsive display ad has both images and text in it and now we can do that all with one shot and I would encourage you to visit our booth if that's kind of interesting to you and we have much more detailed demos there but before I go deeper on the typeface stack and how we built it on top of imagine and other models let me actually talk about how companies are trying to leverage generative Ai and what problems are they struggling with right so there are broadly four kinds of problems we hear from all the customers we talk to the first problem is All About the Best in Class models now I don't know how many of you are kind of very active in this space every single morning I wake up there are four new Twitter demos five new models and the models I knew have already been updated so it's just crazy how fast the space is moving like we started types about a year ago and at that point of time there was no in this kind of scale there was no charge GPT nothing and just a year later we're phenomenally kind of improved the quality of the output and imagine team and the Bison team is going to move really really fast but then you want a partner in this journey who can stay on top of all these Innovations like we have a very close partnership with uh Nelson here and team and we move in the release something that few days later we have it in production so that's the kind of scale people want right so that's the first part of it the second part is deep personalization so companies you have a lot of content already it's not like you don't have content today but how can we use that content to learn from it and then create unique assets in your brand in your voice in your products in it and how do we do it at scale you don't have to do it one by one in the UI how do we do it in a batch mode in a workflow setting right so that's the kind of problem you need to solve which also plays into the last one but I'll get back to that the third is IP ownership so everything typeface does is Enterprise grade so as you share your content with us we create a pretty unique layer called typeface graph I'll cover that in a second but how do we protect your assets from helping improve just generic public AI but we actually just keep that for your company and create assets which are fairly unique but at the same time all your content your voice and your assets are always secure the last thing is integrated workflows so I I don't know how many of you are in the marketing space but I don't know how many martech tools exist there and people have already picked their favorite ones and marketers are actually already in their tools what they don't want to do is learn yet another tool so how do we integrate generative AI into your existing workflows and help you create content wherever you already are so that's a very big piece of puzzle that you also need to solve when you look at this so these four problems are precisely what we are solving at typeface and let me quickly cover how we are doing it so very early on in the Taipei Journey we made a very conscious decision that we are not going to invest and build our own foundational models we're not going to build an llm we're not going to build an image model and we're going to rely on the Best in Class models that exist out there and that's why we partner with Google and and that partnership is kind of gone very well for us and are happy to talk more about it but we actually built on top of Google's vertex AI models which we have talked about earlier as well and what typeface does is is the three layers on top of that I thought this was a technical audience so this is my attempt at an architecture slide so if you look at the first layer there it's called the graph so the simplest way to think about it is you bring your existing content in into typeface and it doesn't have to be a copy you can point us to your existing digital Asset Management Systems you can point us to your existing CMS systems or you can point us to a Google drive with all your content on it we can learn from that and we create a private content graph for you within typeface so I say private because this is is not going to help your competition it's not going to help generic AI get better it's going to be the special AI for for your company and that's the graph layer then what we do is we take this knowledge that we have from your company we marry it with the foundational models like imagine you just saw some pretty cool demos and we now create personalized content for you which is our blend layer so the blend layer actually does that so when you were seeing in the UI the Roja perfume example that was blend layer in action and then finally as business users you don't really want to learn I know the prompting is great and and Zach is a master of that art but but not everybody is right so how do you help people especially people who don't do this for a living don't have to worry about prompts they can just fill simple forms and how can we automatically create some compelling content for them so how do you stay in the flow of your work and still create compelling content which is flow of your work could be I actually want a Google ad I don't necessarily want to know how to go about creating an image then a text I just want to do it one shot right and the second thing is I want it within the app I am already in where I'm planning my paid media campaigns so that's the flow layer for us and on top of that exist various use cases like marketing HR sales and products so that's a little bit about the technical stack behind type is and let me just talk about this a little bit so uh is anybody here from marketing or Works in marketing space at all okay so so let me tell you a little bit about marketing so what happens is you a lot of marketers we talk to they usually have some form of a Content it could be a YouTube video it could be some existing product images but then the name of the game is personalization like how do I reach to various channels so if I go to Instagram I talk in a certain voice and my I have a certain style to my images if I go on my website I have a slightly different style uh to my images so that's kind of one form of personalization which is a channel based personalization the second form of personalization is within that channel how do I optimize for every single audience or the or a set of audiences that come to my site so that's the second form of what uh personalization then finally there's another personalization which is all of this I want to keep a consistent brand voice and brand kit and all that kind of stuff that I already have which could mean like if you look at Google's whole branding in the show there are four predominant colors you will see and how do you kind of incorporate all of these personalizations and help you create content skill and that's kind of what type is does and we do it with the help of our partners at Google also thank you okay I'll give it back to Nelson thank you [Applause] to see and we now wanted to highlight two additional features that we're really excited about um the next one is toning right um raise your hand if you have heard about tuning tuning for objects dream booths dream Booth Google research paper right exactly right so that's a very common capability is supported and imagine we have two features to enable tuning one is what we call the standard tuning based on dream proof Google research but we're pleased to launch an additional feature called instant tuning now instant tuning is a brand new capability it's significantly shortens the time that you need to train the model right instant tuning really works well with common objects but if you have an object that is more unique to your business you could actually leverage the standard tuning based on dream boss but instant tuning we're very excited about and then as Zach is going to share a brief demo of tuning instant tuning in particular okay so if we can switch back no my prompts are visible now so if we switch back to the demo so here is an example in fact I'll show we should have an image somewhere uh might be oh there it is so this is an actual image we took of a brown bag and what we can do is we've uploaded how many images did we upload to a few shots like four to six images not that much four to six images of this specific product yep and what we can do is then start generating images with that product so we can come into the generation we can specify not a style but a custom subject and we have a few here but we have the handbag so we'll select that and it will say okay if you want to start using this custom subject simply reference handbag in your prompt so we'll do that and I'm going to type really fast there we go and this is a handbag on a white carpet let's generate a couple of these so let's say we're generating brand new product photos so we would maybe specify if we've got for building a new product we could upload and find China models specifically for our company we've got really quick access to generate images of that product and you'll see it's generating the product images but you can see there's like slight variations in the angle of the product I mean there's like creases where there weren't creases so it's very intelligent understanding of actually even the properties of the product and how it compares to like maybe how bags can move in the natural world but yeah that's the that's how we do fine tuning and we'll hand it back to Nelson instant tune in thank you thank you so we have one more demo um and this demo is about digital watermarking right but let me introduce the concept first um there are two important questions right that are that are our customers ask when images are generated by AI right and and really the first question is how do you uh protect your content right as Michelle was describing earlier how do you ensure that this image that you generated with your creativity is protected question number one and question number two is what if somebody claims that your company generated an image but that image actually wasn't yours or maybe you generated the image and somebody edited the image and they claim that is your image right that's where digital watermarking comes in right and this new capability we launched in partnership with Google did mind is based on the Google that mine synth ID technology and it starts with an image you Watermark that image right you the watermarking service and then you get an image now if you see those two images to the eye there look exactly the same but they're different the pixels in the watermark image include a watermark right that that is a key thing and what that does is it makes it very robust it makes it very difficult to Tamper that image with that you know with that uh with that really editing the image without knowing that that image was watermarked to begin with and then we also provide a verification service right where you can send an image and this verification service will tell you whether the image is Watermark not Watermark or whether the image was watermarked but changed and zag will share a brief demo okay if we switch back to the demo what I'm showing is our fancy chowder pictures and if we want to inject our digital Watermark into these pictures all we have to do is generate them with this setting add digital Watermark enabled so I will enable that and then I will hit generate and this will go off this will generate those images again and inject that invisible Watermark visually into the image so what we have now is we have these images and they have a watermark that is imperceivable to humans so I will download one of these let's export so that's now we get the option to upscale that's where that's done but I'll just download it and we have our verify service so we come over here we can upload our image this is the image that we just downloaded we see what am I protected cool but let's upload an image that doesn't have a watermark what would that happen so let's say I don't know this one this is a screenshot of the bag that's assumed doesn't have a watermark but there is a question which I initially had as a developer I'm like I want to break this so what happens classic thing an image that has a watermark what happens anybody know what I'm going to test out shout it out screenshot it that's it I'm gonna I'm gonna hack this let's screenshot it not even screenshot it perfectly capture that saved come over verify upload download this is the screenshot you can see the name Watermark detected all right the watermark is not part of the metadata of the image it's actually the visual data of the image it's a very powerful robust service with that hand it back to Nest awesome thank you Zach thank you excellent [Applause] well I'm now really excited to Welcome to the stage ashram from Omnicom Chief product officer Romney come welcome charm all right thanks Nelson thanks I think we're almost out of time so I'm going to try to move very very quickly um perfect uh thrilled to be here excited to talk about what we're doing with generative AI Omnicom um I know there's a technical audience I'm going to focus a little bit more initially on the the business aspect talk about how we've deployed technology at Omnicom uh and how that influences to some degree how we Implement these Technologies if you don't know who what Omnicom is we're one of the world's largest marketing Communications firms we're a holding company of large agencies across all aspects of marketing uh Creative Media Etc and and we view generative AI as fundamental uh to our business going forward um in terms of uh data AI technology we have been hyper focused on deploying these capabilities and uh in in the service of outcomes for our clients and we do that through a platform that we call Omni which is really our operating system it's how we bring technology to the hands of our of our practitioners and into the to the heart of everything that we do uh and Omni is five years old it's Global it's scaled and from inception AI has been at the heart of what we do but clearly the the Advent of generative AI has caused us to really rethink or or prioritize the injection of AI into all aspects of the marketing workflow um so across automation predictive models uh personalization the optimization of campaigns But ultimately in the actual creation of content which is where we partnered with Google and imagine and we'll talk about that in a second and ultimately we don't just think that this is something that's going to transform the work we do for our clients we think this technology transforms ultimately our entire organization we've already deployed a number of different AI based utilities within Omni as a platform at the heart of this just before we get into the the image generation piece we feel it for an organization of our size if you think about the clients that we work with large Global Brands a responsible AI approach uh the vetting of the the models from ethics and legal perspective is critical that's actually one of the key reasons that we actually have partnered with Google on imagine uh and and we we're really excited to work with with them on on that portion of the capability and ultimately none of this matters if we actually don't use these Technologies to make an impact on our clients business so content generation there are thousands of top level creative professionals at Omnicom we have uh you know as an industry a conference in the south of France every year where we celebrate path breaking creative work so you can imagine that um talking about generating content with artificial intelligence is a really really big deal for us and initially where we see the key opportunity given the types of clients we work with the type of work we do is really in pre-production Inspiration the ability to iterate through content through through Concepts and and versions and so forth really really efficiently really really quickly and expand the scope of what we're doing and deliver better work for our clients and that's ultimately where we've partnered with with imagine and we'll talk about how that works um I'm not a creative I'm sort of a martech nerd which is much less cool but ultimately um I worked with our creative Community to kind of think about how we bring together the rich data that lives in our Omni platform uh with creative insights and prompts feed that into imagine and then deliver a Content experience and I'll get into just a little bit of sense of how we're doing that and then we'll do a super quick demo uh video demo of how it comes to life for for in our in our platform so what we're doing is we're taking the audience Persona from Omni think of that as a customer segmentation a profile which comes with a huge set of Rich data assets and we're running that through an llm and compressing it into uh into a verbal description and prompt and then marrying that with creative Direction Creative Concepts some of the stuff that uh that you you just saw in some of the demos and then creating a new prompt which we call a dprompt to diffusion prompt which is specifically Divine for or or created for Imagine to the point earlier that not all of our end users are like experts in prompt engineering and we're feeding that in and generating the imagery and I'll show you uh how it works so I'm actually going to start in Omni um and uh this is this is the platform you can see that we have various capabilities different tools uh and uh different outputs from those tools and I'm going to go into ultimately our audience Explorer capability and show you an audience that that I created for for the conference which is a a sort of a yoga Enthusiast audience um so I bring up the yogi enthusiasts you can see there's a bunch of demographic data about that audience the reason I want to show this because I want to show kind of the richness of the data file that we ultimately feed into the model that creates The Prompt for image creation so various different types of uh data attributes Advanced audience data media consumption data all of that all those attributes about our users is part um of of what makes up that audience profile and then the criteria to build that that audience uh is some Advanced audience profiles um you know focusing on Fitness Yoga Etc okay now I'm actually going to generate through the llm the the verbal description of that audience uh which describes the audience and then I'm going to switch to our image renovation framework which is going to call Imagine and I'm going to take that marry it with some key stylistic guides in this case a relaxing Fine Art illustrative style a relaxing mood and I'm sorry so that's a custom style and then generate a set of of images and again we've seen a bunch of these demos today now so you have a sense of how the product works enabling certain image editing capabilities all of which uh sit on top of of aspects of of imagine and then um uh then I can actually take those audiences those audiences those those images and start to curate them into a collection um and then sort of Name That collection and Define it as an object uh in um and so this is where uh you know we'd be starting to create that mood board of uh of of Creative Concepts that those creatives can then use to to drive their work forward and then you know if ultimately once I've created that that collection uh if I have a sense of that I want to create additional Styles I can I can bring that up change that illustrative style to a photorealistic style maybe change camera angles again uh referencing back the demos that we saw earlier and I can bring those images up add those to the collection and ultimately Define the sort of the parameters of that of that creative ideation that's going to drive that process forward and that becomes um the uh the an object uh in Omni that we can people can collaborate on you can see it on over there alongside audiences and other aspects so I hope we give you a sense of how we're approaching uh the the use of generative AI I think key point is that we do envisage over time potentially the utilization of this capability and production production ads at this stage it's really about that pre-production inspiration and I'll pass it back to Nelson arapa [Applause] excellent that was great to see um great to see all the Innovation here today I we as we discussed right API we saw a number of demos on the UI but API SDK that's really important to provide a developer experience and I like to turn it over to Zach who is going to talk about that experience for developers go ahead Zach absolutely uh the basically the thing to know is that there is an SDK everything we've shown uh through the UI the visible invisible Watermark verification generation editing tuning everything is accessible through a python SDK at the moment with more languages to come later but also a full rest API so if you can make rest calls from your applications or services or pipelines you can use imagine in your pipelines right now I'm going to ask to switch to the demo laptop it's not really a demo but more just to show that there is code there are code Labs available on the Google Cloud generative AI uh repository in GitHub that show you how you can run imagine in notebooks right now and in fact we'll switch back to the slides to show some of the resources where you can learn more about imagine and get started with imagine code yeah fantastic so so in basically have additional sessions there's some sessions taking place tomorrow other sessions already took place but you consider recording we also have resources there's a lot of documentation about imagine there is also the SDK information and also uh there is a at the export there's an exciting couple of exhibits one on generative Ai and there's an exhibit that's really interesting where you can get a souvenir a postcard right generated by llms by palm and imagine so we look forward to seeing you there and and also last but not least we really appreciate your feedback we hope that this session was useful and if you could leverage the app and share your feedback we appreciate it and for those of you that are here enjoy the rest of cloud next and those of you watching remotely have a great day or your evening and thank you everybody appreciate it okay foreign