Multimodal Live API demo: React.js console

Key Takeaways

hi I'm Kyle this is a demonstration of the multimodal live API the easiest way to try this out is at AI Studio can you recommend to me a cool sci-fi film to watch sure I can have you seen a rival it's a pretty unique take on First Contact a studio is a great way to try the API but next let me show you what you can build with it this is a boiler plate I've created to help anyone get up and running with the multimodal live API built in react we've open sourced the code for the boiler plate on GitHub for you to start building on top of it I want to show you a little preview of what it offers remember that I want to watch the movie arrival okay I will remember that you want to watch the movie arrival what movie are you planning on watching next so in this Bo plate you can easily connect to an API over a web socket the API can handle Audio and Video in and responds back with audio in this spoiler plate all of that is already connected it comes ready to record any audio through your microphone and will send frames of your webcam or another tab or window that you've shared on the left side you'll see a series of logs as they stream in you can also filter them by the type of logs you're interested in is a great way to test any function calls you may have received to start building with the multimodal live API visit ai. gooogle dodev geminii or visit the Google Gemini GitHub page