Multimodal AI with Logan Kilpatrick

Google Cloud · Beginner ·👁️ Computer Vision ·1y ago

Key Takeaways

Explores multimodal AI with Logan Kilpatrick, discussing the fusion of input and output modalities

Full Transcript

[Music] I think the multimodal AI in the simplest terms is just the fusion of of all the input modalities and output modalities that humans are familiar with. like your model is able to take in text, audio, video, images, and it's able to both create text like we might see in a in a you know word document and it's also able to sort of output images um and audio and and in the future video as well. I do think audio as an input modality and output modality is something that like we see much more commonly being used. It is one of the new UX paradigms for how people are going to be interacting with with AI models. not doing like a prompt. I'm going to go put a bunch of text into a chatbot. Um, but instead speaking to models like we spend a lot of our time speaking to humans. Putting a little mic icon in your chatbot is like not the sort of perfect implementation of this technology. There's like all these really deep and nuanced experiences that can be created. Um, and this is at the application layer for people building companies. Like this is the opportunity to differentiate. the way that you differentiate is like you go build a deep product experience around these modalities and I think we'll see the opportunity for people to do that more and more like as the you know knowledge of how to build the right products in the in the AI ecosystem is like more widely shared the lines between all of the historical boundaries of like people doing stuff as humans are becoming incredibly blurry and like a lot of that is driven by how much innovation is happening in the ecosystem or like if you're just some random person playing around with a language model like you could actually figure out something that no one else has figured out. And there's very few domains that that that's the case today. Um, and I think the sort of barrier to entry is one of the things that gets me excited about the AI space because like the barrier to entry as someone who's using AI and building with it has never been lower than it is today and like it only continues to go down into the right. Um, so I think it has a bunch of like really positive outcomes. [Music]

Original Description

Want to learn more about multimodal AI? Check out Google Cloud's AI Business Trends 2025 report: https://goo.gle/4bRn91c "What's your favorite AI modality?" This may not be a question that comes up in regular conversation, but it could be if the someone you're chatting with is Logan Kilpatrick, Senior Product Manager at Google DeepMind. We asked Logan a few questions about one of his favorite topics (multimodal AI), and here's what he had to say.
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Google Cloud · Google Cloud · 0 of 60

← Previous Next →
1 Top 3 ways organizations are adjusting their cloud strategies to prepare for economic uncertainty
Top 3 ways organizations are adjusting their cloud strategies to prepare for economic uncertainty
Google Cloud
2 Google Cloud Retail Search and Browse Console deep dive
Google Cloud Retail Search and Browse Console deep dive
Google Cloud
3 Google Cloud Backup and DR - How to mount, clone or restore a VMware VM
Google Cloud Backup and DR - How to mount, clone or restore a VMware VM
Google Cloud
4 Google Cloud Backup and DR - VMware vSphere Backup Overview
Google Cloud Backup and DR - VMware vSphere Backup Overview
Google Cloud
5 Google Cloud Backup and DR - Creating backup Plans for VMware VM backups
Google Cloud Backup and DR - Creating backup Plans for VMware VM backups
Google Cloud
6 Google Cloud Backup and DR - Compute Engine Instance Backups and Sole Tenant Nodes
Google Cloud Backup and DR - Compute Engine Instance Backups and Sole Tenant Nodes
Google Cloud
7 Google Cloud Backup and DR - Managing Service Accounts
Google Cloud Backup and DR - Managing Service Accounts
Google Cloud
8 Let’s solve for what’s next
Let’s solve for what’s next
Google Cloud
9 Google Cloud Executive Briefing Center | Cloud Space | Silicon Valley
Google Cloud Executive Briefing Center | Cloud Space | Silicon Valley
Google Cloud
10 Tinyclues with Google Cloud offers CRM Intelligence to maximize conversions
Tinyclues with Google Cloud offers CRM Intelligence to maximize conversions
Google Cloud
11 Aible partners with Google Cloud helping customers build predictive models within minutes
Aible partners with Google Cloud helping customers build predictive models within minutes
Google Cloud
12 TELUS streamlines big data ingestion with help from Google Cloud and Accenture
TELUS streamlines big data ingestion with help from Google Cloud and Accenture
Google Cloud
13 Getting started with Apigee API Management
Getting started with Apigee API Management
Google Cloud
14 Google Cloud Retail Search
Google Cloud Retail Search
Google Cloud
15 Building your first API proxy with Apigee
Building your first API proxy with Apigee
Google Cloud
16 Brands and agencies develop dynamic video ads with Connected-Stories NEXT and Google Cloud
Brands and agencies develop dynamic video ads with Connected-Stories NEXT and Google Cloud
Google Cloud
17 Redefining the transportation industry
Redefining the transportation industry
Google Cloud
18 Google Cloud Project Katalyst
Google Cloud Project Katalyst
Google Cloud
19 Israel's Family Court: Creating more compelling experiences for its citizens
Israel's Family Court: Creating more compelling experiences for its citizens
Google Cloud
20 Tausight partners with Google Cloud to help healthcare industry protect PHI activity & take action
Tausight partners with Google Cloud to help healthcare industry protect PHI activity & take action
Google Cloud
21 Google Cloud Retail Browse
Google Cloud Retail Browse
Google Cloud
22 Verifying API keys and debugging your API proxy flow
Verifying API keys and debugging your API proxy flow
Google Cloud
23 Getting started with Apigee API Management
Getting started with Apigee API Management
Google Cloud
24 Adding policies to your APIs
Adding policies to your APIs
Google Cloud
25 Google Cloud Backup and DR - Configuring Google Cloud VMware Engine to work with Backup and DR
Google Cloud Backup and DR - Configuring Google Cloud VMware Engine to work with Backup and DR
Google Cloud
26 Topaz Subsea Cable
Topaz Subsea Cable
Google Cloud
27 Episode 29: Building a culture of data literacy with Latin America’s biggest ecommerce platform
Episode 29: Building a culture of data literacy with Latin America’s biggest ecommerce platform
Google Cloud
28 Weshalb Datananalysten die Sparringspartner von Produktmanagern sein sollten
Weshalb Datananalysten die Sparringspartner von Produktmanagern sein sollten
Google Cloud
29 Warum und wie METRO eine Machine Learning-Pipeline implementiert hat
Warum und wie METRO eine Machine Learning-Pipeline implementiert hat
Google Cloud
30 Wie nutzt METRO Data Science, um geschäftliche Herausforderungen zu meistern?
Wie nutzt METRO Data Science, um geschäftliche Herausforderungen zu meistern?
Google Cloud
31 Google Cloud in Qatar. Let's get solving.
Google Cloud in Qatar. Let's get solving.
Google Cloud
32 Google Cloud for Qatar
Google Cloud for Qatar
Google Cloud
33 Doha has a new Google Cloud region
Doha has a new Google Cloud region
Google Cloud
34 The new Google Cloud region in Qatar
The new Google Cloud region in Qatar
Google Cloud
35 Build, tune, and deploy foundation models with Vertex AI
Build, tune, and deploy foundation models with Vertex AI
Google Cloud
36 Generative AI on Google Cloud
Generative AI on Google Cloud
Google Cloud
37 Who will be coming to Google Cloud Day Tel Aviv? #Shorts
Who will be coming to Google Cloud Day Tel Aviv? #Shorts
Google Cloud
38 Protect your organization at the edge
Protect your organization at the edge
Google Cloud
39 Google Cloud Backup and DR Alert Notifications setup
Google Cloud Backup and DR Alert Notifications setup
Google Cloud
40 Build, tune, and deploy foundation models with Generative AI Support in Vertex AI
Build, tune, and deploy foundation models with Generative AI Support in Vertex AI
Google Cloud
41 Where the Internet Lives: Data center on the prairie
Where the Internet Lives: Data center on the prairie
Google Cloud
42 Which developer program are you joining?
Which developer program are you joining?
Google Cloud
43 Lufthansa Group baut intelligente Systeme zur Vereinfachung des Flugbetriebs
Lufthansa Group baut intelligente Systeme zur Vereinfachung des Flugbetriebs
Google Cloud
44 How ASML revived Moore's Law and remade chipmaking
How ASML revived Moore's Law and remade chipmaking
Google Cloud
45 CMO of Unity celebrates Women's History Month
CMO of Unity celebrates Women's History Month
Google Cloud
46 Vint Cerf on Google Cloud Digital Leader
Vint Cerf on Google Cloud Digital Leader
Google Cloud
47 Mobile World Congress 2023
Mobile World Congress 2023
Google Cloud
48 Topaz - Canada
Topaz - Canada
Google Cloud
49 Google Data Cloud & AI Summit 2023: Reveal opportunities to transform your business
Google Data Cloud & AI Summit 2023: Reveal opportunities to transform your business
Google Cloud
50 Building a conversational bot with Google Cloud Gen App Builder
Building a conversational bot with Google Cloud Gen App Builder
Google Cloud
51 Elisa Polystar and Google Cloud partner to bring the power of analytics and automation to CSPs
Elisa Polystar and Google Cloud partner to bring the power of analytics and automation to CSPs
Google Cloud
52 Network modernization - how can CSPs start now?
Network modernization - how can CSPs start now?
Google Cloud
53 How Semios uses imported and remote models for inference with BigQuery ML
How Semios uses imported and remote models for inference with BigQuery ML
Google Cloud
54 Deliver your AI solutions up to 100 times faster with Google Cloud partner, Snorkel AI
Deliver your AI solutions up to 100 times faster with Google Cloud partner, Snorkel AI
Google Cloud
55 Capture consumer perspectives for CPG using NLP and analytics with Harmonya and Google Cloud
Capture consumer perspectives for CPG using NLP and analytics with Harmonya and Google Cloud
Google Cloud
56 Delivering Cloud-Native Network Transformation
Delivering Cloud-Native Network Transformation
Google Cloud
57 Proactively detect & investigate anomalies & data quality issues in BigQuery with Telmai
Proactively detect & investigate anomalies & data quality issues in BigQuery with Telmai
Google Cloud
58 Introducing AlloyDB Omni
Introducing AlloyDB Omni
Google Cloud
59 Episode 30: How Auto Trader transitioned to the cloud to analyze tricky customer data
Episode 30: How Auto Trader transitioned to the cloud to analyze tricky customer data
Google Cloud
60 MongoDB Atlas on Google Cloud
MongoDB Atlas on Google Cloud
Google Cloud

Related Reads

Up next
9-Phase Computer Vision Roadmap 2026 | AI & Deep Learning | #shorts
SCALER
Watch →