Local AI development with Foundry Local and .NET Aspire | DEM520
When we start building apps infused with AI it begs the question of how we tackle the local dev experience. Do we provision cloud resources, if so, how do we secure them, manage rate limits and cost? Or do run local models, and how do we set them up? What about vector databases, data ingestion, and all those auxiliary systems? It all sounds complicated, that is until we start leveraging the power of .NET Aspire and see that we can have it as easy as clone repo and dotnet run!
𝗦𝗽𝗲𝗮𝗸𝗲𝗿𝘀:
* Aaron Powell
𝗦𝗲𝘀𝘀𝗶𝗼𝗻 𝗜𝗻𝗳𝗼𝗿𝗺𝗮𝘁𝗶𝗼𝗻:
This is one of many sessions from the Micro…
Watch on YouTube ↗
(saves to browser)
Chapters (9)
Challenges of Running AI Locally vs. Cloud
2:58
Demonstration of Foundry Local Usage
3:37
Distributed Application Concept Explanation
4:02
Model Download and Service Management with Aspire
5:50
Configuration of Foundry Local Resource
6:33
Explanation of the Chat Model Requirement and Initial Mention of Application's
10:47
Options for downloading models and continuation plans
11:50
Explanation of automatic model version and device compatibility selection
12:11
Details on CPU model download
Playlist
Uploads from Microsoft Developer · Microsoft Developer · 0 of 60
← Previous
Next →
1
![What you need to know about LLMs [Pt 1]](https://i.ytimg.com/vi/GQ_2OjNZ9aA/mqdefault.jpg)
2
![Get started with AI for free using Phi-3 [Pt 6]](https://i.ytimg.com/vi/Ds32MS9SHzU/mqdefault.jpg)
3
![Azure tools & services for hosting and storing AI apps [Pt 9]](https://i.ytimg.com/vi/WB6Fpzhwyug/mqdefault.jpg)
4
![Run AI models on your local machine with Ollama [Pt 5]](https://i.ytimg.com/vi/dLfNnoPv4AQ/mqdefault.jpg)
5
![Streaming Generative AI output with the AI Chat Protocol [Pt 10]](https://i.ytimg.com/vi/fzDCW-6hMtU/mqdefault.jpg)
6
![Essential prompt engineering techniques [Pt 2]](https://i.ytimg.com/vi/gQ6TlyxBmWs/mqdefault.jpg)
7
8
![Improve AI accuracy and reliability with RAG [Pt 3]](https://i.ytimg.com/vi/xkFOmx5yxIA/mqdefault.jpg)
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
What you need to know about LLMs [Pt 1]
Microsoft Developer
Get started with AI for free using Phi-3 [Pt 6]
Microsoft Developer
Azure tools & services for hosting and storing AI apps [Pt 9]
Microsoft Developer
Run AI models on your local machine with Ollama [Pt 5]
Microsoft Developer
Streaming Generative AI output with the AI Chat Protocol [Pt 10]
Microsoft Developer
Essential prompt engineering techniques [Pt 2]
Microsoft Developer
Generative AI with JavaScript - Introduction
Microsoft Developer
Improve AI accuracy and reliability with RAG [Pt 3]
Microsoft Developer
Data As a Corporate Asset—the GenAI-era Take (Part 2)
Microsoft Developer
Boost your local development with Dev Container templates for Azure SQL
Microsoft Developer
Boost your local development with Dev Container templates for Azure SQL
Microsoft Developer
What's your favorite use case for Copilot?
Microsoft Developer
What's your favorite use case for Copilot?
Microsoft Developer
How can Copilot help me make my software more accessible?
Microsoft Developer
How can Copilot help me make my software more accessible?
Microsoft Developer
Database performance and scalability with Azure SQL Database Hyperscale elastic pools | Data Exposed
Microsoft Developer
What languages are supported by Copilot?
Microsoft Developer
What languages are supported by Copilot?
Microsoft Developer
Azure Essentials: Improve the reliability, security, and performance of cloud and AI investments
Microsoft Developer
Use Copilots To Put Esoteric Tools to Work
Microsoft Developer
Data Engineering in Fabric using Copilot | Data Exposed: MVP Edition
Microsoft Developer
Mr. Maeda's Cozy AI Kitchen - AI Coaching the Coach, with Pat Cavanaugh
Microsoft Developer
GitHub Copilot for Azure: Discovering Azure services and AI templates
Microsoft Developer
GitHub Copilot for Azure: Deploying to Azure Kubernetes Service (AKS)
Microsoft Developer
GitHub Copilot for Azure: Exploring your Azure resources
Microsoft Developer
GitHub Copilot for Azure: Deploying to Azure with context
Microsoft Developer
GitHub Copilot for Azure: Understanding and managing your models in Azure AI
Microsoft Developer
GitHub Copilot for Azure: Planning a migration to Azure
Microsoft Developer
“How does Copilot for Azure SQL work?” and more of your questions answered! | Data Exposed
Microsoft Developer
How did you get started writing books for Windows and .NET?
Microsoft Developer
Streamline agreement workflows with Docusign
Microsoft Developer
Deploy OpenAI Services at Scale Using Provision Throughput Units
Microsoft Developer
Automated Deployment from AKS VsCode Extension
Microsoft Developer
What’s New in SQL Server & Azure SQL | Data Exposed Live @ PASS Summit 2024
Microsoft Developer
Microsoft 365 Copilot: Developer Camp
Microsoft Developer
Introducing Custom Engine Agents
Microsoft Developer
Unlock the Power of Custom Engine Agents
Microsoft Developer
Introducing Declarative Agents
Microsoft Developer
The Future of Declarative Agents
Microsoft Developer
Extending Declarative Agents
Microsoft Developer
Developer's Guide to Building Copilot Agents
Microsoft Developer
A Conversation with the Leaders Behind the Developer Tools
Microsoft Developer
Azure SQL Revealed 2nd Edition Book | Data Exposed
Microsoft Developer
What’s the origins of .NET generics?
Microsoft Developer
Essential Azure Skilling and Guidance
Microsoft Developer
Unlocking Multilingual Accessibility with Co-op Translator: A Case Study on Phi-3 Cookbook
Microsoft Developer
Master Azure Resiliency, Performance, and Security
Microsoft Developer
Mr. Maeda's Cozy AI Kitchen - Composite AI, with Hiromichi Kobashi
Microsoft Developer
Build Intelligent Apps on Azure
Microsoft Developer
Tell us a story from the era when you got your 5 (and 3!?!) year service award
Microsoft Developer
Next Gen Data Analytics with Microsoft Fabric
Microsoft Developer
Tell us a story from the era when you got your 10-year service award
Microsoft Developer
Building the ultimate chatbot on your own data with Azure SQL and Semantic | Data Exposed
Microsoft Developer
Trustworthy AI: From Principles to Practice
Microsoft Developer
Tell us a story from the era when you got your 15-year service award
Microsoft Developer
Tell us a story from the era when you got your 20-year service award
Microsoft Developer
Tell us a story from the era when you got your 25-year service award
Microsoft Developer
Tell us a story from the era when you got your 30-year service award
Microsoft Developer
Tell us a story from the era when you got your 35-year service award
Microsoft Developer
Tell us a story from the era when you got your 40-year service award
Microsoft Developer
DeepCamp AI