The power within: Running Large Language Models on your local machine | DEM524
Running Large Language Models (LLMs) locally represents a revolutionary shift in an era where cloud reliance is the norm. This approach amplifies your control over data privacy and processing speeds and unlocks a new level of customization and immediate integration into your systems. Whether you're just starting with LLMs or you've been exploring their capabilities for some time, this demo will enhance your comprehension of the possibilities that open up when you run LLMs locally.
To learn more, please check out these resources:
* https://aka.ms/build25/plan/BestModelGenAISolution
𝗦𝗽𝗲𝗮…
Watch on YouTube ↗
(saves to browser)
Chapters (9)
Introduction of Rodrigo Diaz Conscha
4:19
Downloading Specific Software Versions
4:42
Management of Software and Models
5:40
Demonstration of Loading Models on Foundry
8:00
Model Loading for Different Processors
8:05
Capabilities of Foundry Local
8:45
CPU Performance with Model
14:55
Demonstration of Local Model Functionality without Internet
15:08
Benefits of Running Local Large Language Models
Playlist
Uploads from Microsoft Developer · Microsoft Developer · 0 of 60
← Previous
Next →
1
![What you need to know about LLMs [Pt 1]](https://i.ytimg.com/vi/GQ_2OjNZ9aA/mqdefault.jpg)
2
![Get started with AI for free using Phi-3 [Pt 6]](https://i.ytimg.com/vi/Ds32MS9SHzU/mqdefault.jpg)
3
![Azure tools & services for hosting and storing AI apps [Pt 9]](https://i.ytimg.com/vi/WB6Fpzhwyug/mqdefault.jpg)
4
![Run AI models on your local machine with Ollama [Pt 5]](https://i.ytimg.com/vi/dLfNnoPv4AQ/mqdefault.jpg)
5
![Streaming Generative AI output with the AI Chat Protocol [Pt 10]](https://i.ytimg.com/vi/fzDCW-6hMtU/mqdefault.jpg)
6
![Essential prompt engineering techniques [Pt 2]](https://i.ytimg.com/vi/gQ6TlyxBmWs/mqdefault.jpg)
7
8
![Improve AI accuracy and reliability with RAG [Pt 3]](https://i.ytimg.com/vi/xkFOmx5yxIA/mqdefault.jpg)
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
What you need to know about LLMs [Pt 1]
Microsoft Developer
Get started with AI for free using Phi-3 [Pt 6]
Microsoft Developer
Azure tools & services for hosting and storing AI apps [Pt 9]
Microsoft Developer
Run AI models on your local machine with Ollama [Pt 5]
Microsoft Developer
Streaming Generative AI output with the AI Chat Protocol [Pt 10]
Microsoft Developer
Essential prompt engineering techniques [Pt 2]
Microsoft Developer
Generative AI with JavaScript - Introduction
Microsoft Developer
Improve AI accuracy and reliability with RAG [Pt 3]
Microsoft Developer
Data As a Corporate Asset—the GenAI-era Take (Part 2)
Microsoft Developer
Boost your local development with Dev Container templates for Azure SQL
Microsoft Developer
Boost your local development with Dev Container templates for Azure SQL
Microsoft Developer
What's your favorite use case for Copilot?
Microsoft Developer
What's your favorite use case for Copilot?
Microsoft Developer
How can Copilot help me make my software more accessible?
Microsoft Developer
How can Copilot help me make my software more accessible?
Microsoft Developer
Database performance and scalability with Azure SQL Database Hyperscale elastic pools | Data Exposed
Microsoft Developer
What languages are supported by Copilot?
Microsoft Developer
What languages are supported by Copilot?
Microsoft Developer
Azure Essentials: Improve the reliability, security, and performance of cloud and AI investments
Microsoft Developer
Use Copilots To Put Esoteric Tools to Work
Microsoft Developer
Data Engineering in Fabric using Copilot | Data Exposed: MVP Edition
Microsoft Developer
Mr. Maeda's Cozy AI Kitchen - AI Coaching the Coach, with Pat Cavanaugh
Microsoft Developer
GitHub Copilot for Azure: Discovering Azure services and AI templates
Microsoft Developer
GitHub Copilot for Azure: Deploying to Azure Kubernetes Service (AKS)
Microsoft Developer
GitHub Copilot for Azure: Exploring your Azure resources
Microsoft Developer
GitHub Copilot for Azure: Deploying to Azure with context
Microsoft Developer
GitHub Copilot for Azure: Understanding and managing your models in Azure AI
Microsoft Developer
GitHub Copilot for Azure: Planning a migration to Azure
Microsoft Developer
“How does Copilot for Azure SQL work?” and more of your questions answered! | Data Exposed
Microsoft Developer
How did you get started writing books for Windows and .NET?
Microsoft Developer
Streamline agreement workflows with Docusign
Microsoft Developer
Deploy OpenAI Services at Scale Using Provision Throughput Units
Microsoft Developer
Automated Deployment from AKS VsCode Extension
Microsoft Developer
What’s New in SQL Server & Azure SQL | Data Exposed Live @ PASS Summit 2024
Microsoft Developer
Microsoft 365 Copilot: Developer Camp
Microsoft Developer
Introducing Custom Engine Agents
Microsoft Developer
Unlock the Power of Custom Engine Agents
Microsoft Developer
Introducing Declarative Agents
Microsoft Developer
The Future of Declarative Agents
Microsoft Developer
Extending Declarative Agents
Microsoft Developer
Developer's Guide to Building Copilot Agents
Microsoft Developer
A Conversation with the Leaders Behind the Developer Tools
Microsoft Developer
Azure SQL Revealed 2nd Edition Book | Data Exposed
Microsoft Developer
What’s the origins of .NET generics?
Microsoft Developer
Essential Azure Skilling and Guidance
Microsoft Developer
Unlocking Multilingual Accessibility with Co-op Translator: A Case Study on Phi-3 Cookbook
Microsoft Developer
Master Azure Resiliency, Performance, and Security
Microsoft Developer
Mr. Maeda's Cozy AI Kitchen - Composite AI, with Hiromichi Kobashi
Microsoft Developer
Build Intelligent Apps on Azure
Microsoft Developer
Tell us a story from the era when you got your 5 (and 3!?!) year service award
Microsoft Developer
Next Gen Data Analytics with Microsoft Fabric
Microsoft Developer
Tell us a story from the era when you got your 10-year service award
Microsoft Developer
Building the ultimate chatbot on your own data with Azure SQL and Semantic | Data Exposed
Microsoft Developer
Trustworthy AI: From Principles to Practice
Microsoft Developer
Tell us a story from the era when you got your 15-year service award
Microsoft Developer
Tell us a story from the era when you got your 20-year service award
Microsoft Developer
Tell us a story from the era when you got your 25-year service award
Microsoft Developer
Tell us a story from the era when you got your 30-year service award
Microsoft Developer
Tell us a story from the era when you got your 35-year service award
Microsoft Developer
Tell us a story from the era when you got your 40-year service award
Microsoft Developer
DeepCamp AI