Connect Semantic Kernel to Open Source models via Ollama

Ali Issa · Beginner ·🧠 Large Language Models ·1y ago

Key Takeaways

This video demonstrates how to connect Semantic Kernel to Open Source models via Ollama and run Llama 3 locally

Original Description

In this video you will learn what #ollama is and it's key capabilities. Moreover, I demonstrate how to run #llama3 locally on your computer via #ollama. Lastly, a walkthrough of how to connect #semantickernel to Llama 3.1 which is served by Ollama. 00:00 - Intro 00:20 - Ollama Overview 01:44 -Running Llama 3.1 locally via Ollama 02:44 - Connecting Semantic Kernel to Llama 3.1 via Ollama 04:22 - Recap of what we have learned in this video #ollama #huggingface #llm #ai #aiagent #openai
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related Reads

📰
GPT-5.5 Complete Guide in 2026
Learn about GPT-5.5, its features, performance, and why it matters in 2026, and how to leverage it for improved AI-assisted tasks
Dev.to AI
 📰
AI Simplified — Why Structured Output Matters More Than a Fluent Answer
Learn why structured output is crucial for AI answers and how it can improve usability and automation
Dev.to AI
 📰
You Validated the Output. Who Validated the Process?
Validate AI processes, not just outputs, to ensure reliability and trustworthiness
Dev.to · Yura Solovey
 📰
I ran a 110B LLM on 16GB of RAM. Here's the equation that predicts any model's speed on your machine
Learn how to predict a large language model's speed on your machine using a simple equation, and discover how to run a 110B LLM on limited RAM
Dev.to · Federico Sciuca

Chapters (5)

Intro
0:20 Ollama Overview
1:44 Running Llama 3.1 locally via Ollama
2:44 Connecting Semantic Kernel to Llama 3.1 via Ollama
4:22 Recap of what we have learned in this video
Up next
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)
Watch →