Local LLMs with llamafile

External: Coursera Courses ↗ · Coursera

Open Course on External: Coursera

Free to audit · Opens on External: Coursera

Local LLMs with llamafile

Coursera · Beginner ·📊 Data Analytics & Business Intelligence ·3mo ago

Key Takeaways

Packages open-source AI models into portable llamafile executables and deploys them locally across Windows, macOS, and Linux

Original Description

In this 1-hour project-based course, you will learn to: * Package open-source AI models into portable llamafile executables * Deploy llamafiles locally across Windows, macOS and Linux * Monitor system metrics like GPU usage when running models * Query llamafile APIs with Python to process generated text * Experience real-time inference through hands-on examples
Watch on External: Coursera ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related Reads

📰
OpenPowerlifting Veri Seti ile Keşifçi Veri Analizi (EDA): Domain Bilgisinin Önemi ve Anomali…
Learn how to apply exploratory data analysis (EDA) on a real-world dataset, OpenPowerlifting, and understand the importance of domain knowledge in data science
Medium · Data Science
 📰
Could Satellite Data Help Some Communities Monitor Air Pollution?
Satellite data from NASA can help communities monitor air pollution, especially where ground-based monitors are lacking
Forbes Innovation
 📰
The Oldest Decision in Agriculture, Made With a New Instrument
Learn how to apply curve-implied convenience yield to decide when to sell harvests using economic problems, backtesting, and risk assessment
Medium · AI
 📰
Python Excel Automation: Create, Edit, and Format Text Boxes
Automate Excel tasks using Python to create, edit, and format text boxes in spreadsheets
Medium · Programming
Up next
Sentiment Analysis of HBO Euphoria Using NLP | Emotion Detection Across All Episodes & Seasons
Pavithra’s Podcast
Watch →