No Cloud, No API Keys: Local Open-Source Coding with Trinity Mini, OpenCode, and MLX

Julien Simon · Intermediate ·🧠 Large Language Models ·3mo ago

Key Takeaways

This video teaches how to run Trinity Mini locally on Apple Silicon using MLX and OpenCode without API keys or cloud services

Original Description

No API keys. No cloud. No per-token cost. Just your Mac. In this video, I show you how to run Arcee AI's Trinity Mini (26B parameters, 3B active) locally on Apple Silicon using MLX, and wire it up to OpenCode as a fully local AI coding assistant. Everything runs on-device — ideal for air-gapped environments, regulated industries, or anyone who wants a private coding AI. I cover the full setup: choosing the right quantization for your hardware, benchmarking generation speed across all quantizations, and configuring OpenCode to talk to the local model. I also check Trinity's results with Claude Code! ⭐️⭐️⭐️ More content on Substack at https://www.airealist.ai ⭐️⭐️⭐️ *** MODELS Arcee Trinity Mini (base) → https://huggingface.co/arcee-ai/Trinity-Mini Trinity Mini MLX 8-bit → https://huggingface.co/mlx-community/Trinity-Mini-8bit Trinity Mini MLX 6-bit → https://huggingface.co/mlx-community/Trinity-Mini-6bit Trinity Mini MLX 4-bit → https://huggingface.co/mlx-community/Trinity-Mini-4bit Trinity Mini on OpenRouter (free) → https://openrouter.ai/arcee-ai/trinity-mini:free *** CODE Full walkthrough + scripts → https://github.com/juliensimon/arcee-demos/tree/main/trinity-mini-mlx *** TOOLS MLX by Apple → https://github.com/ml-explore/mlx mlx-lm (model serving) → https://github.com/ml-explore/mlx-lm OpenCode (terminal coding assistant) → https://opencode.ai Arcee AI → https://www.arcee.ai
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related Reads

📰
Prompts Are Not Dead, Bad Prompts Are. How to write a Perfect Prompt?
Learn to write effective prompts to unlock AI potential, as poor prompts hinder model performance
Medium · Programming
📰
Running LLMs Locally in 2026: The Complete Guide to Benefits, Trade-offs, and Getting Started
Learn how to run LLMs locally in 2026, including benefits, trade-offs, and a step-by-step guide to getting started
Dev.to AI
📰
A Four-Part Prompt Structure for Financial Variance Commentary (That Actually Holds Up)
Learn a four-part prompt structure for financial variance commentary that drives effective analysis and decision-making
Dev.to · Clarity With AI
📰
Unlocking the Power of Open-Weight LLMs: A Developer's Guide to API Integration
Learn to integrate open-weight LLMs into your applications using APIs and unlock their full potential for enhanced language understanding and generation
Dev.to · NovaStack
Up next
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)
Watch →