Your local LLM is 10x slower than it should be

Alex Ziskind · Beginner ·🧠 Large Language Models ·11:02 ·3mo ago

Skills: LLM Foundations90%LLM Engineering70%

Here's the one change that took mine from ~120 tok/s to 1200+ without a new GPU. TryHackMe just launched Cyber Security 101 ...

Watch on YouTube ↗ (saves to browser)

Sign in to unlock AI tutor explanation · ⚡30

More on: LLM Foundations

View skill →

Getting Started with Vertex AI Gemini 1.5 Flash

I TRAINED AN AI TO SOLVE 2+2 (w/ Live Coding)

I TRAINED AN AI TO SOLVE 2+2 (w/ Live Coding)

How to use the ChatGPT API with Python!!

How to use the ChatGPT API with Python!!

Nicholas Renotte

Gemini 2.5: Create an interactive plot of economic data

Gemini 2.5: Create an interactive plot of economic data

Google DeepMind

LangChain Chatbots: Building a Personalized AI Assistant

LangChain Chatbots: Building a Personalized AI Assistant

Analytics Vidhya

Auto-generating meeting notes with Python

Auto-generating meeting notes with Python

Related AI Lessons

Build AI Compliance SaaS with RAG

Build a scalable AI-powered compliance monitoring SaaS with RAG and regulatory alerts to help businesses stay on top of regulatory changes

How We Cut LLM API Costs by 94%: A 3-Layer Caching Strategy

Cut LLM API costs by 94% using a 3-layer caching strategy without sacrificing quality or performance

I Asked AI to Teach Algebra. The First Result Was Slop. Here’s How We Fixed It.

Learn how to improve AI-generated educational content by refining prompts and fine-tuning models, as demonstrated by a project to create an AI-generated algebra course

Medium · Machine Learning

AI Is Like a Super Smart Toy Box — But It Still Needs You

Discover how AI can augment human capabilities, but still requires human input and oversight to function effectively

5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems

Dave Ebbelaar (LLM Eng)