I made a System Calculator for Local LLMs (with Source Code)

📰 Medium · LLM

Learn how to build a system calculator for local LLMs to determine the required system specifications, making it easier to run models without crashes

intermediate Published 28 Apr 2026

Action Steps

Identify the system requirements for running local LLMs
Determine the key factors that affect system performance, such as CPU, RAM, and GPU
Build a system calculator using the provided source code to estimate the required system specifications
Test the calculator with different models and system configurations to validate its accuracy
Use the calculator to optimize system performance and reduce crashes when running local LLMs

Who Needs to Know This

Data scientists and machine learning engineers can benefit from this tool to optimize their workflow and reduce crashes when running local LLMs

Key Insight

💡 A system calculator can help determine the required system specifications for running local LLMs, reducing crashes and optimizing performance

Key Takeaways

Learn how to build a system calculator for local LLMs to determine the required system specifications, making it easier to run models without crashes

Full Article

Title: I made a System Calculator for Local LLMs (with Source Code)

URL Source: https://medium.com/@umerfarooq230/i-made-a-system-calculator-for-local-llms-with-source-code-3bcbebeeaed3?source=rss------llm-5

Published Time: 2026-04-28T20:53:36Z

Markdown Content:
# I made a System Calculator for Local LLMs (with Source Code) | by Umer | Apr, 2026 | Medium

[Sitemap](https://medium.com/sitemap/sitemap.xml)

[Open in app](https://play.google.com/store/apps/details?id=com.medium.reader&referrer=utm_source%3DmobileNavBar&source=post_page---top_nav_layout_nav-----------------------------------------)

Sign up

[Sign in](https://medium.com/m/signin?operation=login&redirect=https%3A%2F%2Fmedium.com%2F%40umerfarooq230%2Fi-made-a-system-calculator-for-local-llms-with-source-code-3bcbebeeaed3&source=post_page---top_nav_layout_nav-----------------------global_nav------------------)

[](https://medium.com/?source=post_page---top_nav_layout_nav-----------------------------------------)

Get app

[Write](https://medium.com/m/signin?operation=register&redirect=https%3A%2F%2Fmedium.com%2Fnew-story&source=---top_nav_layout_nav-----------------------new_post_topnav------------------)

[Search](https://medium.com/search?source=post_page---top_nav_layout_nav-----------------------------------------)

Sign up

[Sign in](https://medium.com/m/signin?operation=login&redirect=https%3A%2F%2Fmedium.com%2F%40umerfarooq230%2Fi-made-a-system-calculator-for-local-llms-with-source-code-3bcbebeeaed3&source=post_page---top_nav_layout_nav-----------------------global_nav------------------)

![Image 1](https://miro.medium.com/v2/resize:fill:32:32/1*dmbNkD5D-u45r44go_cf0g.png)

# I made a System Calculator for Local LLMs (with Source Code)

[![Image 2: Umer](https://miro.medium.com/v2/resize:fill:32:32/1*ynvxBVO1mUXjDIzwXFBAHg.jpeg)](https://medium.com/@umerfarooq230?source=post_page---byline--3bcbebeeaed3---------------------------------------)

[Umer](https://medium.com/@umerfarooq230?source=post_page---byline--3bcbebeeaed3---------------------------------------)

Follow

2 min read

·

1 hour ago

[](https://medium.com/m/signin?actionUrl=https%3A%2F%2Fmedium.com%2F_%2Fvote%2Fp%2F3bcbebeeaed3&operation=register&redirect=https%3A%2F%2Fmedium.com%2F%40umerfarooq230%2Fi-made-a-system-calculator-for-local-llms-with-source-code-3bcbebeeaed3&user=Umer&userId=4bee6e00ed0b&source=---header_actions--3bcbebeeaed3---------------------clap_footer------------------)

[](https://medium.com/m/signin?actionUrl=https%3A%2F%2Fmedium.com%2F_%2Fbookmark%2Fp%2F3bcbebeeaed3&operation=register&redirect=https%3A%2F%2Fmedium.com%2F%40umerfarooq230%2Fi-made-a-system-calculator-for-local-llms-with-source-code-3bcbebeeaed3&source=---header_actions--3bcbebeeaed3---------------------bookmark_footer------------------)

[Listen](https://medium.com/m/signin?actionUrl=https%3A%2F%2Fmedium.com%2Fplans%3Fdimension%3Dpost_audio_button%26postId%3D3bcbebeeaed3&operation=register&redirect=https%3A%2F%2Fmedium.com%2F%40umerfarooq230%2Fi-made-a-system-calculator-for-local-llms-with-source-code-3bcbebeeaed3&source=---header_actions--3bcbebeeaed3---------------------post_audio_button------------------)

Share

I coded the solution of my own problem

Press enter or click to view image in full size

![Image 3](https://miro.medium.com/v2/resize:fit:700/0*xhEQQWNB7F81Wqu_)

Photo by [Solen Feyissa](https://unsplash.com/@solenfeyissa?utm_source=medium&utm_medium=referral) on [Unsplash](https://unsplash.com/?utm_source=medium&utm_medium=referral)

Ever since I have discovered local LLMs from huggingface and Ollama, I have downloaded and ran many of the models, but each time the same problem occurred

## The Problem

Every time I wanted to run a model, My process looked like this:

1. Find a model
2. Get excited about its benchmarks
3. Scroll reddit for reviews and system reqs
4. Ask GPT
5. Try anyway

… and it still crashes after 3 prompts.

The question was same every time. “What should be my syst

Read full article → ← Back to Reads

I made a System Calculator for Local LLMs (with Source Code)

Key Takeaways

Full Article

Related Videos