This Shouldnโ€™t Be Able to Run 120B Locally

Alex Ziskind ยท Beginner ยท๐Ÿง  Large Language Models ยท1w ago
I paired a tiny AI box with the MacBook Neoโ€”and it seriously changed what I thought was possible with local AI. Tiiny box: https://tiiny.ai ๐Ÿ‘€ My favorite external drive (dependable): https://amzn.to/3Os9Wi3 ๐Ÿ‘€ Thunderbolt 4 dock: https://amzn.to/3yVRicC โšก *Other gear I use:* https://www.amazon.com/shop/alexziskind ๐ŸŽฅ Related Videos ๐ŸŽฅ ๐Ÿงฌ๐Ÿ Mac Studio CLUSTER vs M3 Ultra ๐Ÿคฏ - https://youtu.be/d8yS-2OyJhw ๐Ÿงณ๐Ÿงฐ Mini PC portable setup - https://youtu.be/4RYmsrarOSw ๐ŸŽ๐Ÿ’ป Dev setup on Mac - https://youtu.be/KiKUN4i1SeU ๐Ÿ’ธ๐Ÿง  Cheap mini runs a 70B LLM ๐Ÿคฏ - https://youtu.be/xyKEQjUzfAk ๐Ÿงช๐Ÿ”ฅ RAM torโ€ฆ
Watch on YouTube โ†— (saves to browser)
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Next Up
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)