This Shouldnโt Be Able to Run 120B Locally
I paired a tiny AI box with the MacBook Neoโand it seriously changed what I thought was possible with local AI.
Tiiny box: https://tiiny.ai
๐ My favorite external drive (dependable): https://amzn.to/3Os9Wi3
๐ Thunderbolt 4 dock: https://amzn.to/3yVRicC
โก *Other gear I use:* https://www.amazon.com/shop/alexziskind
๐ฅ Related Videos ๐ฅ
๐งฌ๐ Mac Studio CLUSTER vs M3 Ultra ๐คฏ - https://youtu.be/d8yS-2OyJhw
๐งณ๐งฐ Mini PC portable setup - https://youtu.be/4RYmsrarOSw
๐๐ป Dev setup on Mac - https://youtu.be/KiKUN4i1SeU
๐ธ๐ง Cheap mini runs a 70B LLM ๐คฏ - https://youtu.be/xyKEQjUzfAk
๐งช๐ฅ RAM torโฆ
Watch on YouTube โ
(saves to browser)
DeepCamp AI