Running a 180B parameter LLM on a single Apple M2 Ultra

📰 Hacker News · tbruckner

Running a 180B parameter LLM on a single Apple M2 Ultra. 141 comments, 255 points on Hacker News.

Published 7 Sept 2023
Read full article → ← Back to Reads