llm.sql - Run a 640MB LLM on SQLite, with 210MB peak RSS and 7.4 tok/s
📰 Dev.to · aldielshala
I built llm.sql, an LLM inference framework that reimagines the LLM execution pipeline as a series of...
I built llm.sql, an LLM inference framework that reimagines the LLM execution pipeline as a series of...