📰 Dev.to · SomeOddCodeGuy

5 articles · Updated every 3 hours · View all reads

All Articles 71,577 Blog Posts 101,113 Tech Tutorials 17,384 Research Papers 15,342 News 12,859 ⚡ AI Lessons

Llama.cpp's New MTP on MacOS

Dev.to · SomeOddCodeGuy 2w ago

Llama.cpp's New MTP on MacOS

MTP So I decided to test out the new MTP in llama.cpp on Metal using my M2 Ultra, and...

Building and Running Llama.cpp on an Air-Gapped Mac

Dev.to · SomeOddCodeGuy 2w ago

Building and Running Llama.cpp on an Air-Gapped Mac

If you ever tried to run Llama.cpp on a MacOS device that doesn't have internet on it, you've...

Wilmer Tool Calling

Dev.to · SomeOddCodeGuy 1mo ago

Wilmer Tool Calling

So some year and a half after the request was made for me to put tool calling into Wilmer, I've...

A Quick Note on Gemma 4 Image Settings in Llama.cpp

Dev.to · SomeOddCodeGuy 2mo ago

A Quick Note on Gemma 4 Image Settings in Llama.cpp

In my last post, I mentioned using --image-min-tokens to increase the quality of image responses from...

An Analogy to Help Understand Mixture of Experts

Dev.to · SomeOddCodeGuy 3mo ago

An Analogy to Help Understand Mixture of Experts

If you're having a hard time understanding MoE strength vs dense models, and roughly where they might...