📰 Reddit r/LocalLLaMA

Measuring PCIe transfer under dual GPU with pipeline & tensor llama.cpp

llama.cpp b9966 for sm-tensor

[not mine] costs

Here's your recipes for models for the most popular hardware

Ultra budget 20GB vram with 448GB/s for $100 bucks.

Performance comparison on full compute performance (Anima) and LLM prompt processing of 5090 (600,475 and 400W) vs 6000 PRO MaxQ shunt modded and water cooled (at 300, 400, 475 and 600W), and 6000 PRO WS/SE (600W).

I benched quad 5060Tis for code generation with Qwen3.6-27B so you don't have to (it's really good)

Is it possible to run Qwen 122B in 64GB ram + 24gb vram ? If so, how ?

actual advice about SLM fine tuning?

I built Flaxeo Image a local desktop ui for stable diffusion cpp

Upgrading from 2x 3090 - what should I add? (2x A6000/5090/48GB 4090?)

CTX: How far can you reasonably go with Qwen 3.6 27B?

Dual 3060 MoE loading issue.

I created a super harmful model ! :D (by tweaking it's J-Space!!!)

I feel like I'm not using my hardware efficiently

Follow-up: what I learned scaling a SQLite/FTS5 patent database from 3.5M to 5.36M records

Why are MoE models so belittled?

Are EPYC CCDs all you need + benchmarks

The U.S. tech industry is increasingly anxious about the rising power and competitive price of open-source AI models from China — and whether the Trump administration will respond with yet another executive order | Politico

Running Qwen3 30B A3B at 50 tok/s on RTX 5060 Ti

Can we reconstruct a closed-source LLM tokenizer using only two oracles from the chat API?

How can i limit reasoning effort on the qwen3.5 and gemma4 models?

Qwen3.6 35B-A3B (Q8_0, no KV quant) single prompt in opencode: "Create a beautiful, relaxing flight simulator in a single html file with mountains, clouds, and endless procedural terrain"

Some testing on RTX Pro 4500 (With Oculink) on PrismaQuant, INT4 Autoround and NVFP4 W4A4 quantized model