llama.cpp b9966 for sm-tensor
📰 Reddit r/LocalLLaMA
B9966 If you run -sm tensor in production you might want to grab this fix which removes 29 regex recompilations per tensor per token on the decode thread. Claude tell me in one sentence what this means: The code was rebuilding 29 regex patterns from scratch on every tensor of every token instead of building them once and reusing them, so the fix just caches them — same
DeepCamp AI