Hacker News · sssummer
1y ago
Show HN: KTransformers:671B DeepSeek-R1 on a Single Machine-286 tokens/s Prefill
Hey Hacker News! We are excited to share the new version of KTransformers, a flexible framework designed for cutting-edge LLM inference optimizations! Leveragin