Hacker News · zhisbug
🧠 Large Language Models
⚡ AI Lesson
2y ago
Consistency LLM: converting LLMs to parallel decoders accelerates inference 3.5x
Consistency LLM: converting LLMs to parallel decoders accelerates inference 3.5x. 98 comments, 461 points on Hacker News.