Cerebras CS-4

Cerebras CS-4：比 GPU 快 30 倍的机架级 AI 推理方案

HN 315 分 · 作者 sunils34 · 来源 cerebras.ai · HN 讨论

热门评论

1. @9cb14c1ec0 Just a reminder for everyone that we are only several years and 3 or 4 iterations into hardware being optimized for LLMs. We should all expect orders of magnitude improvement in speed and/or cost over the next 5 years. Then we can have fun conversations about "unlimited" "intelligence" and about what the price wars and profit margins of consumer AI products are when your average ChatGPT user costs the company $0.10 per month. "CS-4 delivers more than 1,000 tokens per second on models exceeding 10 trillion parameters" Wow!

⋯ 继续阅读请开通会员 ⋯