Inferact 与 Google 提交首个 TPUv7 Kimi K3 2.8T 模型初步提交版本,凭借 megakernel 方案,在超高交互性场景下对ety外部客户实现了对标 GB200 NVL72、B300 和 MI355 的强劲每 TCO 性能。该提交由 vLLM 开发方 Inferact 端到端主导,采用 TorchTPU vLLM 技术栈完成,凸显外部算力平台对强大社区生态的重视。
AI 生成摘要 · 以原文为准
BREAKING NEWS🚨: @Inferact & Google submit their FIRST preliminary TPUv7 Kimi K3 2.8T Model Submission, and it is already delivering strong perf per TCO against GB200 NVL72, B300, and MI355 in the ultra-high-interactivity regime due to their megakernel approach for external customers.
One of the most important aspects of an external compute platform is a strong community, and what makes this submission special is that Inferact (Makers of vLLM) led the submission end to end using the TorchTPU vLLM stack.👇️(1/6)🧵
来源:SemiAnalysis · x.com