跳到正文
SemiAnalysis· @SemiAnalysis_ · X·· 9 天前AI 评分40
AI 导读

SemiAnalysis 测算称,AMD 芯片通过 vLLM 服务开源 Kimi K3 模型,即便计入芯片租金上涨后,每芯片每小时仍可产生最高 3 美元纯利润。Kimi K3 拥有超过 2.8 万亿参数,可充分利用 AMD 单芯片 288GB 显存。

AI 生成摘要 · 以原文为准

正文

PROFIT ALERT🚨: AMD @vllm_project can generate up to $3/hr/chip in pure profit serving the open-source Kimi K3 model, even after accounting for the rapid increase in chip rental prices post-Claude Code.

Kimi K3 2.8T is a great model for AMD, as it has over 2.8 trillion parameters that can take advantage of AMD's 288GB per chip. B200 CANNOT fit Kimi K3 in a single server, so it has to use tensor parallelism or pipeline parallelism for communication across 400Gbit/s InfiniBand/Ethernet, which is 18x slower than the BW within an NVLink domain.

来源:SemiAnalysis · x.com