a16z 的 Moses Sternstein 和 Alex Danco 提出 rack spread 概念，指 GPU 价格上涨与 token 价格下跌之间的缺口。自 7 月中旬以来 B300 GPU 租金上涨 106%，B200 上涨 66%，H100 上涨 17%，平均 token 价格下跌 58%；两人将原因归为开放竞争与模型实验室降价。
AI 生成摘要 · 以原文为准
a16z's Moses Sternstein and Alex Danco on the "rack spread," the gap between rising GPU prices and falling token prices:
"The core observation in the rack spread is as follows: roughly since the summer, GPU pricing has gone up, token pricing has gone down. Why that is: a combination of open competition, the labs themselves cutting prices."
"We start with a bunch of GPUs and a bunch of electricity and a bunch of cooling, and on the other side out comes tokens, right? And the thing that achieves that is the model."
"In an oil refinery, you have a bunch of inputs... It goes into a refinery, which is like the model, and then out come refined products that you can actually use, like jet fuel or diesel or lubricant or any number of specialized things."
"There is this term called the crack spread... It's not a net margin that anybody is actually making... But it is useful because if you look at any given refinery, just like you might look at any given model, you want to ask this basic question which is, 'Is this making any money?'"
@MosesSternstein @alex_danco
The "Rack Spread" is unfolding, token prices are falling while GPU prices climb Change since mid-July: - B300 GPU rentals up 106% - B200 up 66% - H100 up 17% - Average token prices down 58% Charts of the Week: https://www.a16z.news/p/charts-of-the-week-job-fud-fades在 X 查看被引用的帖子
来源：a16z · x.com