SemiAnalysis· @SemiAnalysis_ · X·· 4 小时前AI 评分41
AI 导读
SemiAnalysis 本周播客由 Max、Andrew 和 Jordan 讨论 AI 基准测试为何失效,并解读 GDPx:14 家专业数据合作方提供覆盖 11 个领域的真实任务。节目还谈及首批万亿美元 AI 收入将集中于少数领域、GPT-6 Astra 因拒绝所有任务在 cyber 测试得 0 分,以及 Anthropic 是否已在用 Mythos 4。
AI 生成摘要 · 以原文为准
正文
Are the most popular AI benchmarks trash? 🚨
"Anyone who looks at data, like definitely knew that the benchmarks are broken."
Max (@maxkan) and Andrew (@AndrewMegalaa) join Jordan (@JordanNanos) this week to unpack GDPx: 14 specialized data partners supplying real tasks across 11 domains, why the first trillion dollars of AI revenue will be concentrated in a few of them, GPT-6 Astra scoring zero percent on cyber because it refused every task, why "half of it right" fails, and whether Anthropic is already on Mythos 4.
来源:SemiAnalysis · x.com