跳到正文
NVIDIA Blog· Hannah Coutand·· 3 小时前精选AI 评分65

NVIDIA 发布 Vera CPU,称智能体吞吐与速度兼顾优于 x86

Vera Delivers the Best of Both Worlds: Highest Throughput and Fastest Agents

AI 导读

NVIDIA 官方宣布 Vera CPU 在 100 兆瓦数据中心对比中,性能同时超过最快的 x86 CPU 和能效最优的 x86 CPU,每瓦可多支持 1.6 倍智能体,智能体速度较能效最优 x86 CPU 快 2 倍。早期客户测试中,Perplexity 的智能体编程任务快 1.5 倍并计划部署,DeepInfra 的智能体编排达到最优 x86 处理器最高 2.2 倍速度。

AI 生成摘要 · 以原文为准

关注理由

官方公布了 Vera CPU 的智能体负载对比数据与 Perplexity、DeepInfra 等早期客户测试结果,可用于跟踪其在 AI 工厂中的部署进展。

正文 · 原文

AI agents do more than generate answers. They search for information, query databases, write and test code and take action. 

Each of those steps relies on a CPU, with agents moving between GPU reasoning and CPU execution throughout a task. 

As businesses put more agents to work, AI factories need CPUs that can execute those steps quickly and support many agents at once, all within the limits of available power.

What this means: AI infrastructure providers need to support more agents without making each one wait longer to get work done. And critically, AI factories are power limited. This means operators need to choose infrastructure that maximizes the work done for every watt. 

Why it matters: NVIDIA Vera delivers both fast agent performance and high capacity per watt within a single CPU. That gives providers one CPU for a range of agent workloads, rather than having to mix and match fast and dense x86 parts to balance speed and capacity.

The data that proves it: In a 100-megawatt data center comparison, NVIDIA found that a single Vera CPU performs better than the fastest x86 CPU and the most energy-efficient x86 CPU.

  • Vera delivers industry-leading agent speed while enabling 1.6x more agents per watt versus the fastest x86 CPU.
  • Vera delivers 2x faster agent speed with leading energy efficiency compared with the most energy-efficient x86 CPU.

Partners are already putting Vera to work. Early adopters see the same exceptional performance in production-style tests:

  • Perplexity: Ran agentic coding tasks 1.5x faster with Vera than on traditional CPUs. Perplexity plans to deploy Vera in an upcoming production system.
  • DeepInfra: Delivered up to 2.2x speed of the best x86 processor on agentic orchestration for its production agent workload, achieving the fastest of the four architectures tested.
  • ClickHouse: Its standard binary, with no Vera-specific tuning, scaled near-linearly across 176 cores and topped the ClickBench hardware leaderboard.
  • DuckLabs: Achieved about 1.5x the median TPC-H SF1000 performance of an Intel Xeon 6 baseline.
  • Daytona: Brought 1,000 agent sandboxes online in 10.8 seconds, and achieved 12.7 completed jobs per second at 2,000 concurrent sandboxes, using Vera versus 88.4 seconds with x86.
  • Modal: Achieved up to 2x sandbox throughput per core versus comparable x86 hardware, with gains that grow under heavy load.

Learn more about the NVIDIA Vera CPU.

来源:NVIDIA Blog · blogs.nvidia.com