Cerebras 在 8 月 18 日甩出了新一代 AI 加速器 CS-4,直接把推理速度拉到了 GPU 的 30 倍。这不是又一个"PPT芯片",而是真的要在今年 Q3 开始出货的产品。
CS-4 的核心配置很硬核:三颗全新 WSE-3 Turbo 晶圆级引擎,整机提供 750 PFLOPS 算力、129.6 PB/s 内存带宽。在 GPT-OSS-120B 测试中,单用户每秒生成超过 4,400 个 Token,每瓦吞吐量比上代 CS-3 提升 10 倍。
晶圆级架构为什么快
答案很简单——它绕开了 GPU 的根本瓶颈:内存带宽。GPU 做推理的时候,模型权重存在显存里,计算的时候需要不停把权重在显存和计算核心之间搬运。内存带宽就是那个永远不够用的水管。
Cerebras 的思路完全不同:把整颗晶圆当一个芯片用,把模型权重全部常驻在晶圆上的 44GB SRAM 里。SRAM 的速度比 HBM 显存快数量级,而且数据不用"搬家",直接就近计算。CS-4 单颗晶圆有 4 万亿晶体管、90 万个 AI 核心,三颗晶圆通过 Direct Wafer Links 互联,延迟低到 2 微秒。
简单说,GPU 的推理是"一边搬数据一边算",CS-4 是"数据都在这儿了,直接算"。这就是为什么它能快 30 倍。
推理速度是 Agent 时代的胜负手
为什么现在突然所有人都在拼推理速度?因为 Agent 来了。
以前的 AI 应用是"一问一答"模式——用户发一句话,模型生成一段回答。延迟高个几秒,用户可能也就忍了。但 Agent 不一样,它不是生成一次回答就完事了,而是要走一个完整的思考回路:分析问题→调用工具→读取结果→再推理→再调用工具……一个任务可能要跑十几轮推理。
如果每轮推理要等 5 秒,10 轮就是 50 秒。用户早就不耐烦了。但如果每轮只要 0.5 秒,10 轮也才 5 秒,体验就完全不一样了。推理速度直接决定了 Agent 能"想"多少步、能用多少工具。
这也是 Cerebras CTO Sean Lie 说的那句话的真正含义:"快 30 倍,意味着智能体系统有了显著更多的推理和工具使用空间。"
但 GPU 的护城河没那么容易破
Cerebras 很强,但要说撼动 Nvidia 的地位还太早。
第一,生态差距巨大。CUDA 生态发展了十几年,几乎所有 AI 框架和工具都是围绕 GPU 优化的。Cerebras 虽然也支持主流框架,但深度和广度完全不在一个量级。企业客户换硬件,不是换一张卡那么简单——整个软件栈都要跟着调。
第二,通用性问题。晶圆级芯片在推理场景下有绝对优势,但训练呢?多模态呢?更复杂的计算图呢?GPU 虽然在单项上可能不如专用芯片,但它什么都能干。对于大多数企业来说,买一堆 GPU 既能训练又能推理,比买专用推理芯片灵活得多。
第三,商业模式。CS-4 是整机架卖的,客户一买就是一套完整系统,采购门槛极高。而 GPU 的采购是弹性的,从小规模试用到大规模部署,可以一步步来。
所以 Cerebras 的机会不是"干掉 Nvidia",而是在推理这个细分战场上,切下一块 GPU 吃不下的蛋糕——比如对延迟极度敏感的 Agent 应用、超大模型的极速推理服务。
30 倍的速度差距,放在任何领域都是降维打击。但 AI 硬件这门生意,从来不只是比谁快。
明天见。
On August 18, Cerebras dropped its next-gen AI accelerator, the CS-4, delivering inference speed up to 30x faster than GPUs. This isn't another "PPT chip" — it's actually shipping starting Q3 this year.
The CS-4 packs a serious punch: three new WSE-3 Turbo wafer-scale engines, 750 PFLOPS of AI compute per rack, and 129.6 PB/s of memory bandwidth. On GPT-OSS-120B, it generates over 4,400 tokens per second per user, with 10x more throughput per watt than the previous CS-3 generation.
Why Wafer-Scale Is Faster
The answer is simple — it bypasses the fundamental GPU bottleneck: memory bandwidth. When GPUs run inference, model weights live in VRAM and have to be constantly shuttled between memory and compute cores. Memory bandwidth is the pipe that's always too narrow.
Cerebras takes a completely different approach: treat an entire wafer as one chip, and keep the entire model resident in 44 GB of on-wafer SRAM. SRAM is orders of magnitude faster than HBM memory, and the data doesn't have to "travel" — it's computed right where it sits. Each WSE-3 Turbo wafer packs 4 trillion transistors and 900,000 AI-optimized cores, and three wafers are connected via Direct Wafer Links with as little as 2 microseconds of latency.
Put simply: GPUs do inference by "moving data while computing." The CS-4 does it by "data's already here, just compute." That's why it's 30x faster.
Inference Speed Is the New Battleground
Why is everyone suddenly racing on inference speed? Because agents are here.
Previous AI applications were "ask once, answer once" — the user sends a prompt, the model generates a response. A few seconds of delay, and users mostly tolerated it. But agents aren't one-and-done. They run a full loop: analyze the problem → call tools → read results → reason again → call more tools… A single task might run a dozen rounds of inference.
If each round takes 5 seconds, 10 rounds means 50 seconds. Users will have already bounced. But if each round takes 0.5 seconds, 10 rounds is still 5 seconds — a completely different experience. Inference speed directly determines how many steps an agent can "think" and how many tools it can use.
That's the real meaning behind Cerebras CTO Sean Lie's line: "Being 30 times faster gives agentic systems room for significantly more reasoning and tool use."
But the GPU Moat Isn't So Easy to Crack
Cerebras is impressive, but it's still way too early to say it's shaking Nvidia's position.
First, the ecosystem gap is enormous. The CUDA ecosystem has grown for over a decade, and virtually every AI framework and tool is optimized around GPUs. Cerebras supports major frameworks too, but the depth and breadth aren't comparable. For enterprise customers, switching hardware isn't just swapping a card — the entire software stack has to be re-tuned.
Second, versatility matters. Wafer-scale chips have a decisive advantage in inference, but what about training? Multimodal? More complex computation graphs? GPUs may not be the best at any single thing, but they can do everything. For most enterprises, buying a fleet of GPUs that can both train and inference is way more flexible than buying specialized inference chips.
Third, the business model. The CS-4 is sold as a full rack system — a complete turnkey solution with a very high procurement threshold. GPU purchasing is elastic; you can start small and scale up gradually.
So Cerebras's opportunity isn't "killing Nvidia" — it's carving out a piece of the inference pie that GPUs can't easily eat: ultra-low-latency agent applications, lightning-fast inference for frontier-scale models. That kind of thing.
A 30x speed difference is a beatdown in any field. But the AI hardware business has never been just about who's fastest.
See you tomorrow.