AMD and Cerebras join forces against Nvidia’s Groq LPUs
GPUs are great for training, but for inference, you need a heavy dose of speedy memory to churn out the tokens. AMD has tapped Cerebras Systems to develop a disaggregated compute platform combining Instinct GPUs with the chip startup's SRAM-powered AI accelerators. The goal: to deliver ultra-low-latency inference for agentic workloads.
The collaboration, announced on stage during AMD CEO Lisa Su's Advancing AI keynote Thursday, closes a gap in AMD's portfolio that cost Nvidia $20 billion to acquihire from Groq back in December.
Cerebras CEO and cofounder Andrew Feldman is no fan of Nvidia, having previously denigrated the GPU giant as a mere AI arms dealer. And unlike GPUs, Cerebras' wafer scale engines (WSE) don't rely on HBM4 but instead use on-chip SRAM that's orders of magnitude faster.
REG AD
This has made Cerebras one of the fastest inference providers in the world, with output speeds often exceeding 2,000 tokens a second.
REG AD
By running compute-heavy prompt processing operations on AMD's Instinct GPUs and offloading the memory intensive token generation to Cerebras' WSE accelerator, the duo aims to achieve higher interactivity without compromising on throughput or cost to do it.
“What you have with Instinct and the Helios rack is you have the leader in performance and memory capacity. And you marry that with our Wafer Scale Engine, which is the leader in SRAM and in memory bandwidth, and that combination allows us to deliver a solution that is unmatched,” Feldman said on stage.
Neither company has shared specific figures, but the combination is expected to boost the number of tokens per second generated per watt of electricity consumed by as much as 5x.
If any of this sounds familiar, Cerebras' accelerators fill the same role as the Groq 3 LPUs (Language Processing Units) announced alongside Nvidia's Vera Rubin rack systems at GTC in March.
But where Nvidia needs two thousand Groq LPUs worth of SRAM to serve a trillion-parameter model like Kimi K2.5, AMD and Cerebras will need at most a few dozen.
The combined offering will be available in Cerebras Cloud later this year, but may not be AMD's last deal with the upstart.
MORE CONTEXT
- AMD attacks the rack with Helios systems that rival Nvidia's
- Intel-backed AI chip startup SambaNova breathes new life into aging Nvidia GPUs in latest benchmarks
- AMD’s Ryzen AI Halo makes local AI look easy, but at $4K, easy doesn't come cheap
- Qualcomm's proposed solution to catch up in AI infra: Bury the compute under the DRAM
-
off-prem Anyone with a shed, an extension cord, a couple of GPUs and an overdraft is building datacenters. Fujitsu just offloaded five
-
security Linux kernel team publishes 432 CVEs in two days
-
AI AND ML OpenAI admits it was the source of the agent swarm that attacked Hugging Face
-
off-prem AWS customer learns the hard way how even the smallest oversight can be mission-critical
-
columnists Airbus takes flight from AWS. What happens next is critical - SYSTEMS AMD and Cerebras join forces against Nvidia’s Groq LPUs The enemy of my enemy is my friend
- AI and ML Codeberg gives vibe-coded projects the toss, promotes human FLOSS AI no longer welcome in human-focused community
- Systems AMD attacks the rack with Helios systems that rival Nvidia's Spec for spec, the House of Zen's first rack-scale AI compute platform is bigger and faster than Nvidia's Vera Rubin by nearly every metric, but that's only on paper
- DEVOPS Model Context Protocol prepares to break with its stateful past Biggest overhaul since launch ditches sessions, guts little-used features, and leaves homebrew implementations facing a slog
- Offbeat Tesla burns through a billion as Musk bets the farm on chips and bots Optimus remains 'very complex' and Robotaxis will try not to flatten your cat
- Security Russians are posing as Signal support to launch phishing attacks PLUS: US takes down Iranian propaganda sites; Marketing company asks 'Why Do We Have Your Information?' And more!
- Security Microsoft patches failed to fix on-prem SharePoint, which is now under zero-day attack PLUS: China upgrades smartphone surveillance tools; Ring eases anti-snooping stance; and more
- Black Hat and DEF CON DEF CON Franklin project enlists hackers to harden critical infrastructure Voting village reports have been so successful, says Jeff Moss, that the whole of DEF CON will now be included
- Security EQT buys majority share in Swiss cybersecurity biz Acronis Went at equivalent of $3.5B+ valuation for entire firm, though portion sold not specified
- Malware Month Ten years since the first corp ransomware, Mikko Hyppönen sees no end in sight On the plus side, infosec's a good bet for a long, stable career
- GNOME can look like Windows – and Flashback can do it without extensions New 'Simple-taskbar' is an option, but there's a simpler, stabler way
- A moment of silence, please, for the final release of Debian on x86-32 New Debian versions hit FOSSland in the form of 13.6 and 12.15
- Baddies caught exploiting extensions bugs with perfect 10 scores on vulnerable Joomla websites Flaws in iCagenda, Balbooa Forms extensions can impact open source CMS that powers a million sites worldwide
- Frame: A new X11 server – implemented directly in assembly Joins yserver, Phoenix, and of course XLibre – and outlier Arcan
- Cinnamon 6.8 will support Wayland – if you want it Next version of Linux Mint’s desktop has both kinds of display server
- KDE Plasma users face a dire omen of change: 6.6.6 arrives 6.7 is now current, and in 6.8 you're getting Wayland whether you like it or not
“There are lots of ways to get workload-specific acceleration done, and I think Cerebras has a very interesting technology. It works very well with Helios,” Su said during a press conference following the keynote. “The idea of our open ecosystem is frankly that we will work with a number of different companies that may have technology that could be useful.”
“You can expect that we're going to do more workload disaggregation going forward,” she added. ®
[](https://www.facebook.com/sharer.php?u=https%3A%2F%2Fwww.theregister.com%2Fsystems%2F2026%2F07%2F23%2Famd-and-cerebras-join-forces-against-nvidias-groq-lpus%2F5277817) [](https://twitter.com/intent/tweet?url=https%3A%2F%2Fwww.theregister.com%2Fsystems%2F2026%2F07%2F23%2Famd-and-cerebras-join-forces-against-nvidias-groq-lpus%2F5277817) [](https://www.linkedin.com/sharing/share-offsite/?url=https%3A%2F%2Fwww.theregister.com%2Fsystems%2F2026%2F07%2F23%2Famd-and-cerebras-join-forces-against-nvidias-groq-lpus%2F5277817) [](https://bsky.app/intent/compose?text=AMD%20and%20Cerebras%20join%20forces%20against%20Nvidia%E2%80%99s%20Groq%20LPUs%0Ahttps%3A%2F%2Fwww.theregister.com%2Fsystems%2F2026%2F07%2F23%2Famd-and-cerebras-join-forces-against-nvidias-groq-lpus%2F5277817) [](https://www.reddit.com/submit?url=https%3A%2F%2Fwww.theregister.com%2Fsystems%2F2026%2F07%2F23%2Famd-and-cerebras-join-forces-against-nvidias-groq-lpus%2F5277817&title=AMD%20and%20Cerebras%20join%20forces%20against%20Nvidia%E2%80%99s%20Groq%20LPUs) [](https://api.whatsapp.com/send?text=AMD%20and%20Cerebras%20join%20forces%20against%20Nvidia%E2%80%99s%20Groq%20LPUs%0Ahttps%3A%2F%2Fwww.theregister.com%2Fsystems%2F2026%2F07%2F23%2Famd-and-cerebras-join-forces-against-nvidias-groq-lpus%2F5277817)
REG AD