• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
Technology

AMD packs 72 Instinct GPUs and 31TB of HBM4 into one Helios rack

The rack-scale system combines more than 18,000 CDNA 5 compute units with 4,600 Zen 6 CPU cores for large AI workloads.

AMDAM
1 Source, 13d ago, first seen 13d ago

TLDR

AMD's Helios rack-scale system links 72 Instinct MI455X accelerators into one compute domain. The company lists more than 18,000 CDNA 5 GPU compute units, 4,600 Zen 6 CPU cores and 31TB of HBM4 memory in a single rack. Each MI455X provides 432GB of HBM4 and up to 23.3TB/s of memory bandwidth, while an all-to-all UALoE fabric connects the GPUs in one hop. These are AMD's architecture specifications and positioning, not independent performance results.

Combined views

41.7K

1 Source, first seen 13d ago

801 likes25 comments64 saves85 reposts

Combined views

41.7K

1 Source, first seen 13d ago

801 likes25 comments64 saves85 reposts
An AMD Helios rack-scale AI system shown in an AMD product video.
Image: AMD

AMD is promoting Helios as a single-rack AI system that combines 72 Instinct MI455X accelerators, more than 18,000 CDNA 5 GPU compute units and 4,600 Zen 6 CPU cores.

Featured Source

The company also lists 31TB of HBM4 memory for the rack. Those figures describe the combined resources across the system, not 18,000 individual GPUs.

A shared 72-GPU compute domain

Each Instinct MI455X contains 432GB of HBM4 memory and offers up to 23.3TB/s of memory bandwidth, according to AMD. Helios connects 72 of those accelerators through an all-to-all UALoE fabric, allowing any GPU to communicate with another in a single hop.

That architecture is designed to keep large model weights, context windows and inference caches close to the accelerators while reducing the cost of moving data across the rack. AMD also uses a chiplet design that separates compute, cache, memory and I/O functions across specialized dies.

The scale claim still needs workload results

AMD positions Helios for training and serving large AI models, including agentic systems that need substantial memory and fast communication between accelerators. The company says its CDNA 5 architecture adds lower-precision data types and data-movement features intended to improve throughput and efficiency.

The published specifications establish the system's capacity and topology, but they do not by themselves show how Helios will perform on a customer's model, software stack or power budget. Those comparisons will depend on production systems and workload-level testing.

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Related

AMD says “another Helios system enters the wild” in post tagging OpenAI

AMD said in an Oct. 1 X post that “another AMD Helios system enters the wild” and that Vamsi Boppana and Uday Ruddarraju visited for a lab tour last week. The post tagged OpenAI, but it did not establish that OpenAI is operating the system.

AMD Instinct MI355X reportedly posts ~42% lower p99 latency in RAG testing against Nvidia HGX B200

AMD says Signal65’s RAG testing, hosted via TensorWave, found the MI355X had roughly twice the concurrent-user headroom before breaching the evaluated SLA.

Advertisement featuring text promoting enhanced performance for enterprise AI. Highlights include approximately 42% lower P99 latency and around 2x concurrent-user headroom. The AMD logo is displayed at the bottom.
Autonomous AI agents’ potential to free up time for innovation

AMD shared CTO Mark Papermaster’s perspective on agentic AI: autonomous agents can run tasks in parallel.

1 Source

AMD@AMDThis is what it takes to run agentic AI at scale. Helios delivers over 18,000 CDNA 5 GPU compute units, 4,600 Zen 6 CPU cores and 31 TB of HBM4 memory. All in a single rack. Looking back at #AdvancingAI with Dr. Lisa Su.13d
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI

    1 Source

    AMD@AMDThis is what it takes to run agentic AI at scale. Helios delivers over 18,000 CDNA 5 GPU compute units, 4,600 Zen 6 CPU cores and 31 TB of HBM4 memory. All in a single rack. Looking back at #AdvancingAI with Dr. Lisa Su.13d
    AMD
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet