AMD’s Threadripper Halo: AI Juggernaut for the Affluent
Attention, machine learning experts! AMD has just introduced a new powerhouse, pieced together from spare parts, and it’s targeting the premium AI workstation market. Introducing the Threadripper Halo, which dishes out an impressive 576 GB of HBM3e memory. Revealed at IFA 2026, this machine is set to launch next year and represents AMD’s initial attempt to integrate its Instinct accelerators into a workstation. However, temper your excitement, as we’ve encountered similar setups previously.
What’s Inside?
This liquid-cooled marvel features a 96-core Threadripper PRO 9995WX, which made its debut in 2025. It comes with a staggering 2 TB of DDR5 memory and a total of 2.6 TB of system memory. Tailored specifically for researchers, the system can accommodate up to four of AMD’s PCIe-based Instinct GPUs – though only two were showcased at IFA.
High-Performance Instinct GPUs
Now, let’s discuss the GPUs. Launched in May, the MI350P is essentially a compact version of an MI350X designed for PCIe format. Each of these dynamic accelerators includes 144 GB of rapid HBM3e, delivering 4 TB/s of memory bandwidth and reaching up to 4.6 petaFLOPS of FP4 computing power. But wait, that’s at its 600 W configuration. Within the Threadripper Halo, anticipate them to operate slightly cooler at 450 W.
Extensive Memory for Extensive Models
Overall, the Threadripper Halo claims up to 576 GB of HBM3e and 16 TB/s of memory bandwidth, enabling it to manage models with a trillion parameters entirely in GPU memory. With some model components shifted to system memory, it should even tackle giants like Moonshot.AI’s 2.8 trillion-parameter Kimi K3. However, don’t fool yourself; this level of capability won’t be affordable and might necessitate adjustments to your electrical configuration.
Cost and Power Considerations
AMD remains tight-lipped about pricing, but estimates suggest it could range from $100,000 to $150,000. A fully equipped quad MI350P configuration might push a typical North American outlet to its limits unless AMD reduces the power from 600 W to 300 W or requires a 20-amp circuit. Perhaps that’s the reason the demonstration at IFA featured only two GPUs.
Competing with Nvidia
In this pricing tier, AMD’s latest device competes with Nvidia’s premium AI system, the DGX Station. This unit was revealed back at GTC in 2025 and includes a 252 GB B300 GPU, a 72-core Grace CPU, and 496 GB of LPDDR5x memory, all for approximately $100,000, if available.
AMD claims the Threadripper Halo has up to 3.4 times the total system memory and over double the memory bandwidth of the DGX Station, which could provide a competitive advantage in large language model inference—assuming the CPU’s PCIe bus can handle tensor parallel operations efficiently.
Launch Timeline
Stay tuned, as AMD has indicated that the Threadripper Halo is scheduled to be released next year.
Conclusion: A Beast for Your Workspace, If You Can Afford It!
AMD’s Threadripper Halo is a formidable AI powerhouse with a price that reflects its capabilities. Ideal for those with substantial resources and a solid power supply. It’s a challenge to Nvidia that delivers substantial performance, but ensure you’ve got the energy to support it!
