AMD is preparing to launch the Ryzen AI Halo, a Mini-PC tailored for local artificial intelligence development. Positioned as a contender against Nvidia's specialized hardware and Apple's Mac Studio, this device offers a Windows-based alternative aimed at AI developers.
Utilizing the Strix Halo platform, the Ryzen AI Halo incorporates high-performance components traditionally found in laptops and Mini-PCs. It is powered by the AMD Ryzen AI Max+ 395 APU, which features a 16-core Zen 5 CPU capable of 32 threads, with a base frequency of 3.00 GHz and a boost up to 5.10 GHz. This APU is produced by TSMC using a 4 nm process and supports AVX-512, contributing to its performance in demanding workloads.
In terms of raw performance, the Ryzen AI Halo can deliver up to 126 trillion operations per second (TOPS), allowing it to run models with as many as 200 billion parameters locally. Under certain configurations, it can process up to 235 billion parameters. Despite these capabilities, the performance metrics are influenced by various factors including model format and quantization.