Mac Studio M5 Ultra: Local Model Citizen Outpaces DGX Spark and Threadripper (www.tomshardware.com)

Apple has launched the Mac Studio with the new M5 Ultra chip, which outperforms Nvidia's DGX Spark and AMD's Threadripper in local AI model handling and general productivity tasks. Featuring a 36-core CPU and an 80-core GPU, the M5 Ultra boasts 1.2 TB/s memory throughput and a unique quad-die architecture that enhances bandwidth between cores. This positions the Mac Studio as a robust option for creative professionals and enterprises, delivering significant performance for video editing, AI workloads, and multi-threaded applications, all within a compact and quiet design. The announcement is noteworthy for the AI/ML community, as the M5 Ultra's capabilities allow for the efficient running of large language models (LLMs) directly on the device, enhancing local AI applications. With its high memory capacity and accelerated processing speeds, it addresses the growing demand for powerful, accessible AI computing solutions. Although the system is expensive and not upgradable post-purchase, it represents a shift in Apple's focus toward high-performance computing, potentially catalyzing a new era for local AI processing tailored for creative and enterprise environments.