DGX Station GB300 Cluster: Two 400G DACs, and Frontier Models (www.storagereview.com)

Recent tests have revealed significant enhancements in performance and scalability for NVIDIA's DGX Station GB300 cluster, which allows two individual stations—the ASUS ExpertCenter Pro ET900N G3 and the HP ZGX Fury AI Station—to communicate through dual 400G direct attach copper cables. Bridging these stations not only demonstrated the ability to achieve near-complete bandwidth utilization (98% of 800 Gb/s) for data-intensive AI workloads but also showcased the enhanced throughput for complex models. Notably, the GLM-5.3 model observed a staggering increase in output tokens processed per second, jumping from 188 to 5,018 tokens when split across the dual stations and leveraging tensor parallelism and disaggregated inference techniques. This development is crucial for the AI/ML community, as it confirms the practical scalability of high-performance computing environments tailored for AI applications. With NVIDIA's clear step-by-step clustering guide, users can efficiently expand their computational capabilities on-demand, ensuring they can handle larger models without facing performance bottlenecks. The integration of advanced networking through the ConnectX-8 SuperNIC not only enhances data transfer rates but also simplifies the setup process, making these systems more accessible for researchers and enterprises looking to push the boundaries of AI workloads.