SK hynix and Nvidia formalize joint SSD development to boost AI inference (biz.chosun.com)

SK hynix has announced a formal collaboration with Nvidia to develop a next-generation solid-state drive (SSD) aimed at enhancing AI inference performance. This partnership builds on SK hynix's successful track record of supplying high bandwidth memory (HBM) to Nvidia and signifies a strategic shift towards innovating in the NAND flash sector. The SSD development project, known as "Storage Next" for Nvidia and "AI-N P" for SK hynix, is projected to deliver performance improvements tenfold by 2027, with anticipated input/output operations per second (IOPS) reaching 100 million. A prototype is expected by the end of 2024, reflecting the urgency to address the data handling requirements of modern AI applications. The significance of this development lies in overcoming the limitations of HBM as artificial intelligence transitions from a training focus to real-world inference, where minimizing latency and maximizing data retention are crucial. While traditional DRAM has struggled with bandwidth limitations that lead to GPU bottlenecks, NAND's nonvolatile storage capabilities present a promising solution, particularly for retaining user-specific data essential for personalized AI. SK hynix's strategic initiatives, which include collaborations to establish the high bandwidth flash (HBF) standard, aim to secure a leading role in this evolving memory landscape, thereby enhancing the performance and cost-efficiency of AI-driven technologies in the coming years.