Kioxia developing 100M IOPS SSD for Nvidia (blocksandfiles.com)

Kioxia has announced a collaboration with Nvidia to develop an advanced SSD capable of delivering 100 million IOPS, aimed at enhancing GenAI workloads by operating alongside high-bandwidth memory (HBM) directly connected to Nvidia GPUs, with a planned release in 2027. This initiative involves producing two SSDs that would collectively achieve 200 million IOPS, partially substituting HBM and utilizing the fast PCIe 7.0 interface. Kioxia’s chief engineer highlighted the company's commitment to follow Nvidia's specifications, signaling a tailored approach to meet the needs of AI applications. The significance of this development lies in its potential to revolutionize data processing speeds in AI and machine learning environments, where latency and throughput are critical. Kioxia is exploring different flash technologies, including XL-Flash and its daisy-chained prototypes that have already shown impressive performance metrics, such as 64 GB/s bandwidth. By leveraging advanced architectures, Kioxia aims to provide scalable storage solutions that align with emerging AI demands while challenging the expensive HBM paradigm. As the AI landscape evolves, these innovations may notably improve efficiency and reduce costs in high-performance computing scenarios.