As AI Increases Demands on Memory, Storage Steps Up

At the Future of Memory and Storage conference, NVIDIA presented storage advances aimed at AI factories facing datasets and context windows that exceed system memory. The company argues that storage must provide more than capacity: it must efficiently encrypt, compress, verify and reconstruct data under highly concurrent access. NVIDIA says GPUs can initiate storage requests directly, producing thousands of concurrent operations. In a benchmark described in the blog, the NVIDIA Vera CPU, part of the Vera BlueField-4 STX, delivered up to 3.21x the throughput of an x86 CPU in a two-stage compression workload. The result is vendor-reported and does not by itself establish system-wide gains.