Techzine TV podcast

NetApp Novus: solving the AI data bottleneck at exascale

• Coen or Sander • Season 3 • Episode 17

Use Left/Right to seek, Home/End to jump to start or end. Hold shift to jump forward or backward.

0:00 | 28:38

At NetApp INSIGHT in Las Vegas, Techzine TV sat down with Jürgen Hofkens, CTO EMEA at NetApp. We talked about why enterprises are struggling to get the most out of their data for AI. Storage is a major bottleneck, until now. Hofkens talks about the core tension between AI's voracious appetite for data and the practical constraints organizations face when trying to feed that data to GPU clusters at scale.

The conversation centers on NetApp's new Novus architecture, which tackles a fundamental bottleneck: the metadata service. By disaggregating the metadata layer from compute and storage, a concept borrowed from high-performance computing, Novus enables near-infinite namespace scaling using parallel NFS (pNFS) while staying fully ONTAP-compatible. This means enterprises can expose their existing data to neocloud GPU clusters without copying it. They also don't have to sacrifice governance or give up any encryption keys.

Key takeaways:
• Enterprises currently use less than 5% of their data for AI due to structural and throughput constraints
• A cluster of 50,000 GPUs needs 100 TB/s of storage throughput. Today's storage typically tops out at 5 TB/s
• Novus disaggregates the metadata service, removing the architectural bottleneck and enabling exascale namespaces
• Novus runs on ONTAP and uses pNFS (so no proprietary protocols). This makes it compatible with existing enterprise data estates
• Neocloud providers can use ONTAP compatibility as a differentiator to attract enterprise customers
• NetApp's strategy centers on delivering intelligent data infrastructure anywhere: on-premises, hyperscalers, and NeoClouds

Chapters:
2:00 The biggest data trends in the AI era
3:54 Which industries lead in AI data maturity
6:27 Technology challenges: data copies and governance complexity
7:31 The GPU throughput bottleneck: only 5% of data accessible
9:34 Introducing NOVUS: disaggregating metadata for exascale storage
13:13 ONTAP meets NeoCloud: enabling enterprise AI workloads
17:13 Sustained performance and flexible hardware with Supermicro
23:33 The rise of CPUs, AI agents, and enterprise file systems
25:41 Future-proofing with a flexible data architecture