Nvidia goes green to keep grid capacity from zapping its revenues

Nvidia’s ability to sell GPUs is ultimately limited by how much juice the power grid can provide.

With ever-growing depreciation cycles, it’ll be years before datacenters decommission their aging Hopper or Blackwell systems.

More GPUs mean pulling more power from the grid.

Nvidia can’t exactly force grid operators to add capacity any faster, but it can make it easier for its customers to build smarter and more efficient bit barns.

“At the datacenter scale and at the AI-factory scale, we're literally trying to think about how can we eke out every bit of efficiency to drive more performance per gigawatt,” Dion Harris, senior director of Nvidia HPC and AI Hyperscale Infrastructure Solutions, told El Reg in a recent interview.

At the AI Infra Summit this week, we got our first look at the systems Nvidia has been building to maximize the amount of power available for compute while minimizing the impact of datacenters on the local grid.

Datacenters, as a general rule, rarely operate anywhere close to the peak capacity.

A 100 megawatt datacenter might use at most 80 percent for critical compute loads.

The actual ratios vary from bit-barn to bit-barn, but this provides a buffer for hardware inefficiency, conversion losses, and other spikes in demand.

The downside, of course, is that this leaves 20 megawatts or so of untapped capacity that the datacenter can’t use and the utility can’t reclaim.

Every kilowatt of stranded power is a GPU that Nvidia could have sold, so Nvidia’s DSX platform aims to address both problems.

Minimizing overheads The first of these, which Nvidia calls DSX MaxLPS, is an evolution of an old idea.

If the compute and all the physical infrastructure — power cabinets, batteries, coolant distribution units (CDUs), and chillers — can talk to one another, operators can achieve significant power savings.

For example, if the air handlers had a way of knowing how much power a rack was pulling, they could ramp up and down based on demand rather than running maxed out all the time.