Nvidia's grand plan for speeding up datacenter deployments: AI trailer parks

Posted

Datacenters are taking too long to bring online to fill the demand of the AI boom. So starting in 2027, Nvidia and its partners will offer its Vera Rubin rack systems fully plumbed, wired, and ready for deployment in modular bit barns.

The containers, which Nvidia calls DSX pods, were unveiled at GTC Berlin this week and are essentially the datacenter equivalent of a trailer home.

Built by partners like HPE, Dell, Schneider Electric, and others, each DSX pod will come fully furnished with all the compute, interconnects, electrical, and plumbing a growing AI factory might need.

Just drop the pod on a prepared datacenter site, hook up power, networking, and cooling, and you'll be churning out tokens and raking in profit in no time.

Or that's Nvidia's sales pitch anyway.

Inside the 28 metric ton containers you'll find seven Vera Rubin NVL72 racks packing 504 GPUs and 252 Vera CPUs.

GPUzilla says the pods will cut datacenter deployment times from six months to as little as two weeks because it will validate every fitting, cable, and component before it leaves the factory. The idea being if there is something wrong, it'll get caught there rather than after customers have gone through the trouble of hooking everything up.

And just like a trailer home, Nvidia's DSX pods will be entirely customizable. Prefer HPE over Dell, or Eaton over Schneider? No problem, Nvidia has roped all its buddies into building these compute containers.

And if you ever need more compute, just add another trailer and you've got yourself a double wide, which will surely be the envy of all your neocloud neighbors.

The first DSX pods powered by Nvidia's Vera Rubin rack systems should roll off the production line early next year, and reflect the company's ongoing effort to quash supply chain challenges before they start eating into revenues.

Also at GTC Berlin, Nvidia laid out out new DSX specs for waterless datacenters, which use closed loop coolants and dry coolers rather than water-thirsty cooling towers. This effort builds on work announced at the AI Infra Summit earlier this year, when Nvidia touted its effeorts to squeeze more performance out of less juice, while also allowing bit barns to spin down their workloads in response to changing grid conditions. ®

on-prem