The cloud was an excellent name. It suggested lightness, distance, and the absence of anyone arriving with a wrench. Then the machines became sufficiently powerful that the discussion returned to coolant temperatures.
NVIDIA’s June explanation of liquid cooling describes an architecture designed to capture heat at components and move it through liquid loops. The company emphasizes warmer operating coolant and, in suitable designs and climates, reduced reliance on mechanical chilling and evaporative cooling. Those qualifications matter: this is not a claim that every AI facility consumes no water or that all locations have identical economics.1
The metaphor has reached the plant room
Behind that interaction is equipment performing work. Equipment uses energy and produces heat. That heat has to go somewhere. The systems handling it require design, installation, operation, and maintenance.
The physical plant follows the workload whether or not it makes the keynote. Cooling is especially difficult to postpone until the business model becomes clear.
Efficiency is a ratio, not a disappearance
A machine can use less energy per task while a growing fleet uses more energy in total. Both statements can be true on the same electricity bill.
To assess an efficiency claim, keep the unit attached to it. Per chip, per rack, per task, and across the facility will give you different answers.
“Can reduce cooling demand in this design” is less portable than “AI solved water.” It is also considerably more informative.
Geography has rejoined the meeting
A facility operates in a place. Ambient conditions, available power, water systems, land, and neighboring uses can affect what designs make sense.
This means the same equipment can sit inside different operational stories. A cooling approach suitable for one climate may need additional support in another. A proposed use for waste heat depends on whether someone nearby needs it when it is available.
The overlooked people in the AI photograph
The public image of AI tends to feature a researcher, a founder, or a person onstage beside a large display. The infrastructure story has other protagonists: the people who design and maintain electrical systems, cooling loops, controls, and physical facilities.
A prompt takes seconds to type. The equipment serving it has a maintenance schedule, a power connection, and people who have to turn up when something leaks.
Follow the heat
One advantage of the physical layer is that it resists vague claims. Heat must be managed. Equipment must operate within limits. A facility must continue functioning after the presentation team leaves.
The cloud has a plant room. Someone should know where the key is.