Traditional data centers designed for 8–12 kW/rack cannot support GB200 NVL72 systems at 132 kW — an 11× increase. AI workloads have increased per-rack thermal density by 8–15× in five years, forcing complete infrastructure redesign across all tier-1 hyperscale campuses.
DLC Now Mandatory
Direct Liquid Cooling deployments in AI clusters grew 118% YoY in 2025. GPU junction temperatures drop from 85–95°C under air cooling to 50–65°C under DLC, eliminating thermal throttling. Every major GPU vendor now ships with integrated cold-plate mounting — making DLC the default, not the exception.
Nuclear Power Race
Grid interconnection queues average 5.2 years in PJM markets, forcing AI campuses off-grid. Microsoft (Three Mile Island), Google (Kairos SMR), and Amazon (Talen Energy) have committed to nuclear. The SMR procurement pipeline exceeds $40B as of Q1 2026, with first operational units expected 2029–2031.
Structural Shift · 2024–2026
AI data center power demand reached 62 GW of global installed capacity in 2026 — up 31% versus 2024. U.S. AI data centers are projected to consume 9.1% of total national electricity generation by 2030 (up from 4.1% in 2024). Best-in-class hyperscale PUE has improved to 1.09, but the industry average remains 1.40, creating significant efficiency headroom — and cost opportunity — for operators adopting liquid-first architectures.
Castle Rock Digital
HPC-AI Market Intelligence Series · 2026
Module 03 · Facilities, Power & Cooling
01 Storage
02 Systems
03 Facilities
04 Quantum
05 Processing
06 Interconnects
07 Memory
08 TCO
Cooling Technologies · Vendor Landscape · 2031 Outlook
Cooling Technology Comparison — 2026
Key parameters · max density · PUE · deployment share
Method
Max Density
PUE Range
2026 Share
Cost Premium
Air CoolingCRAC / CRAH / in-row
≤20 kW
1.35–1.65
26%
Baseline
Direct Liquid (DLC)Cold plates + CDUs
≤132 kW
1.10–1.25
55%
1.4–1.8×
Single-Phase ImmersionMineral oil tanks
≤200 kW
1.04–1.10
8%
3.5–4.5×
Two-Phase ImmersionDielectric fluid + vapor
200+ kW
1.02–1.06
5%
4–6×
Hybrid (Air + DLC)Cold plates + rear-door RDHx
≤80 kW
1.18–1.35
6%
1.1–1.4×
Rear-Door HX (RDHx)Passive heat capture
≤40 kW
1.25–1.45
Residual
1.1–1.3×
Top Vendor Revenue — 2026E
Power infrastructure + cooling market ($B)
Market Forecast 2026–2031F
Power infrastructure + cooling systems ($B)
PUE Improvement Trend 2020–2026F
Industry avg vs hyperscale AI vs DLC clusters
▲ Bull Case · 2031
$112B
~25% CAGR
AGI-scale training demands emergency power procurement; immersion cooling industrializes ahead of schedule; SMR deployments accelerate; sovereign DC buildouts exceed $12B.
◆ Base Case · 2031
$89B
18.7% CAGR
Sustained AI build pace; DLC becomes universal default by 2028; sovereign clusters proceed as planned; 800G ramp on schedule; nuclear first units online 2030–2031.
▼ Bear Case · 2031
$68B
~13% CAGR
AI CapEx cycle slows post-2027 as scaling laws plateau; hyperscaler build pace normalizes; liquid cooling adoption slows due to cost and retrofit complexity.
Access the Full Facilities, Power & Cooling Module
Complete analysis of cooling technology economics, power infrastructure investment, PUE benchmarking, site selection drivers, nuclear and alternative energy procurement, sovereign data center buildouts, and vendor competitive positioning through 2031.