Rack Power Is Rising Fast. Here’s What It Means for Data Centers
AI-heavy deployments are driving higher per-rack loads and new requirements for power delivery, liquid cooling, and structural planning.
Rack power density, the amount of sustained power each server rack draws, has been rising sharply due to AI workloads and space constraints, with average loads increasing from 6.1 kW in 2016 to 26 kW in 2026. Higher-powered racks generate more heat and require more electricity delivery, creating challenges for data center power systems, cooling infrastructure, and building structures that were designed for lighter equipment. Advanced cooling technologies like liquid cooling can support denser racks but introduce new maintenance requirements and costs. Data center operators should now plan for higher per-rack power draw by upgrading their power delivery systems, adopting liquid cooling strategies, and reinforcing building structures to handle heavier equipment.
One short email a day with the stories that matter. Free. Unsubscribe with one click.
Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.
Browse AI courses on Maven
Google Unveils TPU 8i Max and TPU 8tx: A Dual-Chip TPU and a Confidential TPU
Google has added two new systems to its eighth-generation TPU lineup. TPU 8i Max targets massive context windows and rack density. TPU 8tx targets secure, confidential inference. Google TPU 8i Max is a dual-chip package built from 2 TPU 8i chips. Both arrive alongside TPU 8t and TPU 8i, announced in April. TL;DR Size: TPU 8i Max = 2 TPU 8i chips in 1 package. TPU 8tx = TPU 8t silicon plus 5th Gen AMD EPYC hosts. Runs on: Google Cloud TPU systems. Performance: 8i Max doubles TPU 8
Also reported by Data Center Knowledge
Why the data center you dread might never even be built
The data center boom is running into serious real-world obstacles, from widespread local opposition and permitting delays to a scramble for electricity. Before those challenges even come into play, though, there’s a more basic problem: A lot of the projects being announced may never get built in the first place. With billions of dollars in AI infrastructure […]
How backlash and red tape continue to slow data centers post-Blue Wave
The data center boom is running into serious real-world obstacles, from widespread local opposition and permitting delays to a scramble for electricity. Before those challenges even come into play, though, there’s a more basic problem: A lot of the projects being announced may never get built in the first place. With billions of dollars in AI infrastructure […]
AMD Launches Epyc SP7, Helion as AI Rack Demand Rises
AMD has begun shipping sixth-gen Epyc servers and is rolling out Helion AI racks, signaling a bigger push into enterprise and agentic AI infrastructure.
Google broadens its AI hardware portfolio with two new specialized chips
Google's new tensor processing units (TPUs) broaden its chip portfolio to more use cases: confidential model training and more memory capacity.
Anthropic joins AI’s natural gas frenzy, buys $3.4B worth of turbines
Anthropic bought billions of dollars worth of natural gas turbines in a deal that could give it buyer's remorse.