Inside the Data Centres Powering AI: A Glimpse into the Physical Infrastructure
AI feels invisible. Yet within test server halls like one in Virginia, it's anything but. "Demented white noise," gold-painted Nvidia racks, and nearly 40 diesel generators await.
July 23, 2026 - 3:02 pm
Image by: Rainier Ehrhardt/Getty Images
AI, seemingly magical, is built on a foundation of noise, heat, metal, and enormous power consumption. Axios’s Amy Harder took a rare tour of a test server hall run by Digital Realty in Ashburn, Virginia—the heart of America’s “data center alley.”
Upon entering, she immediately noticed the "demented white noise" emanating from fans battling the heat generated by racks filled with AI chips. A glass floor revealed cooling pipes beneath her feet.
A single gold-coloured Nvidia system caught her eye. While its colour is aesthetically pleasing, it signifies a $1 million investment.
Data Centres: Boring by Design
For all their value, data centres are designed to be mundane. As Harder puts it, "If excitement is happening inside a data center, something has probably gone wrong."
Their true drama lies in power and cooling systems—substations, water towers, or industrial air conditioners.
A Look at the Numbers
Harder counted nearly 40 diesel generators bolted to one building, intended for backup only. Virginia’s grid primarily relies on gas and nuclear power. The nearby Digital Dulles campus could eventually hold 13 data centres, a bet worth over $10 billion.
Secrecy and Backlash
Accessing these facilities is difficult; some operators refuse tours outright while others demand non-disclosure agreements. This secrecy, Harder argues, fuels a growing backlash from communities concerned about rising power bills and water usage.
She suggests firms could do more to open up without compromising secrets. The buildout continues, with Digital Realty expanding to Singapore, São Paulo, and Johannesburg. AI’s physical footprint is rapidly expanding, largely out of public view.
The less people see of it, the more distrust they seem to develop—potentially a significant flaw for the industry. The data centre industry is undergoing a profound transformation as AI demands ever-increasing computational power. By 2026, the global data centre market size was projected to reach USD 233.51 billion, with AI-driven applications being a primary driver. This growth underscores the need for more efficient cooling systems and sustainable energy sources. One notable trend is the shift towards edge computing, which brings AI processing closer to data sources, reducing latency. This evolution is reshaping data centre design, with smaller, more distributed facilities emerging as a new norm. Additionally, the integration of renewable energy sources, such as solar and wind power, is gaining momentum, addressing both environmental concerns and the escalating energy demands of AI. Despite these advancements, the industry faces challenges related to energy consumption and water usage, particularly in regions with high AI adoption. As AI continues to advance, data centres must adapt to meet the demands of this rapidly evolving technology, ensuring a sustainable and efficient future for both industries. The question AI providers hope VPs of Engineering never ask