Executive Summary
- Artificial intelligence is changing the economics of the data centre at extraordinary speed.
- As models become larger, workloads more intensive and adoption accelerates across almost every industry, demand for compute is rising with it.
- Jordan Toulson, senior product manager of QiO Technologies explores why the biggest constraint on AI’s growth may not ultimately be access to compute, it will be access to power.
Data centres are already facing growing pressure around energy availability, grid capacity and the infrastructure required to support increasingly dense environments. AI intensifies that challenge. More compute traditionally means more servers, greater cooling requirements and, ultimately, more power.
The problem is that power is not an infinitely expandable resource. For years, the industry has largely responded to growing demand by adding capacity. But in an era of AI and high-density computing, continually adding more infrastructure cannot be the only answer. The sector also needs to look much more closely at how effectively it is using the infrastructure it already has.
High density needs higher intelligence
When we talk about high-density data centres, the conversation often focuses on the physical infrastructure required to accommodate more demanding workloads.
That is important, but density also needs to be considered from an efficiency perspective. If operators are going to support significantly greater compute requirements within existing power constraints, infrastructure itself needs to become more intelligent.
Servers are not operating at maximum utilisation every second of every day. Workloads fluctuate continuously, yet power provision has traditionally been relatively static. That creates a gap between the energy being made available and the energy genuinely required to perform the workload.
Across a large server estate, even relatively small inefficiencies can accumulate into a significant amount of wasted power.
Before assuming the answer to AI demand is simply another data hall, another server deployment or another request for grid capacity, operators should therefore be asking a more fundamental question: how much additional capacity could we unlock from what we already have?
Using AI to solve AI’s infrastructure challenge
There is an interesting irony here – AI is contributing to the data centre’s power challenge, but it can also become part of the solution.
The complexity and size of modern server estates means optimisation can no longer rely solely on periodic human intervention or fixed settings. Workloads change too quickly and there are simply too many variables.
AI-driven autonomous optimisation allows infrastructure to respond dynamically to those changing conditions. Rather than provisioning power based on assumptions about what a server might need, technology can continuously interpret workload and server behaviour and adjust power consumption accordingly.
The goal is not to remove people from the process. Data centres are already highly software-centric environments. The opportunity is instead to automate thousands of routine operational adjustments that technology can make continuously, while people remain firmly in control of strategy, risk and the parameters within which those decisions are made.
That shift could become increasingly important as infrastructure becomes denser.
Creating capacity without waiting for capacity
The potential prize is substantial. From our work within data centre environments, we are seeing average server power reductions of more than 25 per cent. At scale, efficiencies of this kind can translate into meaningful power headroom within an existing estate.
That changes the conversation around capacity. If operators can reduce the amount of power required by existing servers while maintaining the compute performance their workloads demand, they may be able to accommodate additional workloads within the same power envelope.
That does not eliminate the need for new data centres, grid investment or advances in cooling and hardware. AI growth will require all of those things. But optimisation needs to become an equally important part of the capacity strategy.
The next generation of data centres will not simply be defined by how much infrastructure they can accommodate. They will be defined by how intelligently that infrastructure operates.
As AI drives the industry towards higher-density environments, the winners will be those capable of extracting more compute from every available watt.
Because in the race to scale AI, compute may be what everyone wants, but power is increasingly what determines how much of it we can actually have.
