Explainer-Keeping cool: heat a key challenge for data centers and AI


AI (Artificial Intelligence) letters are placed on computer motherboard in this illustration taken, June 23, 2023. REUTERS/Dado Ruvic/Illustration

STOCKHOLM/LONDON (Reuters) -The global boom in data centers as companies increasingly outsource information storage and ramp up use of energy-intensive artificial intelligence is creating a key challenge for the industry - how to keep cool.

An outage at the world's biggest exchange operator CME Group from late Thursday that halted trade on its popular currency platform and in futures spanning foreign exchange, commodities, Treasuries and stocks has put a spotlight on data centers overheating.

The problem was a cooling issue at data centers operated by Dallas-headquartered CyrusOne, which operates more than 55 centers in the U.S., Europe and Japan.

CyrusOne said on Friday its engineering teams were on site at the data center near Chicago to get the cooling system back online.

WHAT CAUSES THE HEAT?

High-powered AI and cloud servers crunching data need huge amounts of power, which gives off intense heat that traditional air cooling systems are often unable to cool properly.

Data centers contain racks of servers stacked together which are constantly turned on, consuming power. As they heat up, they require constant cooling.

"The chips that are in those data centers need to stay within certain temperatures, otherwise they either malfunction or they turn off," said Daniel Mewton, a partner in the infrastructure, energy and natural resources practice at law firm Slaughter and May.

WHAT CAN DATA CENTER OPERATORS DO ABOUT IT?

More data centers are looking to use water or specialized coolants instead of air cooling, as liquid cooling can be 3,000 times more efficient than air at removing heat.

Liquid cooling however can create its own challenges, including potential leaks, corrosion and the need for specialized maintenance. It can also be water intensive.

Companies are looking to find ways to reduce outside coolants. Microsoft last year launched a new data center design that consumes zero water for cooling.

According to the company, its new technologies recycle water through a closed loop, circulating between the servers and chillers to dissipate heat without needing a fresh supply.

There are also systems to recover and reuse waste heat from data centers.

HOW COMMON ARE OUTAGES LINKED TO COOLING ISSUES?

Mewton said that in general data center outages were "extremely uncommon" because of contractual requirements for operators to keep them almost always online.

"You need to be up more than 99.99% of the time sometimes," he said.

While outages overall were fairly unusual, specific issues directly affecting cooling systems were "even rarer", Mewton said. "What I most often hear (about) is obviously power issues," he said.

A WAVE OF DEAL-MAKING FOR DATA CENTER COOLING

The global appetite for data centers has sparked a wave of deal-making across the industry as companies race to build capacity to meet the surge in power and cooling needs.

Law firm White and Case estimates that up to 40% of total energy consumption in data centers is spent on cooling them down, making it a big business.

In November, power management firm Eaton said it would buy Boyd Corporation's thermal business from Goldman Sachs Asset Management for $9.5 billion, part of a push to cater to an AI demand surge.

Peer Vertiv is also in a $1 billion deal for PurgeRite Intermediate to expand its liquid cooling services.

(Reporting by Supantha Mukherjee and Lucy Raitano; Additional reporting by Toby Sterling and Leo Marchandon; Writing Adam Jourdan; Editing by Jan Harvey)

Follow us on our official WhatsApp channel for breaking news alerts and key updates!

Next In Tech News

Smartphone on your kid’s Christmas list? How to know when they’re ready.
A woman's Waymo rolled up with a stunning surprise: A man hiding in the trunk
A safety report card ranks AI company efforts to protect humanity
Bitcoin hoarding company Strategy remains in Nasdaq 100
Opinion: Everyone complains about 'AI slop,' but no one can define it
Google faces $129 million French asset freeze after Russian ruling, documents show
Netflix’s $72 billion Warner Bros deal faces skepticism over YouTube rivalry claim
Pakistan to allow Binance to explore 'tokenisation' of up to $2 billion of assets
Analysis-Musk's Mars mission adds risk to red-hot SpaceX IPO
Analysis-Oracle-Broadcom one-two punch hits AI trade, but investor optimism persists

Others Also Read