Explainer-Keeping cool: heat a key challenge for data centers and AI


AI (Artificial Intelligence) letters are placed on computer motherboard in this illustration taken, June 23, 2023. REUTERS/Dado Ruvic/Illustration

STOCKHOLM/LONDON (Reuters) -The global boom in data centers as companies increasingly outsource information storage and ramp up use of energy-intensive artificial intelligence is creating a key challenge for the industry - how to keep cool.

An outage at the world's biggest exchange operator CME Group from late Thursday that halted trade on its popular currency platform and in futures spanning foreign exchange, commodities, Treasuries and stocks has put a spotlight on data centers overheating.

The problem was a cooling issue at data centers operated by Dallas-headquartered CyrusOne, which operates more than 55 centers in the U.S., Europe and Japan.

CyrusOne said on Friday its engineering teams were on site at the data center near Chicago to get the cooling system back online.

WHAT CAUSES THE HEAT?

High-powered AI and cloud servers crunching data need huge amounts of power, which gives off intense heat that traditional air cooling systems are often unable to cool properly.

Data centers contain racks of servers stacked together which are constantly turned on, consuming power. As they heat up, they require constant cooling.

"The chips that are in those data centers need to stay within certain temperatures, otherwise they either malfunction or they turn off," said Daniel Mewton, a partner in the infrastructure, energy and natural resources practice at law firm Slaughter and May.

WHAT CAN DATA CENTER OPERATORS DO ABOUT IT?

More data centers are looking to use water or specialized coolants instead of air cooling, as liquid cooling can be 3,000 times more efficient than air at removing heat.

Liquid cooling however can create its own challenges, including potential leaks, corrosion and the need for specialized maintenance. It can also be water intensive.

Companies are looking to find ways to reduce outside coolants. Microsoft last year launched a new data center design that consumes zero water for cooling.

According to the company, its new technologies recycle water through a closed loop, circulating between the servers and chillers to dissipate heat without needing a fresh supply.

There are also systems to recover and reuse waste heat from data centers.

HOW COMMON ARE OUTAGES LINKED TO COOLING ISSUES?

Mewton said that in general data center outages were "extremely uncommon" because of contractual requirements for operators to keep them almost always online.

"You need to be up more than 99.99% of the time sometimes," he said.

While outages overall were fairly unusual, specific issues directly affecting cooling systems were "even rarer", Mewton said. "What I most often hear (about) is obviously power issues," he said.

A WAVE OF DEAL-MAKING FOR DATA CENTER COOLING

The global appetite for data centers has sparked a wave of deal-making across the industry as companies race to build capacity to meet the surge in power and cooling needs.

Law firm White and Case estimates that up to 40% of total energy consumption in data centers is spent on cooling them down, making it a big business.

In November, power management firm Eaton said it would buy Boyd Corporation's thermal business from Goldman Sachs Asset Management for $9.5 billion, part of a push to cater to an AI demand surge.

Peer Vertiv is also in a $1 billion deal for PurgeRite Intermediate to expand its liquid cooling services.

(Reporting by Supantha Mukherjee and Lucy Raitano; Additional reporting by Toby Sterling and Leo Marchandon; Writing Adam Jourdan; Editing by Jan Harvey)

Follow us on our official WhatsApp channel for breaking news alerts and key updates!

Next In Tech News

New app helps you sit up straight while at your computer
Dispose of CDs, DVDs while protecting your data and the environment
'Just the Browser' strips AI and other features from your browser
How do I reduce my child's screen time?
Anthropic buys Super Bowl ads to slap OpenAI for selling ads in ChatGPT
Chatbot Chucky: Parents told to keep kids away from talking AI dolls
South Korean crypto firm accidentally sends $44 billion in bitcoins to users
Opinion: Chinese AI videos used to look fake. Now they look like money
Anthropic mocks ChatGPT ads in Super Bowl spot, vows Claude will stay ad-free
Tesla 2.0: What customers think of Model S demise, Optimus robot rise

Others Also Read