KITECH Webinar_~7.22
Physical AI HBM Smart Factory SDV AIoT Power Semicon 특수 가스 정정·반론보도 모음 e4ds plus

“In the AI/HPC era, innovation in cooling technology is essential”

Google 우선 소스 기사입력2025.06.02 11:31


Utilizes various cooling methods such as air cooling, liquid cooling, and immersion cooling
Operators choose the optimal cooling solution considering cost and efficiency

“Data centers are playing an essential role in the digital trend driven by artificial intelligence (AI) and high-performance computing (HPC). On the other hand, these high-density computing environments entail massive power consumption, and cooling technology in particular is emerging as a key factor in determining operational efficiency and sustainability. Accordingly, data center cooling methods are continuously evolving, and improvements are required to become more efficient and environmentally friendly.”

Mouser Electronics recently published a technical paper titled “AI and HPC: Evolving Data Center Cooling Approaches” in Trends in Tech.

Accordingly, with AI and HPC leading recent technology trends, data center cooling technology is emerging as a key technology as a sustainable technology to cope with the increasing data center power.

Data centers account for a significant portion of global electricity consumption, and that share is expected to increase in the coming years.

In particular, data centers, including AI and HPC systems, have much higher power densities than typical servers, and thus the efficiency of cooling methods plays a critical role not only in reducing costs but also in optimizing energy usage.

As the cooling capacity of existing air-cooled systems reaches its limit, there is an active movement to introduce more effective cooling technologies.

Liquid cooling technology is currently considered the most effective method of cooling data centers.

Among these, the direct-to-chip cooling (DTC) method is very effective in cooling key processing hardware.

On the other hand, auxiliary hardware such as networking, RAM, and storage still have limitations in that they must rely on air cooling.

Immersion cooling technology is attracting attention as a solution to overcome these limitations.

Immersion cooling efficiently absorbs and transfers heat from electronic components by immersing the entire rack in a dielectric fluid, resulting in much higher cooling efficiency than conventional air-cooled systems.

Immersion cooling is a power millThis will play an increasingly important role as temperatures increase, with studies showing it can reduce the energy required for cooling by up to 90 percent.

Improving data center cooling technology in the future will require innovation in several key components.

Heat exchangers, a core component of the cooling system, are an essential element within a data center.

In particular, the rear door heat exchanger is positioned as a useful alternative to existing air-cooled systems to improve cooling performance.

In order to introduce an immersion cooling system, a dielectric cooling fluid with excellent thermal conductivity and non-reactive electronic components is required. As this technology advances, data center cooling efficiency will be further improved.

Control systems that utilize AI are being developed to optimize existing cooling technologies. This method allows AI to analyze and adjust tens of thousands of sensors and cooling devices to maintain an optimal temperature range. This can reduce cooling costs and increase stability in data centers.

The location and operation of data centers are also changing. To provide AI and HPC services close to urban areas, space optimization is essential and high-density cooling methods are required.

As data center rack power densities exceed 100 kW to 300 kW, engineers must consider innovative cooling technologies beyond traditional approaches.

Immersion cooling and liquid cooling systems are expected to be adopted in more and more data centers, and changes in cooling methods will become key to building sustainable IT infrastructure.

While data center operators are cautious about adopting new technologies, they must recognize the critical role cooling technologies play in reducing power consumption and increasing operational efficiency.

As data center cooling technology advances in the future, waste heat recycling is also likely to become more active. Energy efficiency can be maximized through various utilization methods such as hot water supply, heating systems, and industrial processes.

Data center cooling technology goes beyond simply ensuring the stability of IT infrastructure and is positioned as a key element for sustainable technological development in the future.

A variety of cooling methods will be utilized, including air cooling, liquid cooling, and immersion cooling, and data center operators will need to select the optimal cooling solution by considering both cost and efficiency.

Technological innovation and industry collaboration will become increasingly necessary to build a sustainable data center environment.