07Apr
Data Center Cold Wars Part 4 — Rear Door Heat Exchanger Versus Single-Phase Immersion Cooling

Data Center Cold Wars – Part 4:
Single-Phase Immersion Cooling Versus Rear-Door Heat Exchangers

Submitted by Dhruv Varma, Director of Business Development - APAC
On: April 7, 2020 Comments: 0
Follow Us for the Latest Insights on Data Center Cooling!
 
When we talk immersion cooling, we talk single-phase immersion cooling, not two-phase.

Things are really heating up out there. Even conventional computing operations are frequently pushing the 30 kW/rack barrier now. HPC apps like AI are becoming commonplace. And because IT is such an integral part of business growth, IT execs are under renewed pressure to have a fail-proof game plan for scaling up.

This fourth in our series of comparison blogs can help. By evaluating two popular data center cooling methods – single-phase immersion and rear door heat exchangers, we’ll give you insights on how best to “beat the heat” and master the trend.

Technology Comparison Chart RDHx vs. Single Phase Immersion Cooling

Matchup:
How These Competing Cooling Technologies Work

Rear Door Heat Exchanger (RDHx) Schematic

Rear Door Heat Exchanger (RDHx)

Originally designed to make air-cooling more efficient, RDHx systems were an early solution for bringing the cooling effects of a liquid-to-gas phase change closer to the heat source. With RDHx, radiator-like doors are attached to the fronts or backs of server racks. Heat produced by IT equipment is removed by air blown into the exchangers via fans. That heated air travels a short distance before transferring to water or refrigerant running inside the radiators.

Heated liquid is then carried away from the server rack to a cooling distribution unit (CDU), which in turn is connected to an outside chilled water system.

Some RDHx systems have “active doors” with integrated fans, while others rely solely on server fans to eject the air.

Essentially, RDHx is just a better form of air-cooling. Although often mistakenly considered so, it is not a liquid-cooling solution.

Single-Phase Liquid Immersion Cooling Schematic

Single-Phase Immersion Cooling

With single-phase immersion cooling, servers are installed vertically in coolant bath of dielectric (electrically non-conductive) fluid. Like its two-phase counterpart, the coolant transfers heat through direct contact with server components. Heated coolant then exits the top of the rack and is circulated through a CDU connected to a warm-water loop. This loop incorporates a cooling tower or dry cooler on the other side as the final form of heat removal. In the end, cooled liquid is returned to the rack from a heat exchanger.

Single-phase immersion cooling systems are noted for their simplicity, which translates into greater upfront affordability, easier operations and less maintenance.

Data Center Cold Wars — Part 2 Two-Phase Versus Single-Phase Immersion Cooling

What’s the difference between single- and two- phase immersion cooling?

Loads.

Find Out Here >>

Compare, Contrast and Be Cool

Now let’s break down each of these technologies and see how they compare across eight important categories.

Complexity & Upfront Costs

RDHx

Absent the need for raised floors, air handlers and the like, RDHx is simpler than traditional air cooling. But since it still uses air as a medium of cooling, it requires compressor – or refrigerant-based cooling at the CDU level, or a chilled water loop. It also requires specialized building design and engineering such as CFD analysis to ensure appropriate layouts and cooling.

Further, environmental and humidity control systems are also needed. All these systems increase complexity and add costs. Although RDHx does not require raised floors, aisle containment, false ceilings, and plenums may still be needed.

RDHX Technology Has Been Widespread Since 2009

On the plus side, operators will find it easy to add an RDHx to an air-cooled system, or to augment a liquid-to-chip solution attached solely to CPUs.

Single-Phase Immersion Cooling

In all fairness to competing systems, single-phase immersion cooling is arguably the simplest, most cost-effective way to cool a data center. For example, there are only three moving parts involved in GRC’s ICEraQ™ micro-modular immersion cooling solution.

As a result, we can confidently claim to reduce both data center CAPEX & OPEX by a full 50%, as we have for many of our customers.

RDHx Cooling Photo

Rear Door Heat Exchanger Installation.

GRC ICEraQ Photo

Immersion-cooled ICEraQ systems provide super easy server access.

Key Takeaway: Like any air-cooled solution RDHx is more complex hence more costly than single-phase immersion cooling.
Key Takeaway: Like any air-cooled solution RDHx is more complex hence more costly than single-phase immersion cooling.

Efficiency & Operating Expenses

RDHx

Again, because RDHx uses air – a bad conductor of heat, it requires a lot of air flow and a huge temperature delta between the incoming air and the heat source to maintain optimal core temperatures. The higher delta means that air must be cooled to temperatures that mandate the use of compressors or chiller plants to cool the air directly. Either way, when you consider the need for compressors plus the number of fans needed to create the required air flow, RDHx consumes significant amounts of energy

Plus, unlike immersion cooling, RDHx solutions still require server fans and do not reduce the server power consumption.

Given the combined electrical load of fans, chillers, CDUs and more,RDHx delivers a PUE of between 1.2 and 1.3.

It’s also important to note that, given tightening worldwide environmental regulations, many refrigerants are likely to get harder and costlier to acquire in the long run. This should definitely be considered when building a data center that requires compressor-based cooling.

RDHx versus Single Phase Immersion Cooling PUE Comparison

Single-Phase Immersion Cooling

With single-phase immersion cooling systems, 100% of the heat is picked up by the coolant. In addition, the coolant’s comparatively higher density and superior thermal conductivity means that it can maintain optimal core temperatures with a much lower delta between the coolant and the heat source.. This eliminates the need for compressor-based cooling, and reduces the amount of mechanical work/electrical power needed to create flow and run chiller plants.

Add the disabling or removal of server fans and a 10-30% reduction of server power is possible.

Consider as well that single-phase immersion cooling does not require all the ancillary equipment (and corresponding energy draw) associated with RDHx. As a result, it delivers a remarkable PUE of about 1.03, despite the reduction in server power.

GRC immersion cooling reduces peak server power by 10 to 30%.
Key Takeaway: RDHx PUE is 1.2 to 1.3 vs single-phase immersion cooling's 1.03
Key Takeaway: RDHx PUE is 1.2 to 1.3 vs single-phase immersion cooling's 1.03

Cooling Capacity & High-Density Performance

RDHx

RDHx systems can run either water or refrigerant. The former comes with major safety and reliability caveats to be discussed later. Although RDHx can be cost-competitive for 25-30 kW rack densities, there are limits to those benefits. In fact, its advantages drop sharply as densities rise beyond 15 kW per rack. Given the ever-increasing density of chips and hardware, operators may soon start to hit the 30 kW-per-rack wall with hardware refreshes.

Single-Phase Immersion Cooling

GRC ICEraQ and ICEtank systems can easily cool up to 100 kW per rack – theoretically up to 200 kW when used with a chilled water system. And while the financial case for GRC’s immersion cooling makes sense at rack densities as low as 10 kW (less in some cases), the higher capacity future-proofs the infrastructure against rising hardware density and the ever-evolving technology landscape.

Immersion cooling is also ideal for creating a diverse density layout. This allows operators to run high-density racks right next to lower density ones without stratification or the mixing of hot and cold air

Key Takeaway: RDHx cost-competitiveness maxes out at about 15 kW/rack.
Key Takeaway: RDHx cost-competitiveness maxes out at about 15 kW/rack.

Reliability & Location Flexibility

RDHx

RDHx does not score well in this category, and here’s why:

Feeding the radiator-like doors of RDHx systems are fluid lines containing either water or refrigerant. Depending on which – and whether they’re routed above or below critical IT equipment, leaks can be a major problem. There have actually been cases when failures have sprayed conductive water onto servers and ruined them. So, clearly, using water is a concern.

Yet using refrigerant can be a problem, too, but for different reasons. Aside from high costs, RDHx refrigerants also have a global warming potential (GWP),putting them under the constant scrutiny of the EPA and EEA. In fact, some formulations are in the process of being banned, causing more than a few operators to be concerned about supply disruptions.

Two other factors impede RDHx’s reliability and location flexibility. One is the fact that these systems – much like any other air-cooling system – expose IT assets to airborne contaminants, moisture, and increased levels of vibrations. Thus, they require additional systems and equipment to protect them from harsher environments.

RDHX versus Single Phase Immersion Cooling Fluid Comparison

Next, RDHx still needs significant amounts of power and supporting infrastructure, which can limit location choices, especially for edge applications.

Single-Phase Immersion Cooling

In contrast to RDHx, single-phase immersion cooling scores an A+ when it comes to reliability and location flexibility. The reasons are simple. There are few moving parts (in other words, less things to go wrong). Also, servers are completely immersed, therefore shielded from any harmful environmental factors.

GRC ICEraQ and ICEtank™ systems are the epitome of simplicity, and can be placed virtually anywhere. In fact, our fully containerized ICEtanks can literally be deployed in a parking lot or loading dock.

Operators should also know that our ElectroSafe® coolant is non-conductive, totally inert, and planet-friendly. Most likely it will not need replacing over a typical data center lifecycle.

ICEraQ and ICEtank Systems Can Be Placed Virtually Anywhere
Key Takeaway: Water & refrigerant associated with RDHx can create long-term safety and environmental concerns
Key Takeaway: Water & refrigerant associated with RDHx can create long-term safety and environmental concerns

Conclusion: Single-Phase Immersion Cooling Finishes First

Because air-based systems are fast becoming an outmoded “legacy” method for cooling data centers – and since RDHx is essentially an enhanced form of air-cooling, it simply cannot match single-phase immersion cooling in the eight critical performance categories discussed here.

Ready to Grow Your Data Center? Let’s Talk!

Send us an email at info@grcooling.com or call us at +1.512.692.8003. A GRC associate will reach out and talk details with you. In the meantime, be sure to read Data Center Cold Wars — Part 1: Air-Based Cooling Versus Single-Phase Immersion Cooling and watch for the next installment.