How to Seamlessly Connect 200G HDR Infiniband Data Centers to 100/200GbE Ethernet?

Industry Trends

In data-intensive industries, such as cloud computing, artificial intelligence, and high-performance computing, there is a growing demand for faster data transfers. In recent years, more enterprises and institutions have adopted high-performance, low-latency 200G HDR InfiniBand solutions for their data centers. As technology advances, it becomes necessary for data centers to efficiently connect to external Ethernet for resource sharing and business continuity. This trend has led to innovative solutions for high-performance, highly adaptable network architectures.

What is 200G HDR Infiniband?

InfiniBand is a high-performance network communications standard mainly used in supercomputers and data centers, known for its excellent scalability and low-latency characteristics. With its exceptional data speed, minimal latency, intelligent accelerations, and superior efficiency and reliability, InfiniBand is the go-to solution for interconnecting the most advanced high-performance computing (HPC) systems and artificial intelligence (AI) supercomputers worldwide. The demand for higher data throughput is increasing as data analysis needs continue to grow. Nowadays, many advanced data centers require more than 100Gb/s bandwidth.

200G HDR Infiniband Solution Advantages

200G HDR InfiniBand solution is supported by Mellanox Quantum switches, ConnectX-6 adapters, and LinkX cables. Compared with the 100G EDR switch, the 200G HDR Infiniband switch delivers more than twice the performance in the same QSFP package and 1RU edge switch. 200G HDR solution reduces both rack spaces and power consumption. The higher-density solution delivers performance improvements with a 50% reduction in latency, as well as a simpler interconnect solution that requires fewer cable connections and has HDR fat uplinks which are more robust for congestion and microbursts.

How to Achieve 200G HDR Infiniband Connection With 100G/200G Ethernet?

To seamlessly connect 200G HDR Infiniband data centers to 100/200GbE Ethernet, a high-performance gateway is the key factor. Via the gateway, one can ensure the lowest latency for the internal data center compute communications, and scale the external connectivity to Ethernet as needed.

Appliance-based InfiniBand to Ethernet Gateway

The gateway enables Ethernet storage or other Ethernet-based communications to access the InfiniBand data center. Network-wide configuration handles Ethernet Link Aggregation (LAG) and implements high availability and load balancing. The appliance-based gateway is the conversion hub between InfiniBand and Ethernet, converting InfiniBand signals to Ethernet signals and vice versa. Gateway systems and routers build the communication bridge between InfiniBand and Ethernet.

Network configuration of the gateway includes the assignment of IP addresses, as well as possible subnet settings, routing protocol configuration, and so on. Connect switches or HCAs (Host Channel Adapters) in the InfiniBand network to the InfiniBand ports of the gateway devices using appropriate cables (such as QSFP28 or QSFP56). Connect the Ethernet port of the gateway to an Ethernet switch or router using 100/200GbE-compatible cables and interfaces such as QSFP28 or QSFP56. After the physical connection is established, perform network connectivity and performance tests to confirm that data can be correctly transitioned from the InfiniBand network to the Ethernet environment while maintaining the expected throughput and low-latency performance.

Mellanox Skyway 200G HDR InfiniBand to Ethernet Gateway

Mellanox has introduced a corresponding solution that supports 200G HDR connectivity from the InfiniBand to Ethernet. Skyway, an appliance-based InfiniBand to Ethernet gateway, enables Ethernet storage or other Ethernet-based communications to access the InfiniBand data center. InfiniBand data centers with high performance and low latency can be connected to external Ethernet networks. It means users can continue to have the ultra-low interconnect latency of InfiniBand, ensuring superior application performance.

The solution provides data centers with an efficient and scalable path to seamlessly connect to 100/200Gb/s InfiniBand data centers and 100/200GbE Ethernet infrastructures. The low latency of InfiniBand is maintained throughout the data center. For users who need to connect to external Ethernet platforms, this solution supports a maximum bandwidth of 1.6Tb/s and untilizes 16 ports, each exceeding 100Gb/s traffic. Connectivity-wise, the InfiniBand ports can be connected to the InfiniBand network via HDR/HDR100 or EDR; and the Ethernet ports use 200Gb/s, 100Gb/s Ethernet, or lower speeds.

This solution is well suited for high-performance computing(HPC), artificial intelligence(AI), data-intensive applications, and cloud platforms, as it leverages InfiniBand's high data throughput, ultra-low latency, and intelligent network compute acceleration engine to deliver superior application performance and scalability.

Summary

In summary, Ethernet and InfiniBand are constantly evolving to improve Internet performance and enhance the interconnection experience. The immense power of 200G HDR technology is revolutionizing next-generation data centers. By using InfiniBand to Ethernet gateway, and extending InfiniBand with easy-to-use Ethernet connectivity, network resource availability can be maximized. It provides data centers with an efficient and scalable path to seamless expansion. The latest AI network communication solutions are simpler, more converged, and outcome-driven, enabling enterprises and organizations to go beyond technology.