Introducing InfiniBand HDR Products for AI

Currently ChatGPT has successfully expanded globally, venturing beyond the tech industry. With the advancement of ChatGPT and Artificial Intelligence (AI), there is an accelerated pace in global data center construction, leading to changes in the scale and pattern of optical module procurement. AI data centers adopt the Fat Tree network structure, featuring an equal number of upstream and downstream ports for each node, resulting in a higher number of switches compared to traditional data centers.

Taking NVIDIA's AI cluster model as an example, the SuperPOD serves as the fundamental unit, comprising 140 DGX A100 GPU servers, HDR InfiniBand 200G network cards, and 170 NVIDIA Quantum QM8790 switches. The increased number of switches, using a 1:1 connection approach, results in a port interconnection requirement of 40x170/2 = 3,400, adjusted to 4,000 considering practical deployment scenarios.

The usage ratio for a SuperPOD, in terms of servers: switches: optical modules, is approximately 1:1.2:28.6. Meeting the entry-level demands similar to GPT4.0 requires around 3,750 NVIDIA DGX A100 servers and 110,000 optical modules.

FS offers products for SuperPOD that utilize HDR InfiniBand 200G network interconnections. These products include high-speed, low-latency data transmission, low power consumption, and high stability InfiniBand optics. Specifically, the product lineup comprises the HDR 200G QSFP56 SR4 and HDR 200G QSFP56 FR4 modules, along with DAC and AOC products. Below, we will provide an introduction to these HDR 200G QSFP56 modules and DAC&AOC cables.

InfiniBand HDR 200G QSFP56 Transceiver for AI

FS offers two types of 200G NVIDIA HDR InfiniBand modules, as shown in the table below, each with different features.

InfiniBand HDR 200G QSFP56 DAC & AOC for AI

NVIDIA solution also mentions the application of AOC and DAC cables, typically used for short-distance data transmission, such as within servers or between servers and switches. These cable types offer high bandwidth, low latency, and low power consumption transmission solutions. Therefore, HDR AOC and DAC cables can be used in SuperPODs to meet the requirements of various distances and application scenarios. FS provides both direct-connect and branch HDR AOC as well as DAC cables under the InfiniBand HDR scheme:

Summing Up

In summary, as AI and data center technologies advance rapidly, illustrated by the NVIDIA AI cluster model, the demand for a substantial number of optical transceivers and cables to enable high-speed, low-latency data transmission within a SuperPOD becomes evident. FS InfiniBand optical transceivers and cables not only possess the inherent advantages of high speed, low latency, and low power consumption, but also demonstrate versatility in catering to diverse distances and application scenarios. Looking ahead to the future of data center construction, we are confident that the widespread adoption of high-speed, efficient, and reliable optical transceivers and cables will play a pivotal role, solidifying their significance as an integral component in the ongoing evolution of data center infrastructure.