Popular ToR and ToR Switch in Data Center Architectures

Updated on May 16, 2022 by

25G Switch

Top of rack (ToR) is one common architecture of switch-to-server connections. According to a survey result in 2015, ToR was the most popularly used architecture both in colocation data centers and enterprise data centers. Seen from current trend, it will be widely deployed in the present and in the future as well. ToR switch has therefore become more popular than before.

What Is a ToR Switch?

“But, wait, what does a ToR look like? Is a ToR switch placed at the top of the rack?”

Tor definition

Thanks for your questions. A ToR switch could be at the top of the rack, but the actual physical location does not necessarily need to be at the top of the rack. It can also be at bottom or middle of the rack. After practical installation, however, engineers found that top of the rack is better due to easier accessibility and cleaner cable management.

ToR, EoR or MoR

Benefits of ToR

Benefits of ToR are many and in brief they are:

  • Copper stays “In Rack”.

  • Lower cabling costs.

  • Modular and flexible “per rack” architecture.

  • Future-proofing for higher speeds.

In a ToR design, at least one network switch is placed in each rack and servers within the rack are connected to the switch typically via copper cable. Then switches in each rack are connected to ToR switch.

tor design 1

In today’s leaf-spine topology, the ToR switches are the leaf switches and they are attached to the spine switches. For example, 10G servers are connected to a 10G ToR/leaf switch (it has 40G ports as well) via 10G SFP+ DAC (direct attach copper cable), or via Cat6a/Cat7 cable and 10GBASE-T transceiver. Then the 10G switch is connected to a 40G spine switch.

tor and leaf-spine

The combination of ToR and leaf-spine has solved some problems that existed in traditional three-tier (access-aggregation-core) topology, such as the “traffic jam” in top-tier switch. In a three-tier network topology, the data traffic will all take a single “best path” that is chosen from a set of alternative paths, until the point that it gets congested then packets are dropped.

traditional tree-tier data traffic congestion

In leaf-spine topology, to prevent any one uplink path from being chosen, the path is randomly chosen so that the traffic load is evenly distributed between the top-tier switches. If one of the top-tier switches were to fail, it only slightly degrades performance in data centers.

leaf-spine and tor

High-Performance ToR Switches

Since ToR is the most popular design of data center architecture, ToR switches naturally become popular as well. Here are some high performance ToR switches of different switch-to-server data rates, ranging from 1G to 100G.

Dominant Switch-to-Server Data Rate FS Switch Model Port Type Switching Capacity Forwarding Rate AC/DC Power Supply
1G S3150-8T2FP 8x 10/100/1000BASE-T RJ45, 2x 1G SFP 20 Gbps 15 Mpps AC
  S3400-24T4FP 24x 10/100/1000BASE-T RJ45, 4x 1G RJ45/SFP Combo 56 Gbps 42 Mpps AC
10G S3900-24T4S
24x 10/100/1000BASE-T RJ45, 4x 10G SFP+
128 Gbps
95 Mpps
  S3400-48T4SP 48x 10/100/1000BASE-T RJ45, 4x 10G SFP+ 176 Gbps 132 Mpps AC
25G S5860-20SQ 20x 1G/10G SFP+, 4x 10G/25G SFP28, 2x 40G QSFP+ 760 Gbps 565 Mpps AC/DC
  S5850-24T16B 24x 10/100/1000BASE-T RJ45, 16x 10G/25G SFP28 848 Gbps 630.9 Mpps AC
40G S5860-20SQ 20x 1G/10G SFP+, 4x 10G/25G SFP28, 2x 40G QSFP+ 760 Gbps 565 Mpps AC
  N5850-48S6Q 48x 10G SFP+, 6x 40G QSFP+ 1.44 Tbps full duplex 1 Bpps AC
100G N5860-48SC 48x 10G SFP+, 8x 100G QSFP28 2.56 Tbps 1.9 Bpps AC
  N8550-48B8C 48x 25G SFP28, 2x 10Gb SFP+, 8x 100G QSFP28 4 Tbps full duplex 2.9 Bpps AC
  N8550-32C 32x 100G QSFP28, 2x 10Gb SFP+ 6.4 Tbps full duplex 4.7 Bpps AC
  N8560-32C 32x 100G QSFP28 6.4 Tbps 4.76 Bpps AC

All these FS ToR switches support L2/L3 features, IPv4/IPv6 dual stack, data center bridging and FCoE. ToR switches are often required to be multiport and have low-latency since they have to deal with traffic in different layers.

At present, 1G and 10G data rates still contribute to the largest portion of all switch-to-server connections. 40G and 100G ToR switches that can support multiple data rates are still not many. The 40G example and the 100G example listed above are one of the few multiport high speed ToR switches with low latency and high performance.

Related Article:

10G ToR/Leaf Ethernet Switch: What Is the Right Choice?

Data Center Architecture Design: Top of Rack vs. End of Row

You might be interested in

See profile for Rameez Arif.
Rameez Arif
Top of Rack and End of Row: What's the Difference?
Jun 27, 2022
See profile for Howard.
FAQs About FS Data Center Switches
May 31, 2022
See profile for Sheldon.
Decoding OLT, ONU, ONT, and ODN in PON Network
Mar 14, 2023
See profile for Irving.
What's the Difference? Hub vs Switch vs Router
Dec 17, 2021
See profile for Sheldon.
What Is SFP Port of Gigabit Switch?
Jan 6, 2023