Broadcom Ships Tomahawk 5, Industry’s Highest Bandwidth Switch Chip to Accelerate AI/ML Workloads

Broadcom announced  that it has delivered the StrataXGS Tomahawk 5 switch series, providing 51.2 Terabits/sec of Ethernet switching capacity in a single, monolithic device, double the bandwidth of any other switch silicon available .

“Delivering the world’s first 51.2 Tbps switch two years after we released Tomahawk 4, the industry’s first 25 Tbps switch, is a testament to the outstanding execution and innovation by the Broadcom team,” said Ram Velaga, senior vice president and general manager, Core Switching Group, Broadcom. “Since the introduction of Tomahawk 1 in 2014, Broadcom has consistently executed on doubling the bandwidth approximately every two years. With today’s introduction of the fifth generation Tomahawk family, we are proud to say that a single Tomahawk 5 replaces forty-eight Tomahawk 1 switches in the network, resulting in over 95 percent reduction in power requirements. We applaud our customers, partners, and engineers for making this possible.”

Recommended AI News: Payflo and DataBlend Partner to Extend Reach of Automated Check Fulfilment Services

While data centers continue to experience dramatic growth in network bandwidth requirements, there is also strong motivation to unify the networking infrastructure for general-purpose compute and storage with that of AI/ML compute. AI/ML training clusters are driving the need for fabrics with high-bandwidth connectivity, high radix, and lower job completion time, while operating at high network utilization.

Ethernet offers the best solution for unified network infrastructure, providing the lowest power, highest bandwidth, highest radix, and fastest SerDes speeds, along with a predictable doubling of bandwidth every 18 to 24 months. These benefits combined with its large and vibrant ecosystem, Ethernet provides the highest performance interconnect per Watt and per dollar for AI/ML and cloud scale infrastructure.

To enable the next generation of unified networks, Broadcom is now offering the Tomahawk 5 family. Critical to enabling efficient use of the massively shared infrastructure in large data centers, Tomahawk 5 provides AI/ML workload virtualization with features such as single-pass VxLAN routing and bridging. Critical to minimizing job completion time (JCT) for AI/ML workloads, Tomahawk 5 offers features such as Broadcom Cognitive Routing, advanced shared packet buffering, programmable inband telemetry, and hardware-based link failover.

Recommended AI News: Wiliot Applauded by Frost & Sullivan for Building Sustainable and Effective Customer Relationships and Experiences with Its Low-energy IoT Pixel Tags

Tomahawk 5’s Cognitive Routing improves network link utilization by automatically and dynamically selecting the most lightly loaded links in the system for every flow that transverses the switch. This is especially important for AI/ML workloads which often have a combination of short-lived mice flows and long-lived, high bandwidth elephant flows with low entropy. Tomahawk 5 includes real-time dynamic load balancing that tracks the utilization of all links, both at the switch and downstream in the network, to determine the optimal path for each flow. It also monitors the health of links in hardware and automatically steers traffic away from failed links. These features provide dramatically improved network utilization and reduced congestion, resulting in shortened JCT.

Also important in improving JCT is minimizing network congestion by controlling the rate of traffic injected into the network by each source. Since network operators employ a variety of different congestion control algorithms at their endpoints (such as merchant or custom NICs), Tomahawk 5 provides extensive programmable inband telemetry on both live traffic and network probes. Real-time metadata can be inserted into traffic at line rate as it traverses the network to collect telemetry on queue size, packet latency, switch utilization, and a variety of other customer-selectable metrics. This metadata can be used for precise end-to-end network congestion control.

To enable the lowest power and lowest cost for physical connectivity, Tomahawk 5 enables a direct 100G PAM4 interface to direct attach copper (DAC), front panel pluggable optics, and co-packaged optics. The flexible, long reach Tomahawk 5 SerDes provides DAC connectivity to all devices within a rack, and even between racks, without the need for retimers or other active components. It can also interface directly to a broad ecosystem of standard front-panel pluggable optical modules.

Recommended AI News: Lighthouse by BCG and Unacast Partner to Produce Holistic and Custom Human Mobility Data Solutions

[To share your insights with us, please write to sghosh@martechseries.com]