Nvidia reveals a whole new kind of Ethernet for generative AI

Date:
Mon, 29 May 2023 18:17:00 +0000

Description:
Blisteringly quick Ethernet speeds are being enabled by Nvidia Spectrum-X technology.

FULL STORY ======================================================================

Nvidia has announced details of a new networking platform designed specifically with generative AI workloads in mind, promising lightning-speed lossless networking.

The companys new Spectrum-X technology is built using the Spectrum-4 Ethernet switch and BlueField-3 DPU, and promises performance and power efficiency increases of as much as 1.7x.

In a press release , the company said: The delivery of end-to-end
capabilities reduces run-times of massive transformer-based generative AI models, which in turn enables companies to operate and make decisions more quickly, unlocking cost-saving potential. Spectrum-X Ethernet

Nvidias Networking Senior VP, Gilad Shainer, said: Spectrum-X is a new class of Ethernet networking that removes barriers for next-generation AI workloads that have the potential to transform entire industries.

Its key component, the Spectrum-4 Ethernet switch, is capable of 51 Tb/sec speeds. What this means for consumers is that, in conjunction with
BlueField-3 DPUs and Nvidia LinkX optics, a 400 Gigabit Ethernet network is enabled. Read more

These are the best network switches around

Nvidia and Dell team up help bring AI to your business

Growing our networks whilst reducing energy consumption

The company looked to provide an insight into the powerful networking capabilities that AI supercomputers can now tap into in real-world cases:

Nvidia Spectrum-X enables unprecedented scale of 256 200Gb/s ports connected by a single switch, or 16,000 ports in a two-tier leaf-spine topology to support the growth and expansion of AI clouds while maintaining high levels
of performance and minimizing network latency.

Elsewhere, Nvidia CEO Jensen Huang held up the Spectrum-4 switch chip during his presentation at the Computex expos opening speech, sharing more insight into its design. The hundred billion transistors on a 90x90 mm die draws around 500 watts, he said.

Already, Nvidia is testing its Spectrum-X in its Israeli data center in the Israel 1, a hyperscale generative AI supercomputer running Dell PowerEdge XE9680 servers based on the Nvidia HGX H100 eight-GPU platform. These are the best AI writers to give you a handy productivity boost



======================================================================
Link to news story: https://www.techradar.com/news/nvidia-reveals-a-whole-new-kind-of-ethernet-for -generative-ai


--- Mystic BBS v1.12 A47 (Linux/64)
* Origin: tqwNet Technology News (1337:1/100)