Forget about gigabit network cards, a startup you never heard of wants to
sell you a terabit SuperNIC to power AI data centers of tomorrow but don't expect it to make your broadband go faster
Date:
Thu, 05 Sep 2024 17:33:41 +0000
Description:
Enfabrica showed off its ACF-S at Hot Chips 2024
FULL STORY ======================================================================
At the recent Hot Chips 2024 symposium in Stanford, California, Enfabrica introduced its Accelerated Compute Fabric SuperNIC (ACF-S) silicon and system-level solutions.
Designed to scale AI networks to millions of GPUs, it offers higher
bandwidth, greater resiliency, lower latency, and enhanced programmatic control for data center operators.
The presentation, titled ACF-S: An 8 Terabit/sec SuperNIC for
High-Performance Data Movement in AI and Accelerated Compute Networks, featured Enfabricas Chief Development Officer and Co-Founder, Shrijeet Mukherjee, alongside technical engineer Thomas Norrie. They discussed the architecture, design, and technical attributes of their first-generation ACF SuperNIC silicon, codenamed Millennium. Built differently (Image credit: Enfabrica/Hot Chips)
Covering the event, ServeTheHome noted Enfabricas ACF-S aims to unify
scale-up (adding resources to a single system) and scale-out (connecting multiple systems) fabric communication.
Although the network layout may resemble traditional PCIe switch-based networks, it is not a PCIe switch. Instead, it employs a logically rail-switched 2-tier CLOS network architecture that connects multiple CPUs, GPUs, and other components via ACF-S chips and GPU fabric switches. This architecture supports flexible, high-performance communication across different computing domains (like IPC and RPC), enabling efficient handling
of data-intensive tasks without the constraints of conventional PCIe switch designs.
The ACF-S "Millennium" chip is a key component, designed to deliver resilient networking for GPUs with 3.2 Tbps bandwidth per accelerator. It features a full router, multi-planar internal switch fabric, and user-programmable transport, supporting scalable infrastructure with up to 40,000 copy engines and data movers.
Enfabrica notes that the Millennium chip is built differently by integrating higher chip I/O density, NICs within crossbars, scalable memory translation, and shared flow buffer and packet processing, all of which enhance
performance and efficiency.
Enfabricas approach essentially focuses on maximizing compute efficiency by optimizing hardware and software integration, enhancing I/O and memory scalability, and implementing smart traffic management to improve network performance and system resilience. As ServeTheHome summarizes, It is like taking a bunch of NICs and combining them, and PCIe switches, and combining all of these into one. The other interesting use case is that one could add CXL memory to the ACF-S fabric and present pools of CXL memory without hosts. This is super cool. (Image credit: Enfabrica/Hot Chips) More from TechRadar Pro How AI is fueling the rise of edge networking Managing the IPv4 to IPv6 transition Your own private 5G network could be the answer to your connection woes
======================================================================
Link to news story:
https://www.techradar.com/pro/forget-about-gigabit-network-cards-a-startup-you -never-heard-of-wants-to-sell-you-a-terabit-supernic-to-power-ai-data-centers- of-tomorrow-but-don-t-expect-it-to-make-your-broadband-go-faster
--- Mystic BBS v1.12 A47 (Linux/64)
* Origin: tqwNet Technology News (1337:1/100)