Nvidia and IBM have a plan to connect GPUs straight to SSDs

Date:
Wed, 16 Mar 2022 15:48:51 +0000

Description:
Computing giants Nvidia and IBM detail plan to boost ML training and other tasks.

FULL STORY ======================================================================

Nvidia, IBM, and researchers have a plan to make the lives of those working
in machine learning a bit easier: connecting GPUs directly to SSDs.

Detailed in a research paper , the idea is called Big accelerator Memory
(BaM) and involves connecting GPUs directly to large amounts of SSD storage, helping unwind a bottleneck for ML training and other intensive tasks.

"BaM mitigates the I/O traffic amplification by enabling the GPU threads to read or write small amounts of data on-demand, as determined by the compute," the researchers write. Speed and reliability boost

"The goal of BaM is to extend GPU memory capacity and enhance the effective storage access bandwidth while providing high-level abstractions for the GPU threads to easily make on-demand, fine-grain access to massive data
structures in the extended memory hierarchy."

The ultimate goal is to reduce the reliance of Nvidia GPUs ob hardware accelerated general-purpose CPUs. By allowing Nvidia GPUs to to directly access storage, and then process it, the work is being carried out by the
most specialised tools available. Wham BaM Shang-A-Lang

The technical details are pretty complex (we recommend reading the paper if this is your field) but the gist is twofold.

BaM uses a cache of GPU memory managed by software alongside a library where GPU threads can request data stored on NVMe SSDs directly. Moving information between is handled by the GPUs. READ MORE

Your next gaming laptop might finally have dedicated Intel graphics

It's finally happening: GPU prices sink to lowest levels in over a year

Apple M1 Ultra solves a multi-GPU problem thats been plaguing AMD and

Nvidia

The end result is that ML training and other intensive activities can access data more quickly and, importantly, in specific ways that are helpful to the workloads. In testing, this was borne out: the GPUs and SSDs worked well together, quickly transferring data.

The teams plan to open-source their hardware and software designs ultimately, a big win for the ML community. We've found the best GPUs around today

Via The Register



======================================================================
Link to news story: https://www.techradar.com/news/nvidia-and-ibm-have-a-plan-to-connect-gpus-stra ight-to-ssds/


--- Mystic BBS v1.12 A47 (Linux/64)
* Origin: tqwNet Technology News (1337:1/100)