AWS offers more flexible access to Nvidia GPUs for short-duration AI workloads

Date:
Wed, 01 Nov 2023 13:30:34 +0000

Description:
Short-term rental of Amazons EC2 P5 instances, with Nvidia H100 GPUs, gives compute power to more businesses.

FULL STORY ======================================================================

AWS, an already popular cloud computing service for developers looking to access the best-performing hardware for AI workloads, has announced a more flexible scheme for shorter-term requirements.

Amazon Elastic Compute Cloud (EC2) Capacity Blocks for ML is what Amazon is calling an industry-first, and will allow customers to access GPUs on a consumption-based model.

The Seattle-based cloud giant hopes that more affordable options will provide smaller organizations with greater opportunities, helping to make for a more diverse landscape. AWS launches short-term consumption-based GPU renting

In a press release , the company said: With EC2 Capacity Blocks, customers
can reserve hundreds of Nvidia GPUs colocated in Amazon EC2 UltraClusters designed for high-performance ML workloads.

Customers can get access to the latest Nvidia H100 Tensor Core GPUs, which
are suited to training foundation models and large language models, by specifying cluster size and duration, meaning they only pay for what they need.

Amazon noted that demand for GPUs is fast outpacing supply as more businesses get to grips with generative AI, and many will either find themselves paying for an excessive service or having GPUs sitting dormant when theyre not in
use or worse still, both.

AWS users can reserve EC2 UltraClusters of P5 instances for between 1-14
days, and up to eight weeks in advance. They can pick flexible cluster size options, ranging from 1-64 instances, or a maximum of 512 GPUs.

AWS Compute and Networking VP David Brown commented: With Amazon EC2 Capacity Blocks, we are adding a new way for enterprises and startups to predictably acquire Nvidia GPU capacity to build, train, and deploy their generative AI applications without making long-term capital commitments. Its one of the latest ways AWS is innovating to broaden access to generative AI
capabilities.

Pricing for the service can be found on the AWS website , where prospective users can also sign up to use the short-term, affordable option. More from TechRadar Pro Want to use something thats already been built and tested? Here are the best AI tools AWS upgrades its Apple Mac stack for extra cloud power Weve also rounded up the best cloud hosting providers



======================================================================
Link to news story: https://www.techradar.com/pro/aws-offers-more-flexible-access-to-nvidia-gpus-f or-short-duration-ai-workloads


--- Mystic BBS v1.12 A47 (Linux/64)
* Origin: tqwNet Technology News (1337:1/100)