AWS makes move to host your company's home-made Gen AI models

Date:
Wed, 24 Apr 2024 09:19:01 +0000

Description:
Companies can now use their own in-house models with AWS Bedrock, or choose from the latest third-party models instead.

FULL STORY ======================================================================

In an effort to position itself as one of the leading platforms for custom generative AI models, AWS has announced the launch of Custom Model Import within Bedrock, its suite of enterprise-focused GenAI services.

As the name suggests, Custom Model Import will allow organizations to import and access their own generative AI models as fully managed APIs, which means theyll get to benefit from the same infrastructure and tools that are available for existing models in Bedrock.

AWS sees the addition of custom model support as addressing a growing trend among enterprises to develop and refine their own in-house models. AWS
Bedrock now supports custom in-house models

Besides leveraging their own proprietary models, enterprises using Bedrocks Custom Model Import will be able to use the suites other tools for knowledge expansion, fine-tuning and safeguarding against things like bias. In theory, it should give customers the best of both worlds.

Users will also be able to monitor and filter outputs for undesirable content like hate speech or violence, as well as assess the performance of models across various criteria.

The service is now available in preview, and it supports three of the most popular open model architectures Flan-T5, Llama and Mistal. AWS has committed to adding more architecture support in the future.

In the same breath, AWS also revealed the general availability of Titan Image Generator and the launch of Titan Text Embeddings V2. Trained by AWS, the company says that reductions in storage and compute costs coincide with improved accuracy, making the Titan family more cost-effective for companies that dont have the resources to develop their own models.

Meta Llama 3 foundation models have also arrived on Bedrock, with Coheres Command R and Command R+ models set to arrive soon.

On the whole, its refreshing to see AWS commit to interoperability by
offering popular third-party and now in-house model support on its platform its a move that could be set to jointly benefit it and its customers. More from TechRadar Pro These are the best AI tools and best AI writers Check out our roundup of the best cloud hosting providers Amazon really wants startups to use AI models including Anthropic - and it's giving away free credits to all



======================================================================
Link to news story: https://www.techradar.com/pro/aws-makes-move-to-host-your-companys-home-made-g en-ai-models


--- Mystic BBS v1.12 A47 (Linux/64)
* Origin: tqwNet Technology News (1337:1/100)