Did Qualcomm just launch the first true 'App Store' for AI? AI Hub comes with 75 models for free, but you will have to be a developer to take full
advantage of it
Date:
Sun, 03 Mar 2024 22:25:14 +0000
Description:
Qualcomm's AI Hub offers a library of pre-optimized AI models for devices on Snapdragon and Qualcomm platforms.
FULL STORY ======================================================================
Qualcomm has unveiled its AI Hub, an all-inclusive library of pre-optimized
AI models ready for use on devices running on Snapdragon and Qualcomm platforms.
These models support a wide range of applications including natural language processing, computer vision, and anomaly detection, and are designed to deliver high performance with minimal power consumption, a critical factor
for mobile and edge devices.
The AI Hub library currently includes more than 75 popular AI and generative AI models including Whisper, ControlNet, Stable Diffusion, and Baichuan 7B. All models are bundled in various runtimes and are optimized to leverage the Qualcomm AI Engine's hardware acceleration across all cores (NPU, CPU, and GPU). According to Qualcomm, theyll deliver four times faster inferencing times. Documentation and tutorials provided
The AI Hub also handles model translation from the source framework to
popular runtimes automatically. It works directly with the Qualcomm AI Engine direct SDK and applies hardware-aware optimizations. Developers can search
for models based on their needs, download them, and integrate them into their applications, saving time and resources.
The AI Hub also provides tools and resources for developers to customize
these models, and they can fine-tune them using the Qualcomm Neural
Processing SDK and the AI Model Efficiency Toolkit, both available on the platform.
To use the AI Hub, developers need a trained model in PyTorch, TorchScript, ONNX, or TensorFlow Lite format, and a good understanding of the deployment target, which can be a specific device (like Samsung Galaxy S23 Ultra) or a range of devices.
The AI Hub is not exclusively for experienced developers however. It also serves as a learning platform, providing comprehensive documentation and tutorials for those venturing into the world of AI.
Qualcomm plans to regularly update the AI Hub with new models and support for additional platforms and operating systems. Developers can sign up to access these models on cloud-hosted devices based on Qualcomm platforms and get
early access to new features and AI models. More from TechRadar Pro These are the best AI tools around today Qualcomm is now one step closer to an Arm-free ecosystem Millions of GPUs from Apple, AMD and Qualcomm have a serious security flaw
======================================================================
Link to news story:
https://www.techradar.com/pro/did-qualcomm-just-launch-the-first-true-app-stor e-for-ai-ai-hub-comes-with-75-models-for-free-but-you-will-have-to-be-a-develo per-to-take-full-advantage-of-it
--- Mystic BBS v1.12 A47 (Linux/64)
* Origin: tqwNet Technology News (1337:1/100)