Azure has unveiled Serverless GPUs within Azure Container Apps, enabling flexible, cost-effective GPU computing for AI workloads. This new functionality, powered by NVIDIA A100 and T4 GPUs, allows developers to focus directly on building and deploying AI applications while Azure takes care of resource scaling and management. The addition of NVIDIA NIM microservices enhances the development experience, providing support for secure and reliable AI model inference, allowing for compatibility with various AI models and ease of integration within existing infrastructure.
"With the support of NVIDIA NIM, development teams can easily build and deploy generative AI applications alongside existing applications within the same networking, security, and isolation boundary."
"This new capability, powered by NVIDIA A100 and T4 GPUs, simplifies the deployment and management of GPU-accelerated tasks such as real-time custom model inference."
Collection
[
|
...
]