#onnx

[ follow ]
#docker #fastapi #aws-lambda #aws-cli #aws-ecr #model-serving #resnetv2-50 #pytorch #onnx-runtime #jvm
Python
fromPyImageSearch
2 weeks ago

Pushing Docker App to AWS ECR for Lambda Deployment Using AWS CLI - PyImageSearch

Configure AWS CLI, build and push a Docker image of a FastAPI ONNX inference app to AWS ECR for Lambda deployment.
Python
fromPyImageSearch
3 weeks ago

FastAPI Docker Deployment: Preparing ONNX AI Models for AWS Lambda - PyImageSearch

Build and containerize a FastAPI AI inference server serving an ONNX model with image preprocessing and Docker deployment, preparing for AWS Lambda serverless deployment.
fromPyImageSearch
4 weeks ago

Converting a PyTorch Model to ONNX for FastAPI (Docker) Deployment - PyImageSearch

In this lesson, you will learn how to convert a pre-trained ResNetV2-50 model using PyTorch Image Models (TIMM) to ONNX, analyze its structure, and test inference using ONNX Runtime. We'll also compare inference speed and model size against standard PyTorch execution to highlight why ONNX is better suited for lightweight AI inference. This prepares the model for integration with FastAPI and Docker, ensuring environment consistency before deploying to AWS Lambda.
Python
Artificial intelligence
fromInfoQ
2 months ago

Bringing AI Inference to Java with ONNX: A Practical Guide for Enterprise Architects

Transformer-class models can run directly in the JVM via ONNX, enabling AI inference without adding Python dependencies or disrupting Java-based pipelines.
[ Load more ]