#sagemaker

[ follow ]
fromInfoQ
3 days ago

Lyft Rearchitects ML Platform with Hybrid AWS SageMaker-Kubernetes Approach

Lyft has rearchitected its machine learning platform LyftLearn into a hybrid system, moving offline workloads to AWS SageMaker while retaining Kubernetes for online model serving. Its decision to choose managed services where operational complexity was highest, while maintaining custom infrastructure where control mattered most, offers a pragmatic alternative to unified platform strategies. Lyft's engineers migrated LyftLearn Compute, which manages training and batch processing, to AWS SageMaker, eliminating background watcher services, cluster autoscaling challenges, and eventually-consistent state management, which had consumed significant engineering effort.
Artificial intelligence
#aws
fromTechCrunch
2 weeks ago
Artificial intelligence

AWS doubles down on custom LLMs with features meant to simplify model creation | TechCrunch

AWS added serverless model customization in SageMaker and reinforcement fine-tuning in Bedrock to simplify building and fine-tuning custom frontier LLMs, including Nova and open-source models.
fromInfoWorld
3 weeks ago
Artificial intelligence

AWS launches Flexible Training Plans for inference endpoints in SageMaker AI

FTPs allow enterprises to reserve instance types and GPUs to guarantee low-latency, consistent inference performance when automatic scaling cannot ensure immediate GPU availability.
fromTechCrunch
2 weeks ago
Artificial intelligence

AWS doubles down on custom LLMs with features meant to simplify model creation | TechCrunch

fromInfoWorld
3 weeks ago
Artificial intelligence

AWS launches Flexible Training Plans for inference endpoints in SageMaker AI

[ Load more ]