"Heavy reliance on third-party foundation models and hardware, particularly expensive Nvidia GPUs for training and inference, has proven less cost-effective amid surging AI development expenses. This dependency has limited scalability and profitability in a market where compute costs can dominate budgets."
"In a strategic pivot toward greater control and efficiency, Amazon is shifting to develop its own AI models in-house. Powered by its proprietary Trainium and Inferentia chips, the company aims to slash costs dramatically - potentially to a fraction of what rivals pay when depending solely on external hardware."
"By building models on Trainium (for training large-scale generative AI) and Inferentia (for efficient deployment), Amazon seeks to reduce dependency on costly third-party suppliers. This not only addresses the high barriers of chip scarcity and pricing but also enables more affordable AI offerings on AWS."
Amazon has established itself as an AI pioneer through AWS and internal deployments across Alexa, recommendations, and supply chain optimization. However, heavy dependence on third-party foundation models and expensive Nvidia GPUs has limited cost-effectiveness and scalability. To address this, Amazon is strategically shifting toward in-house AI model development powered by proprietary Trainium chips for training and Inferentia chips for deployment. This initiative, led by new AI chief Pete DeSantis, aims to slash compute costs to a fraction of current expenses, reduce dependency on external hardware suppliers, and enable more affordable AI offerings on AWS. The strategy addresses chip scarcity and pricing barriers while making AI more profitable and accessible to cost-conscious enterprises.
Read at 24/7 Wall St.
Unable to calculate read time
Collection
[
|
...
]