AWS' Trainium2 chips for building LLMs are now generally available, with Trainium3 coming in late 2025 | TechCrunch
Briefly

from TechCrunch2 months ago
AWS's new Trainium2 chips, now available, enable faster training for large language models, offering significant performance boosts over previous generations and rival offerings.
TechCrunchhttps://techcrunch.com/2024/12/03/aws-trainium2-chips-for-building-llms-are-now-generally-available-with-trainium3-coming-in-late-2025/
"These UltraServers will feature 64 interconnected Trainium2 chips, scaling up to 83.2 peak petaflops of compute, an impressive leap for machine learning applications.
TechCrunchhttps://techcrunch.com/2024/12/03/aws-trainium2-chips-for-building-llms-are-now-generally-available-with-trainium3-coming-in-late-2025/
AWS claims Trainium2 will deliver '3x higher token-generation throughput' for Meta's Llama 405B model compared to rivals, enhancing performance in cloud computing.
TechCrunchhttps://techcrunch.com/2024/12/03/aws-trainium2-chips-for-building-llms-are-now-generally-available-with-trainium3-coming-in-late-2025/
The upcoming AI compute cluster, powered by hundreds of thousands of Trainium2 chips, is projected to be the largest in the world, five times more powerful than its predecessor.
TechCrunchhttps://techcrunch.com/2024/12/03/aws-trainium2-chips-for-building-llms-are-now-generally-available-with-trainium3-coming-in-late-2025/
Read at TechCrunch
#aws #trainium2 #large-language-models #cloud-computing #ai-compute-cluster
[
|
]