#network-latency-optimization

[ follow ]
Artificial intelligence
fromTheregister
11 hours ago

How Perplexity optimized 1T parameter AI models for AWS EFA

Software optimizations enable trillion-parameter MoE models to run efficiently across older, cheaper multi-node hardware using existing network technologies including Amazon EFA.
[ Load more ]