Nvidia's competitors, led by startups like SambaNova, Groq, and Cerebras, are attempting to disrupt a market where Nvidia holds a significant head start, rooted in trillions of dollars in investments.
Cofounder Rodrigo Liang believes that 90% of AI computing workloads will consist of inference in the near future, highlighting the urgent need for innovation in this space.
SambaNova's reconfigurable dataflow unit (RDU) is said to be a better fit for machine learning models by targeting efficiency and performance, as opposed to traditional graphics processing units.
Colleen Kress from Nvidia acknowledged that a significant portion of their data center workloads—40%, in fact—has shifted towards inference, reinforcing the competitive landscape.
[
Collection
]
[
|
...
]