Jim Cramer Says NVIDIA Is Preparing A New Chip to Outclass Broadcom and Google

"Nvidia is about to announce a new chip that can compete with pesky offerings from competitors. Several companies, including long standing Nvidia customers, have been bragging about how they make a particular kind of AI semiconductor ones for inference. And Nvidia, well, it looks like they may have something against that that could be better."

"Training is the expensive, power-hungry process of building an AI model. Inference is what happens every time someone uses that model: every query, every response, every decision. As AI moves from labs into products, inference volume explodes."

"Nvidia has long dominated AI training hardware, but inference favors efficiency over raw throughput, which is exactly why competitors have found an opening. Companies like Broadcom have argued that NVIDIA's GPUs aren't specialized enough for inference and will soon prove to be too expensive."

Nvidia is preparing a new chip targeting the AI inference market, signaling a competitive response to rivals like Broadcom and Alphabet who have gained ground with specialized inference solutions. Inference, the process of running trained AI models in production, differs fundamentally from training and prioritizes efficiency over raw throughput. As AI adoption accelerates, inference volume explodes, creating a lucrative battleground. Nvidia acquired Groq, a startup with alternative chip architecture using pre-planned operations and specialized compilers, to strengthen its inference capabilities. This move demonstrates Nvidia's commitment to maintaining dominance as competitors argue its GPUs are overspecialized and expensive for inference workloads.

Read at 24/7 Wall St.