AI data center boom squeezes consumer tech's chip supply-even though they use different chips

"Smartphones and PCs require low power use, thermal efficiency, and tight integration. Data centers that run AI systems such as large language models, or LLMs, require maximum compute power, memory bandwidth, and storage throughput. To meet these needs, consumer devices tend to rely on systems-on-a-chip-chips that combine processing and storage-with dynamic random access memory, or DRAM, and NAND, a type of nonvolatile memory."

"AI is not replacing consumer electronics; it is reorganizing the chip market around new priorities for specific chip characteristics. Data centers are pulling capital and scarce memory capacity toward the production of accelerator processors and high-bandwidth memory and the data handling and electronics equipment that surround them."

"Chip manufacturing behaves less like a competitive commodity market and more like a layered oligopoly. Scale matters because the leading firms can reinvest in research, improve yields, secure equipment, and deepen customer relationships."

Data center construction for AI systems is consuming substantial high-tech chip supplies, constraining consumer device manufacturers despite servers and smartphones requiring different chip types. Smartphones and PCs need low power consumption, thermal efficiency, and integrated systems combining processing and storage with DRAM and NAND memory. AI servers require GPUs or accelerator processors paired with high-bandwidth memory for maximum compute power and throughput. The consumer electronics shortage stems from chip market characteristics: concentration among few manufacturers, high production costs, and boom-and-bust cycles. AI is reorganizing chip market priorities toward accelerator processors and high-bandwidth memory production rather than replacing consumer electronics entirely.

Read at Fast Company