The Neural Processing Unit (NPU) acts as a power-efficient chip complementing a computer's CPU and GPU, particularly for generative AI tasks like image recognition and voice transcription. Microsoft has integrated NPUs into its CoPilot+ PCs, which are required to achieve a performance benchmark of 40 trillion operations per second. Despite the inclusion of NPUs from manufacturers like Qualcomm and Intel, their potential remains underutilized, suggesting a need for software optimization to fully leverage their capabilities in executing AI-driven applications effectively.
"The NPU's ability to offload these tasks from the CPU and GPU allows for faster, more efficient operation of the entire system," Microsoft said.
"Microsoft introduced CoPilot+ PCs last year with NPUs to run genAI tools. The software maker mandated that CoPilot+ PCs include NPUs and that the collective system performance reach 40+ TOPS."
Collection
[
|
...
]