Broadcom's plan for faster AI clusters: strap optics to GPUs
Briefly

In high-end clusters, copper can only carry signals about three to five meters before degradation, signaling the need for optical solutions.
Nvidia estimates that switching to optics for their systems would mean an additional 20 kilowatts of power usage per rack, increasing operational costs.
Broadcom is experimenting with co-packaging optics directly into GPUs to overcome bandwidth limitations and improve overall interconnect performance.
Co-packaged optics have been a focus for Broadcom, showcasing advancements like a second generation CPO switch achieving 51.2Tbit/sec with enhanced optical connectivity.
Read at Theregister
[
|
]