"Valve's new streaming-first VR headset - the Steam Frame - employs a clever trick to help make game streaming feel as low-latency as possible. It's called foveated streaming, and it means the headset requests a higher-quality image for the content that's right in front of your eyes while lowering the resolution of your peripheral vision to reduce bandwidth and processing demands."
"The headset relies on a couple pieces of hardware to make that happen. The first is a dedicated wireless streaming adapter that sends games from a PC to the headset. The second is a pair of eye-tracking cameras inside the headset that follow where you're looking. If you're familiar with foveated rendering, which headsets like Apple's Vision Pro deploy for on-device processing, it's a similar idea."
"Valve tells The Verge that foveated streaming won't be exclusive to the Frame. While it's currently optimized for the Steam Frame, foveated streaming can work with "any headset that supports eye tracking" and that is "compatible with our Steam Link streaming app," according to hardware engineer Jeremy Selan. I've seen foveated streaming in action myself, and it's extremely impressive."
Valve's Steam Frame implements foveated streaming, requesting higher-resolution imagery for the foveal region while lowering peripheral resolution to cut bandwidth and processing. The system uses a dedicated wireless streaming adapter to send PC-rendered games and dual eye-tracking cameras inside the headset to monitor gaze. Foveated streaming parallels foveated rendering used for on-device processing but shifts workload to the PC. The feature is optimized for the Steam Frame but can work with any headset that supports eye tracking and is compatible with the Steam Link streaming app. Early hands-on experience reported virtually indistinguishable streamed gameplay. Wireless adapter support requires lower-level OS integration, available on SteamOS.
Read at The Verge
Unable to calculate read time
Collection
[
|
...
]