4 ms·
The whole "foveated streaming" sounds absolutely fascinating. If they can actually pull off doing it accurately in real time, that would be incredible. I can't
by Night_Thastus 1y ago
The whole "foveated streaming" sounds absolutely fascinating. If they can actually pull off doing it accurately in real time, that would be incredible. I can't even imagine the technical work behind the scenes to make it all work.
I'd really like to know what the experience is like of using it, both for games and something like video.
- rowanG077 1y agoThere is a LTT video: https://www.youtube.com/watch?v=dU3ru09HTng https://www.youtube.com/watch?v=dU3ru09HTng Linus says he cannot tell it is actually foveated streaming.
- Night_Thastus 1y agoI believe in Linus very little. I'll keep my eyes peeled to see what others say. It's certainly possible though, Valve has the chops to pull it off.
- stetrain 1y agoNorm from Tested said the same in his video. https://youtu.be/b7q2CS8HDHU https://youtu.be/b7q2CS8HDHU
- potatolicious 1y agoThe Verge reports similarly - can't tell foveated streaming. Seems like Valve really cracked the code with this one.
- nabakin 1y agoI don't think a lot of people realize how big of a deal this is. You used to have to choose between wireless and slow or wired and fast. Now you can have both wireless and fast. It's insane.
- stetrain 1y agoYep, that basically guarantees this as a purchase for me. It's basically a Quest 3 with some improvements, an open non-Meta OS, and the various WiFi and Streaming app issues fixed to make it nearly as good as a wired headset.
- nabakin 1y agoI haven't bought a VR headset since the Oculus Rift CV1, but this might do it for me
- ehnto 1y agoIf you are lucky enough to have wired as an option anyway, especially in linux this has been shaky. But with Steam continuing to push into linux and VR I have no doubt this will change quickly.
- deleted 1y ago[deleted]
- birdman3131 1y agoThats not what he said. What he said was even rapidly moving his eyes around he could not spot the lower resolution part.
- rowanG077 1y agoIf you are going to be pedantic then at least do it right. Because that's also not what he said. He said that no matter how fast he moved his eyes he wasn't able to catch it.
- archon810 1y agoSame with Dave2D https://youtu.be/356rZ8IBCps https://youtu.be/356rZ8IBCps.
- stetrain 1y agoHow is that meaningfully different than not being able to tell that it's foveated?
- nabakin 1y agoAlso mentions 1-2ms latency on a modern GPU
- pixelpoet 1y agoThere's an awesome shader on shadertoy that illustrates just how extreme the fovea focus is: https://www.shadertoy.com/view/4dsXzM https://www.shadertoy.com/view/4dsXzM Linus the shrill/yappy poodle and his channel are less than worthless IMO.
- jasonjmcghee 1y agoWhen you full screen this, it's crazy how tiny the area that spins is. For me it's like an inch or inch and a half on a 32 inch 4k display at a normal seated position. (If I move my head closer it gets larger, further and it gets smaller)
- Night_Thastus 1y agoImagine if we could hook this into game rendering as well. Have super high resolution models, textures, shadows, etc near where the player is looking, and use lower LoDs elsewhere. It could really push the boundaries of detail and efficiency, if we could somehow do it real-time for something that complex. (Streaming video sounds a lot easier)
- scld 1y agoGame rendering is what they're talking about here. John Carmack has talked about this a bunch if you'd like to seed a google search.
- FeepingCreature 1y agoNot quite: you can use it for games rendering, but with a Wifi adapter you more importantly want to use it for the video signal, and only transfer highres in the area you're looking at. A 4k game (2048*2048*2 screens) is 25gbit uncompressed at 100fps, which would stress even Wifi-7. With foveated rendering you can probably get that down to 8gbit easy.
- LtdJorge 1y agoNot just stress WiFi 7, even if the theoretical limit is 23Gbps, you’re not getting anywhere close to that sending to just one device.
- modeless 1y agoFoveated streaming should be much easier to implement than foveated rendering. Just encode two streams, a low res one and a high res one, and move the high res one around.
- ghosty141 1y agoI'm super curious how they will implement it, if it's a general api in steam vr that headsets like the Bigscreen Beyond could use or if it's more tailored towards the Frame. I hope it's the first as to me it sounds like all you need is eye input and the two streams, the rest could be done by steam-vr.
- ynx 1y agoIf you use a Quest Pro and use Steam Link with a WiFi 6E access point, that should accurately represent the experience of using it. It's close to imperceptible in normal usage.