Meta has a varifocal VR HMD prototype using some kind of stack of switchable prisms to adjust focus based on eye gaze with the rest of the hardware off the shel

Meta has a varifocal VR HMD prototype using some kind of stack of switchable prisms to adjust focus based on eye gaze with the rest of the hardware off the shelf, theoretically solving 2 and 3 without needing entirely new display assemblies. Lightfield captures, particularly video, are jaw dropping even using current headsets. The only things I've seen are Google's demo, mostly clips of common day things like ocean waves, a dude with some angle grinder (the sparks!) and of course a doggy. It's a little soft and there's some artifacts when moving your head too much, but when it works it's very convincing. I think there's potential there for narrative film making, but you are not wrong to call it a work in progress.