7 ms·

Spherical Panoramas

54 points by app4soft 5y ago

app4soft 5y ago
Post on Twitter.[0] [0] https://twitter.com/sastuvel/status/1431936427252662276 https://twitter.com/sastuvel/status/1431936427252662276
- app4soft 5y ago
  Archived article[0] & Hugin script[1] [0] http://web.archive.org/web/20210829110828/https://stuvel.eu/articles/spherical-panoramas/ http://web.archive.org/web/20210829110828/https://stuvel.eu/... [1] http://web.archive.org/web/20210829220747/https://stuvel.eu/articles/spherical-panoramas/pano-hdr-5.assistant http://web.archive.org/web/20210829220747/https://stuvel.eu/...
ktpsns 5y ago
Wow, I haven't used/seen panorama stitching with Hugin for over a decade. I got the impression that ultra-wide angle cameras/lenses are quite widespread nowadays, especially with smartphones. Furthermore, they do "online" live-stitching while doing panoramas, instead of stitching them manually "offline" in the postprocessing. (Of course the quality of the manual stiches are way better)
- app4soft 5y ago
  > Furthermore, they do "online" live-stitching while doing panoramas This way it may be used for even creating video "on-the-go" with standalone camera position (with low FPS it may be useful for landscape timelaps video capture or panoramic webcam) - and as a result it could be cheaper alternative to such things as Facebook's Surround 360[0,1] DIY 3D-360 video capture system. Just as addition to software part it would require to design some sort of automatically rotated "panoramic tripod head" hardware synchronized with camera photo capture control (to take photos). [0] https://github.com/facebook/Surround360 https://github.com/facebook/Surround360 [1] https://engineering.fb.com/2016/07/26/video-engineering/surround-360-is-now-open-source/ https://engineering.fb.com/2016/07/26/video-engineering/surr...
folli 5y ago
I was actually looking for a way on how to generate such panoramas in Android using the accelerometer and magnetic sensor as support. Essentially what Google does with PhotoSphere. Does anyone know of any libraries or implementations of such a project?
- zimpenfish 5y ago
  I don't know specifically about Android but Dermandar[1] have an SDK which claims Android compatibility (I use their iOS app which takes horizontal panoramas as the phone rotates.) Also have a 360 solution SDK[2]. [1] http://www.dermandar.com http://www.dermandar.com [2] https://thevrkit.com/sdk/ https://thevrkit.com/sdk/
  - folli 5y ago
    Oh wow, that's an expensive option.
- bmh 5y ago
  I'm actually about to embark on exactly such a project. My plan is to use OpenCV's "stitching_detailed.cpp" example, and improve it from there. OpenCV's stitching is quite good out of the box, but I think I can improve it by adding knowledge from the phone's IMU. What do you need this for?
  - app4soft 5y ago
    > My plan is to use OpenCV's "stitching_detailed.cpp" example Has you seen next project?[0] [0] https://github.com/acodexm/Panorama360 https://github.com/acodexm/Panorama360
- app4soft 5y ago
  > Google does with PhotoSphere What about Sprayscape?[0] https://github.com/googlecreativelab/sprayscape https://github.com/googlecreativelab/sprayscape
  - 5y ago
tobr 5y ago
Are spherical panoramas usually stored as a single rectangular bitmap? Are there any compressed image formats that account for the distortion and optimize for the final projected output?
- corysama 5y ago
  A KTX file containing a cubemap compressed with Binomial would do the trick https://www.khronos.org/ktx/ https://www.khronos.org/ktx/
- MrLeap 5y ago
  equirectangular .EXR is a relatively common format I've seen in gamedev.
  - xscott 5y ago
    Just as a point of interest: If you're willing to pay the cost for a really good resampling algorithm, you can use a Gall-Peters projection. It's equal area instead of equal angle, so each pixel holds the same amount of surface area from the spherical image. Doing this, you could get a 2/Pi savings from the uncompressed image. https://en.wikipedia.org/wiki/Gall%E2%80%93Peters_projection https://en.wikipedia.org/wiki/Gall%E2%80%93Peters_projection However, it's easier to get good results with the equirectangular projection.
fsiefken 5y ago
It would be nice if there would be a relatively simple method to create stereoscopic spherical panoramas so one would feel even more immersed in VR
- moultano 5y ago
  You can't do that due to the hairy ball theorem. https://web.archive.org/web/20190603140245/elevr.com/elevrant-the-hairy-ball-theorem-in-vr-video/ https://web.archive.org/web/20190603140245/elevr.com/elevran...
- greeneggs 5y ago
  The Google Cardboard app does this. (Did this? I haven't used the app in a long time.)
  - bigiain 5y ago
    Nah, for photos/video it just halfasses it. It splits your single 360 pano into 2 images, one for each eye, but it doesn't do any stereo depth stuff. It's like being in the middle of a sphere with everything painter on it all the same distance away. When there's something 3d rendering the scene it can too stereoscopy, but if there's actual cameras trying to create stereo images in 360 - you always end up with the "what does it do when you're looking directly at the other eye's camera?" paradox.
    - jobigoud 5y ago
      It does stereo. You have to hold the device at arm's length and it reconstructs each eye by picking different rays from the side of the image. i.e. the left eye pano is made of rays looking to the right in the original frames. I played a lot with it a few years back, even wrote a library to read the files in C#.
jokoon 5y ago
I saw a website of someone who either painted or gave printable file of photos so that you can put them on an actual sphere. Was quite amazed by the result.
- carrozo 5y ago
  I bookmarked this on Reddit last year: https://www.reddit.com/r/interestingasfuck/comments/heke2b/a_360_photo_printed_on_a_sphere/?utm_source=share&utm_medium=ios_app&utm_name=iossmf https://www.reddit.com/r/interestingasfuck/comments/heke2b/a...
  - carrozo 5y ago
    Ooh, re-reading comments there and apparently you can order a spherical print of a panorama here: https://www.snapspheres.com/ https://www.snapspheres.com/

54 points by app4soft 5y ago

Post on Twitter.[0] [0] https://twitter.com/sastuvel/status/1431936427252662276 https://twitter.com/sastuvel/status/1431936427252662276

app4soft 5y ago
Archived article[0] & Hugin script[1] [0] http://web.archive.org/web/20210829110828/https://stuvel.eu/articles/spherical-panoramas/ http://web.archive.org/web/20210829110828/https://stuvel.eu/... [1] http://web.archive.org/web/20210829220747/https://stuvel.eu/articles/spherical-panoramas/pano-hdr-5.assistant http://web.archive.org/web/20210829220747/https://stuvel.eu/...

ktpsns 5y ago

Wow, I haven't used/seen panorama stitching with Hugin for over a decade. I got the impression that ultra-wide angle cameras/lenses are quite widespread nowadays, especially with smartphones. Furthermore, they do "online" live-stitching while doing panoramas, instead of stitching them manually "offline" in the postprocessing. (Of course the quality of the manual stiches are way better)

app4soft 5y ago
> Furthermore, they do "online" live-stitching while doing panoramas This way it may be used for even creating video "on-the-go" with standalone camera position (with low FPS it may be useful for landscape timelaps video capture or panoramic webcam) - and as a result it could be cheaper alternative to such things as Facebook's Surround 360[0,1] DIY 3D-360 video capture system. Just as addition to software part it would require to design some sort of automatically rotated "panoramic tripod head" hardware synchronized with camera photo capture control (to take photos). [0] https://github.com/facebook/Surround360 https://github.com/facebook/Surround360 [1] https://engineering.fb.com/2016/07/26/video-engineering/surround-360-is-now-open-source/ https://engineering.fb.com/2016/07/26/video-engineering/surr...

folli 5y ago

I was actually looking for a way on how to generate such panoramas in Android using the accelerometer and magnetic sensor as support. Essentially what Google does with PhotoSphere. Does anyone know of any libraries or implementations of such a project?

zimpenfish 5y ago
I don't know specifically about Android but Dermandar[1] have an SDK which claims Android compatibility (I use their iOS app which takes horizontal panoramas as the phone rotates.) Also have a 360 solution SDK[2]. [1] http://www.dermandar.com http://www.dermandar.com [2] https://thevrkit.com/sdk/ https://thevrkit.com/sdk/
- folli 5y ago
  Oh wow, that's an expensive option.
bmh 5y ago
I'm actually about to embark on exactly such a project. My plan is to use OpenCV's "stitching_detailed.cpp" example, and improve it from there. OpenCV's stitching is quite good out of the box, but I think I can improve it by adding knowledge from the phone's IMU. What do you need this for?
- app4soft 5y ago
  > My plan is to use OpenCV's "stitching_detailed.cpp" example Has you seen next project?[0] [0] https://github.com/acodexm/Panorama360 https://github.com/acodexm/Panorama360
app4soft 5y ago
> Google does with PhotoSphere What about Sprayscape?[0] https://github.com/googlecreativelab/sprayscape https://github.com/googlecreativelab/sprayscape
- 5y ago

tobr 5y ago

Are spherical panoramas usually stored as a single rectangular bitmap? Are there any compressed image formats that account for the distortion and optimize for the final projected output?

corysama 5y ago
A KTX file containing a cubemap compressed with Binomial would do the trick https://www.khronos.org/ktx/ https://www.khronos.org/ktx/
MrLeap 5y ago
equirectangular .EXR is a relatively common format I've seen in gamedev.
- xscott 5y ago
  Just as a point of interest: If you're willing to pay the cost for a really good resampling algorithm, you can use a Gall-Peters projection. It's equal area instead of equal angle, so each pixel holds the same amount of surface area from the spherical image. Doing this, you could get a 2/Pi savings from the uncompressed image. https://en.wikipedia.org/wiki/Gall%E2%80%93Peters_projection https://en.wikipedia.org/wiki/Gall%E2%80%93Peters_projection However, it's easier to get good results with the equirectangular projection.

fsiefken 5y ago

It would be nice if there would be a relatively simple method to create stereoscopic spherical panoramas so one would feel even more immersed in VR

moultano 5y ago
You can't do that due to the hairy ball theorem. https://web.archive.org/web/20190603140245/elevr.com/elevrant-the-hairy-ball-theorem-in-vr-video/ https://web.archive.org/web/20190603140245/elevr.com/elevran...
greeneggs 5y ago
The Google Cardboard app does this. (Did this? I haven't used the app in a long time.)
- bigiain 5y ago
  Nah, for photos/video it just halfasses it. It splits your single 360 pano into 2 images, one for each eye, but it doesn't do any stereo depth stuff. It's like being in the middle of a sphere with everything painter on it all the same distance away. When there's something 3d rendering the scene it can too stereoscopy, but if there's actual cameras trying to create stereo images in 360 - you always end up with the "what does it do when you're looking directly at the other eye's camera?" paradox.
  - jobigoud 5y ago
    It does stereo. You have to hold the device at arm's length and it reconstructs each eye by picking different rays from the side of the image. i.e. the left eye pano is made of rays looking to the right in the original frames. I played a lot with it a few years back, even wrote a library to read the files in C#.

jokoon 5y ago

I saw a website of someone who either painted or gave printable file of photos so that you can put them on an actual sphere. Was quite amazed by the result.

carrozo 5y ago
I bookmarked this on Reddit last year: https://www.reddit.com/r/interestingasfuck/comments/heke2b/a_360_photo_printed_on_a_sphere/?utm_source=share&utm_medium=ios_app&utm_name=iossmf https://www.reddit.com/r/interestingasfuck/comments/heke2b/a...
- carrozo 5y ago
  Ooh, re-reading comments there and apparently you can order a spherical print of a panorama here: https://www.snapspheres.com/ https://www.snapspheres.com/