3 ms·

Couldn’t you just use iphone pros for this? I developed an app specifically for photogrammetry capture using AR and the depth sensor as it seemed like a cheap a

Couldn’t you just use iphone pros for this? I developed an app specifically for photogrammetry capture using AR and the depth sensor as it seemed like a cheap alternative. EDIT: I realize a phone is not on the same level as a red camera, but i just saw iphones as a massively cheaper option to alternatives in the field i worked in.

F7F7F7 9mo ago
ASAP Rocky has a fervent fanbase who's been anticipating this album. So I'm assuming that whatever record label he's signed to gave him the budget. And when I think back to another iconic hip hop (iconic that genre) video where they used practical effects and military helicopters chasing speedboats in the waters off of Santa Monica...I bet they had change to spear.
- cwillu 9mo ago
  Is there any reason to think https://thebaffler.com/salvos/the-problem-with-music https://thebaffler.com/salvos/the-problem-with-music doesn't apply here?
fastasucan 9mo ago
Why would they go for the cheapest option?
- secretsatan 9mo ago
  It was more the point that technology is much cheaper. The company i worked for had completely missed it while trying to develop in house solutions.
darhodester 9mo ago
I think it's because they already had proven capture hardware, harvest, and processing workflows. But yes, you can easily use iPhones for this now.
- secretsatan 9mo ago
  Looks great by the way, i was wondering if there’s a file format for volumetric video captures
  - secretsatan 9mo ago
    Recording pointclouds over time i guess i mean. I’m not going to pretend to understand video compression, but could it be possible to do the following movement aspect in 3d the same as 2d?
  - darhodester 9mo ago
    Some companies have a proprietary file format for compressed 4D Gaussian splatting. For example: https://www.gracia.ai https://www.gracia.ai and https://www.4dv.ai https://www.4dv.ai. Check this project, for example: https://zju3dv.github.io/freetimegs/ https://zju3dv.github.io/freetimegs/ Unfortunately, these formats are currently closed behind cloud processing so adoption is a rather low. Before Gaussian splatting, textured mesh caches would be used for volumetric video (e.g. Alembic geometry).
  - itishappy 9mo ago
    https://developer.apple.com/av-foundation/ https://developer.apple.com/av-foundation/ https://developer.apple.com/documentation/spatial/ https://developer.apple.com/documentation/spatial/ Edit: As I'm digging, this seems to be focused on stereoscopic video as opposed to actual point clouds. It appears applications like cinematic mode use a monocular depth map, and their lidar outputs raw point cloud data.
    - numpad0 9mo ago
      A LIDAR point cloud from a single point of view is a mono-ocular depth map. Unless the LIDAR in question is like, using supernova level gamma rays or neutrino generators for the laser part to get density and albedo volumetric data for its whole distance range. You just can't see the back of a thing by knowing the shape of the front side with current technologies.
numpad0 9mo ago
A single camera only captures the side of the object facing the camera. Knowing how far away that camera facing side of a Rubik's Cube help if you were making educated guesses(novel view synthesis), but it won't solve the problem of actually photographing the backside. There are usually six sides on a cube, which means you need minimum six iPhone around an object to capture all sides of it to be able to then freely move around it. You might as well seek open-source alternatives than relying on Apple surprise boxes for that. In cases where your subject would be static, such as it being a building, then you can wave around a single iPhone for the same effect for a result comparable to more expensive rigs, of course.
- deleted 9mo ago
  [deleted]
- antidamage 9mo ago
  The minimum is four RGB-only cameras (if you want RGB data) but adding lidar really helps. The standard pipeline can infer a huge amount of data, and there are a few AI tools now for hallucinating missing geometry and backfaces based on context recognition, which can then be converted back into a splat for fast, smooth rendering.

F7F7F7 9mo ago

ASAP Rocky has a fervent fanbase who's been anticipating this album. So I'm assuming that whatever record label he's signed to gave him the budget. And when I think back to another iconic hip hop (iconic that genre) video where they used practical effects and military helicopters chasing speedboats in the waters off of Santa Monica...I bet they had change to spear.

cwillu 9mo ago
Is there any reason to think https://thebaffler.com/salvos/the-problem-with-music https://thebaffler.com/salvos/the-problem-with-music doesn't apply here?

fastasucan 9mo ago

Why would they go for the cheapest option?

secretsatan 9mo ago
It was more the point that technology is much cheaper. The company i worked for had completely missed it while trying to develop in house solutions.

darhodester 9mo ago

I think it's because they already had proven capture hardware, harvest, and processing workflows. But yes, you can easily use iPhones for this now.

secretsatan 9mo ago
Looks great by the way, i was wondering if there’s a file format for volumetric video captures
- secretsatan 9mo ago
  Recording pointclouds over time i guess i mean. I’m not going to pretend to understand video compression, but could it be possible to do the following movement aspect in 3d the same as 2d?
- darhodester 9mo ago
  Some companies have a proprietary file format for compressed 4D Gaussian splatting. For example: https://www.gracia.ai https://www.gracia.ai and https://www.4dv.ai https://www.4dv.ai. Check this project, for example: https://zju3dv.github.io/freetimegs/ https://zju3dv.github.io/freetimegs/ Unfortunately, these formats are currently closed behind cloud processing so adoption is a rather low. Before Gaussian splatting, textured mesh caches would be used for volumetric video (e.g. Alembic geometry).
- itishappy 9mo ago
  https://developer.apple.com/av-foundation/ https://developer.apple.com/av-foundation/ https://developer.apple.com/documentation/spatial/ https://developer.apple.com/documentation/spatial/ Edit: As I'm digging, this seems to be focused on stereoscopic video as opposed to actual point clouds. It appears applications like cinematic mode use a monocular depth map, and their lidar outputs raw point cloud data.
  - numpad0 9mo ago
    A LIDAR point cloud from a single point of view is a mono-ocular depth map. Unless the LIDAR in question is like, using supernova level gamma rays or neutrino generators for the laser part to get density and albedo volumetric data for its whole distance range. You just can't see the back of a thing by knowing the shape of the front side with current technologies.

numpad0 9mo ago

A single camera only captures the side of the object facing the camera. Knowing how far away that camera facing side of a Rubik's Cube help if you were making educated guesses(novel view synthesis), but it won't solve the problem of actually photographing the backside. There are usually six sides on a cube, which means you need minimum six iPhone around an object to capture all sides of it to be able to then freely move around it. You might as well seek open-source alternatives than relying on Apple surprise boxes for that. In cases where your subject would be static, such as it being a building, then you can wave around a single iPhone for the same effect for a result comparable to more expensive rigs, of course.

deleted 9mo ago
[deleted]
antidamage 9mo ago
The minimum is four RGB-only cameras (if you want RGB data) but adding lidar really helps. The standard pipeline can infer a huge amount of data, and there are a few AI tools now for hallucinating missing geometry and backfaces based on context recognition, which can then be converted back into a splat for fast, smooth rendering.