3 ms·
I know that (and I'm not building a calorie counter). The question is about whether 4o can read photos better with depth maps or derived measurements provided a
by wahnfrieden 1y ago
I know that (and I'm not building a calorie counter). The question is about whether 4o can read photos better with depth maps or derived measurements provided alongside the original image and the example was chosen as it's inaccurate but could perhaps be improved with depth map data (even if not to the point of "accurate")
- duskwuff 1y agoThe answer to that question is "probably not". First: the image recognition model is unlikely to have seen very many depth maps. Seeing one alongside a photo probably won't help it recognize the image any better. Second: even if the model knew what to do with a depth map, there's no reason to suspect that it'd help in this application. The lack of accuracy in a image-to-calorie-count app doesn't come from problems which a depth map can answer like "is this plate sitting on the table or raised above it"; they come from problems which can't be answered visually like "is this a glass of whole milk or non-fat" or "are these vegetables glossy because they're damp or because they're covered in butter".
- wahnfrieden 1y agoDepth map can be used to measure dimensions of objects, not only relative positions