3 ms·
They’re using some off the shelf multimodal LLM API, perhaps Gemini 1.5 or something else. And no off the shelf VLM API is capable of handling 4 channel images
by woadwarrior01 1y ago
They’re using some off the shelf multimodal LLM API, perhaps Gemini 1.5 or something else. And no off the shelf VLM API is capable of handling 4 channel images (RGB+D).
- wahnfrieden 1y agoYou can take crude measurements from the depth map and provide as text. Or perhaps provide the depth map as an image next to the actual image as those are certainly in training data. I haven’t tested these