4 ms·
You could have also just looked at the documentation linked in the original post...
by sigmoid10 2y ago
You could have also just looked at the documentation linked in the original post...
- simonw 2y agoHave you seen any documents that help explain how to interpret those tokens?
- zerojames 2y ago(I work at Roboflow) We're actively working on this! Our ML team has noted that the segmentation masks in particular from PaLiGemma are a bit tedious and unintuitive to decode. We should be pushing out (more!) open source software that uses this model in the coming days. Look forward to an easy way to fine-tune PaLiGemma and broader support for its task types in `inference`, the package used in the blog post.
- llama_person 2y agohttps://huggingface.co/spaces/google/paligemma/blob/main/paligemma_parse.py#L132 https://huggingface.co/spaces/google/paligemma/blob/main/pal... the blog post details it but essentially to convert from PaliGemma tokens to bbox: y0 / 1024 * h x0 / 1024 * w y1 / 1024 * h x1 / 1024 * w have not played with segmentation yet.
- sigmoid10 2y agoSure. Click on the github link in the post and look at the readme. It's all there. There is even a linked paper.