5 ms·
Does anyone know the performance of this vs BLIP-2?
by m00x 3y ago
Does anyone know the performance of this vs BLIP-2?
- sitkack 3y agoGiven the exposure hn has had to blip-2 it might be good to provide more context. https://arxiv.org/abs/2301.12597 https://arxiv.org/abs/2301.12597 https://hn.algolia.com/?dateRange=all&page=0&prefix=true&query=BLIP-2&sort=byPopularity&type=story https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que... Were you expecting a response?
- m00x 3y agoI'm not sure what you mean. HN has a wide array of people that have multiple sources of information. I was throwing a question out there hoping an expert in the matter would know. They're both multi-modal models for zero-shot answering. I'm not sure what the purpose of this comment is. If no experts see this, I won't get an answer. You don't need to reply with something completely useless that adds nothing to the topic.
- sitkack 3y agoI am recommending that you add more context to your question since it has been posted a couple times but has had zero engagement. HN is not an AIML discussion forum. Putting 10% more work in the question could yield 400% better responses. Linking to what BLIP2 is a good start https://huggingface.co/docs/transformers/main/en/model_doc/blip-2 https://huggingface.co/docs/transformers/main/en/model_doc/b... https://github.com/salesforce/LAVIS https://github.com/salesforce/LAVIS
- m00x 3y agoI'm not expecting someone to go out and do the work for me. If someone happens to know, I'd love a response, otherwise I don't expect one. This reply serves exactly no purpose.
- brianjking 3y agoI don't think Google has released the weights or anything outside of what is linked here, I'd love to know though. Have you looked at YOLOv8 vs BLIP2?
- m00x 3y agoYOLOv8 is an object detection model, BLIP2 and MaMMUT are image<>text generative models.
- brianjking 3y agoYOLOv8 can do image segmentation with labeling (it might need SAM for labels) - but yeah, I understand. For my use they're kind of able to be used interchangeably in this case, depending on which can detect objects in the image and generate a caption or image/text match (BLIP2) or detect via object detection or segmentation in SAM.