5 ms·
PaliGemma
- tosh 3y agoHow does this model compare to the 3b Gemma if I would use it only with text?
- coder543 3y agoWell, to start with, there is no regular 3B Gemma. There are 2B and 7B Gemma models. I would guess this model is adding an extra 1B parameters to the 2B model to handle visual understanding. The 2B model is not very smart to begin with, so… I would expect this one to not be very smart either if you only use it for text, but I wouldn’t expect it to be much worse. It could potentially be useful/interesting for simple visual understanding prompts.
- mmastrac 3y agoThis is an impressive amount of public AI work coming out of Google. The competition we're seeing here is really pushing things forward.
- curl-up 3y agoAnyone here have experience with extracting image embeddings out of these models? All the image emb. models I tried so far were quite bad for my use cases, and I feel that hidden representations of models like these might be much better.
- m3kw9 3y agoGoogle markets their new tech like arxiv articles. They have lots to learn from OpenAI
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- airbreather 3y agoIt refers to images, but would that extend to diagrams, like engineering drawings?
- simonw 3y agoAnyone found a good recipe to run this on a Mac yet?
- adefa 3y agoYou can run it by compiling transformers from source: https://huggingface.co/google/paligemma-3b-mix-448 https://huggingface.co/google/paligemma-3b-mix-448
- histories 3y agoJust from the name my mind raced to LLMs trained on the Pali canon
- echelon_musk 3y agoI had the same assumption!
- Alifatisk 3y agoIs this related to Project Astra?