3 ms·

You can run it by compiling transformers from source: https://huggingface.co/google/paligemma-3b-mix-448 https://huggingface.co/google/paligemma-3b-mix-448

• simonw 2y ago
  Have you seen that work on a Mac? I've had very bad luck getting anything complex to work with transformers on that platform.
  • adefa 2y ago
    Yes, I was able to run inference on the unquantized model in CPU land on Apple Silicon.