6 ms·

Gemma 3 is out! Multimodal (image + text), 128K context, supports 140+ languages, and comes in 1B, 4B, 12B, and 27B sizes with open weights & commercial use. G

Gemma 3 is out! Multimodal (image + text), 128K context, supports 140+ languages, and comes in 1B, 4B, 12B, and 27B sizes with open weights & commercial use. Gemma 3 model overview: https://ai.google.dev/gemma/docs/core https://ai.google.dev/gemma/docs/core Huggingface collection: https://huggingface.co/collections/google/gemma-3-release-67c6c6f89c4f76621268bb6d https://huggingface.co/collections/google/gemma-3-release-67... ollama: https://ollama.com/library/gemma3 https://ollama.com/library/gemma3

derbaum 2y ago
The ollama page shows Gemma 27B beating Deepseek v3 and o3-mini on lmarena. I'm very excited to try it out.
- deleted 2y ago
  [deleted]
- Hiskias 2y ago
  Same!
LeoPanthera 2y ago
Doesn't yet work in LM Studio. Barfs an error when trying to load the model. (Error 6, whatever that means. Happy I missed the first 5.)
- diggan 2y ago
  > Barfs an error when trying to load the model Since you're not using the official models (since they're not GGUFs), what exact model are you trying to use? The 3rd party you rely on might have screwed something up.
  - deleted 2y ago
    [deleted]
- osanseviero 2y ago
  Please make sure to update to the latest llama.cpp version
- genewitch 2y ago
  You need the newest llama.cpp and if you have an amd card and recently updated the drivers, roll them back. Most people complaining are using ROCm. I assure you gemma 3 works fine in LM studio. Gguf and MLx are available.
upghost 2y ago
I'm still a huge fan of gemma-22b. Looking forward to this one!
diggan 2y ago
> open weights What exactly is this supposed to mean? That I can grab the weights by just downloading them, or something like that? Because when I open up the HuggingFace repository, it asks me to "accept the conditions" (Google’s usage license). How is this different from any other proprietary binaries people distribute on the internet but let you run locally? Are other software (like 1Password for example) also "open software" because you can download it?
- idonotknowwhy 2y ago
  Replace "google" with "unsloth" in the browser address bar if you want to download them without signing up to hf
  - diggan 2y ago
    Regardless of where you get the weights, Google says you need to follow their terms and conditions for the model/weights: > By using, reproducing, modifying, distributing, performing or displaying any portion or element of Gemma, Model Derivatives including via any Hosted Service, (each as defined below) (collectively, the "Gemma Services") or otherwise accepting the terms of this Agreement, you agree to be bound by this Agreement. https://ai.google.dev/gemma/terms https://ai.google.dev/gemma/terms Worth knowing if you're planning to use this model for production usage/with a business. So once again, I don't understand what "open" is supposed to mean when they call models like these "open weights". What part exactly is "open"?
    - whimsicalism 2y ago
      i think generally these companies are too afraid of the obvious rejoinder to try actually enforcing these terms
      - diggan 2y ago
        Probably, up until they aren't. Are you willing to bet against Google's lawyers feeling daring in the future? As a private individual, I sure aren't, and I don't think I'd bet my (hypothetical) business on it either.
genpfault 2y ago
> ollama: https://ollama.com/library/gemma3 https://ollama.com/library/gemma3 Needs an ollama newer than 0.5.11. Probably the very-recently-released v0.6.0[1]: > New Model: > * Gemma 3: Google Gemma 3 model is now available in 1B, 4B, 12B, and 27B parameter sizes. [1]: https://github.com/ollama/ollama/releases/tag/v0.6.0 https://github.com/ollama/ollama/releases/tag/v0.6.0
- starik36 2y ago
  Doesn't work on 0.5.13. Had to upgrade to 0.6.0.
setgree 2y ago
A kind of ancillary note, but it's amazing to me how fragmented this presentation and documentation is: * the parent link is to storage.googleapis.com * There's documentation on ai.google.dev * The announcement blogpost is https://blog.google/technology/developers/gemma-3/ https://blog.google/technology/developers/gemma-3/ * you try it on https://aistudio.google.com/ https://aistudio.google.com/ It's helpful to have a top-level post like this, but can some PM please consolidate this into, IDK, ai.google.com/gemini?
- klysm 2y ago
  I don't see how this actually matters - who cares if it it's different top level domains?
  - jhayward 2y ago
    Two reasons it matters: 1) Discoverability 2) "System structure mirrors organization". I.E., it's an indicator of a fragmented and disorganized structure that's not likely to produce cohesive product results.
    - mtrovo 2y ago
      > System structure mirrors organization You listed: - one static pdf file stored on a CDN - one company blog static website - one developer documentation static website - one interactive product URL As much as I like to dunk on how messy things can be at Google I don't think this is a really good example. Apart from small startups I would be scared if you served all of them from the same base host.
      - setgree 2y ago
        The many domains is a problem because it suggests a many-teams approach to product development, and the more cooks in the kitchen, the more likely a repeat of Gemini 1’s rollout, which was a mess [0]. Basically I’m looking to see that Google cares about the meta-level user experience of finding, understanding, and using its products, and scattering key usage details around the internet is not a good sign. It suggests deeper process problems if a simple issue like this either didn’t get noticed or can’t get fixed. [0] https://www.theguardian.com/technology/2024/mar/08/we-definitely-messed-up-why-did-google-ai-tool-make-offensive-historical-images https://www.theguardian.com/technology/2024/mar/08/we-defini...

derbaum 2y ago

The ollama page shows Gemma 27B beating Deepseek v3 and o3-mini on lmarena. I'm very excited to try it out.

deleted 2y ago
[deleted]
Hiskias 2y ago
Same!

LeoPanthera 2y ago

Doesn't yet work in LM Studio. Barfs an error when trying to load the model. (Error 6, whatever that means. Happy I missed the first 5.)

diggan 2y ago
> Barfs an error when trying to load the model Since you're not using the official models (since they're not GGUFs), what exact model are you trying to use? The 3rd party you rely on might have screwed something up.
- deleted 2y ago
  [deleted]
osanseviero 2y ago
Please make sure to update to the latest llama.cpp version
genewitch 2y ago
You need the newest llama.cpp and if you have an amd card and recently updated the drivers, roll them back. Most people complaining are using ROCm. I assure you gemma 3 works fine in LM studio. Gguf and MLx are available.

upghost 2y ago

I'm still a huge fan of gemma-22b. Looking forward to this one!

diggan 2y ago

> open weights What exactly is this supposed to mean? That I can grab the weights by just downloading them, or something like that? Because when I open up the HuggingFace repository, it asks me to "accept the conditions" (Google’s usage license). How is this different from any other proprietary binaries people distribute on the internet but let you run locally? Are other software (like 1Password for example) also "open software" because you can download it?

idonotknowwhy 2y ago
Replace "google" with "unsloth" in the browser address bar if you want to download them without signing up to hf
- diggan 2y ago
  Regardless of where you get the weights, Google says you need to follow their terms and conditions for the model/weights: > By using, reproducing, modifying, distributing, performing or displaying any portion or element of Gemma, Model Derivatives including via any Hosted Service, (each as defined below) (collectively, the "Gemma Services") or otherwise accepting the terms of this Agreement, you agree to be bound by this Agreement. https://ai.google.dev/gemma/terms https://ai.google.dev/gemma/terms Worth knowing if you're planning to use this model for production usage/with a business. So once again, I don't understand what "open" is supposed to mean when they call models like these "open weights". What part exactly is "open"?
  - whimsicalism 2y ago
    i think generally these companies are too afraid of the obvious rejoinder to try actually enforcing these terms
    - diggan 2y ago
      Probably, up until they aren't. Are you willing to bet against Google's lawyers feeling daring in the future? As a private individual, I sure aren't, and I don't think I'd bet my (hypothetical) business on it either.

genpfault 2y ago

> ollama: https://ollama.com/library/gemma3 https://ollama.com/library/gemma3 Needs an ollama newer than 0.5.11. Probably the very-recently-released v0.6.0[1]: > New Model: > * Gemma 3: Google Gemma 3 model is now available in 1B, 4B, 12B, and 27B parameter sizes. [1]: https://github.com/ollama/ollama/releases/tag/v0.6.0 https://github.com/ollama/ollama/releases/tag/v0.6.0

starik36 2y ago
Doesn't work on 0.5.13. Had to upgrade to 0.6.0.

setgree 2y ago

A kind of ancillary note, but it's amazing to me how fragmented this presentation and documentation is: * the parent link is to storage.googleapis.com * There's documentation on ai.google.dev * The announcement blogpost is https://blog.google/technology/developers/gemma-3/ https://blog.google/technology/developers/gemma-3/ * you try it on https://aistudio.google.com/ https://aistudio.google.com/ It's helpful to have a top-level post like this, but can some PM please consolidate this into, IDK, ai.google.com/gemini?

klysm 2y ago
I don't see how this actually matters - who cares if it it's different top level domains?
- jhayward 2y ago
  Two reasons it matters: 1) Discoverability 2) "System structure mirrors organization". I.E., it's an indicator of a fragmented and disorganized structure that's not likely to produce cohesive product results.
  - mtrovo 2y ago
    > System structure mirrors organization You listed: - one static pdf file stored on a CDN - one company blog static website - one developer documentation static website - one interactive product URL As much as I like to dunk on how messy things can be at Google I don't think this is a really good example. Apart from small startups I would be scared if you served all of them from the same base host.
    - setgree 2y ago
      The many domains is a problem because it suggests a many-teams approach to product development, and the more cooks in the kitchen, the more likely a repeat of Gemini 1’s rollout, which was a mess [0]. Basically I’m looking to see that Google cares about the meta-level user experience of finding, understanding, and using its products, and scattering key usage details around the internet is not a good sign. It suggests deeper process problems if a simple issue like this either didn’t get noticed or can’t get fixed. [0] https://www.theguardian.com/technology/2024/mar/08/we-definitely-messed-up-why-did-google-ai-tool-make-offensive-historical-images https://www.theguardian.com/technology/2024/mar/08/we-defini...