5 ms·

Hi Austin, what say you about how the Gemma rollout was handled, issues raised, and atmosphere around the office? :)

trisfromgoogle 3y ago
I'm not Austin, but I am Tris, the friendly neighborhood product person on Gemma. Overall, I think that the main feeling is: incredibly relieved to have had the launch go as smoothly as it has! The complexity of the launch is truly astounding: 1) Reference implementations in JAX, PyTorch, TF with Keras 3, MaxText/JAX, more... 2) Full integration at launch with HF including Transformers + optimization therein 3) TensorRT-LLM and full NVIDIA opt across the stack in partnership with that team (mentioned on the NVIDIA earnings call by Jensen, even) 4) More developer surfaces than you can shake a stick at: Kaggle, Colab, Gemma.cpp, GGUF 5) Comms landing with full coordination from Sundar + Demis + Jeff Dean, not to mention positive articles in NYT, Verge, Fortune, etc. 6) Full Google Cloud launches across several major products, including Vertex and GKE 7) Launched globally and with a permissive set of terms that enable developers to do awesome stuff Pulling that off without any major SNAFUs is a huge relief for the team. We're excited by the potential of using all of those surfaces and the launch momentum to build a lot more great things for you all =)
- kergonath 3y ago
  I am not a fan of a lot of what Google does, but congratulations! That’s a massive undertaking and it is bringing the field forward. I am glad you could do this, and hope you’ll have many other successful releases. Now, I’m off playing with a new toy :)
- verticalscaler 3y ago
  [flagged]
  - trisfromgoogle 3y ago
    Always -- anything that comes with the Google name attached always attracts some negativity. There's plenty of valid criticism, most of which we hope to address in the coming weeks and months =).
    - verticalscaler 3y ago
      [flagged]
      - trisfromgoogle 3y ago
        I mean, many articles will have a negative cast because of the need for clicks -- e.g., the Verge's launch article is entitled "Google Gemma: because Google doesn’t want to give away Gemini yet" -- which I think is both an unfair characterization (given the free tier of Gemini Pro) and unnecessarily inflammatory. Legitimate criticisms include not working correctly out of the box for llama.cpp due to repetition penalty and vocab size, some snafus on chat templates with huggingface, the fact that they're not larger-sized models, etc. Lots of the issues are already fixed, and we're committed to making sure these models are great. Honestly, not sure what you're trying to get at here -- are you trying to "gotcha" the fact that not everything is perfect? That's true for any launch.
        verticalscaler 3y ago
        [flagged]
        trisfromgoogle 3y ago
        Neither of those applies at all to Gemma, though? I'm still confused -- what are you trying to accomplish with this line of questioning?
        verticalscaler 3y ago
        [flagged]
deleted 3y ago
[deleted]

I'm not Austin, but I am Tris, the friendly neighborhood product person on Gemma. Overall, I think that the main feeling is: incredibly relieved to have had the launch go as smoothly as it has! The complexity of the launch is truly astounding: 1) Reference implementations in JAX, PyTorch, TF with Keras 3, MaxText/JAX, more... 2) Full integration at launch with HF including Transformers + optimization therein 3) TensorRT-LLM and full NVIDIA opt across the stack in partnership with that team (mentioned on the NVIDIA earnings call by Jensen, even) 4) More developer surfaces than you can shake a stick at: Kaggle, Colab, Gemma.cpp, GGUF 5) Comms landing with full coordination from Sundar + Demis + Jeff Dean, not to mention positive articles in NYT, Verge, Fortune, etc. 6) Full Google Cloud launches across several major products, including Vertex and GKE 7) Launched globally and with a permissive set of terms that enable developers to do awesome stuff Pulling that off without any major SNAFUs is a huge relief for the team. We're excited by the potential of using all of those surfaces and the launch momentum to build a lot more great things for you all =)

kergonath 3y ago
I am not a fan of a lot of what Google does, but congratulations! That’s a massive undertaking and it is bringing the field forward. I am glad you could do this, and hope you’ll have many other successful releases. Now, I’m off playing with a new toy :)
verticalscaler 3y ago
[flagged]
- trisfromgoogle 3y ago
  Always -- anything that comes with the Google name attached always attracts some negativity. There's plenty of valid criticism, most of which we hope to address in the coming weeks and months =).
  - verticalscaler 3y ago
    [flagged]
    - trisfromgoogle 3y ago
      I mean, many articles will have a negative cast because of the need for clicks -- e.g., the Verge's launch article is entitled "Google Gemma: because Google doesn’t want to give away Gemini yet" -- which I think is both an unfair characterization (given the free tier of Gemini Pro) and unnecessarily inflammatory. Legitimate criticisms include not working correctly out of the box for llama.cpp due to repetition penalty and vocab size, some snafus on chat templates with huggingface, the fact that they're not larger-sized models, etc. Lots of the issues are already fixed, and we're committed to making sure these models are great. Honestly, not sure what you're trying to get at here -- are you trying to "gotcha" the fact that not everything is perfect? That's true for any launch.
      - verticalscaler 3y ago
        [flagged]
        trisfromgoogle 3y ago
        Neither of those applies at all to Gemma, though? I'm still confused -- what are you trying to accomplish with this line of questioning?
        verticalscaler 3y ago
        [flagged]

deleted 3y ago

[deleted]