4 ms·

> Has Google/Alphabet publicly released any of their AI models yet? You mean NLP field changing models from Google like BERT [1]? or Transformers paper [2]? or

> Has Google/Alphabet publicly released any of their AI models yet? You mean NLP field changing models from Google like BERT [1]? or Transformers paper [2]? or T5 model [3] (used by company doing ChatGPT like search currently on the front page on HN)? 1. https://arxiv.org/abs/1810.04805 https://arxiv.org/abs/1810.04805 code+models: https://github.com/google-research/bert https://github.com/google-research/bert 2. https://arxiv.org/abs/2112.04426 https://arxiv.org/abs/2112.04426 3. https://arxiv.org/abs/1910.10683 https://arxiv.org/abs/1910.10683 code+models: https://github.com/google-research/text-to-text-transfer-transformer https://github.com/google-research/text-to-text-transfer-tra...

dougmwne 4y ago
Right, so that’s a no. Google releases research papers but can’t productize anything. They are like a modern day Xerox Parc.
- TaylorAlexander 4y ago
  I must be missing something. Did you see the GitHub links in the post you’re replying to?
  - SeanAnderson 4y ago
    Some of the commenters in this thread are remarking on the lack of functional examples that they can interact with and others are saying they feel the existence of published technical papers is sufficient. They're talking through each other a bit.
- lossolo 4y ago
  > Google releases research papers but can’t productize anything If you mean actual products and not just open sourcing models and code then: https://cloud.google.com/products/ai https://cloud.google.com/products/ai They also implement a lot (the most interesting stuff) of what they publish inside google to power their own products.
typon 4y ago
I read a lot on Twitter about the so-called "culture" of Google that prevents them from making AI based products, meanwhile OpenAI has made ChatGPT and is going to replace Google search within the next two months or so. I think this is the same narrative that's being expressed by the GP comment. To add to your comment, Google has been using BERT to power Search since 2019: https://blog.google/products/search/search-language-understanding-bert/ https://blog.google/products/search/search-language-understa... I'm going to guess that the only reason they don't use larger models is because of the compute cost. ChatGPT at 4 billion users with today's hardware is an unsustainable business. However, that thought leads me to imagining: if Google offered Search "Premium" using the latest LLMs, how much would people pay for it?
- lossolo 4y ago
  > if Google offered Search "Premium" using the latest LLMs, how much would people pay for it? I think they need to solve hallucination problem first, they are already working on optimization eg FLAN-T5 (smaller LLM models same performance) and RETRO (retrieval transformer that can use data index outside of the model) that takes them closer to use it in search.
  - astrange 4y ago
    Apparently you can avoid hallucination by basically reading the model’s mind instead of asking it questions. https://arxiv.org/abs/2212.03827 https://arxiv.org/abs/2212.03827 Raises some ethical issues…

dougmwne 4y ago

Right, so that’s a no. Google releases research papers but can’t productize anything. They are like a modern day Xerox Parc.

TaylorAlexander 4y ago
I must be missing something. Did you see the GitHub links in the post you’re replying to?
- SeanAnderson 4y ago
  Some of the commenters in this thread are remarking on the lack of functional examples that they can interact with and others are saying they feel the existence of published technical papers is sufficient. They're talking through each other a bit.
lossolo 4y ago
> Google releases research papers but can’t productize anything If you mean actual products and not just open sourcing models and code then: https://cloud.google.com/products/ai https://cloud.google.com/products/ai They also implement a lot (the most interesting stuff) of what they publish inside google to power their own products.

typon 4y ago

I read a lot on Twitter about the so-called "culture" of Google that prevents them from making AI based products, meanwhile OpenAI has made ChatGPT and is going to replace Google search within the next two months or so. I think this is the same narrative that's being expressed by the GP comment. To add to your comment, Google has been using BERT to power Search since 2019: https://blog.google/products/search/search-language-understanding-bert/ https://blog.google/products/search/search-language-understa... I'm going to guess that the only reason they don't use larger models is because of the compute cost. ChatGPT at 4 billion users with today's hardware is an unsustainable business. However, that thought leads me to imagining: if Google offered Search "Premium" using the latest LLMs, how much would people pay for it?

lossolo 4y ago
> if Google offered Search "Premium" using the latest LLMs, how much would people pay for it? I think they need to solve hallucination problem first, they are already working on optimization eg FLAN-T5 (smaller LLM models same performance) and RETRO (retrieval transformer that can use data index outside of the model) that takes them closer to use it in search.
- astrange 4y ago
  Apparently you can avoid hallucination by basically reading the model’s mind instead of asking it questions. https://arxiv.org/abs/2212.03827 https://arxiv.org/abs/2212.03827 Raises some ethical issues…