4 ms·
> Now it turns out they were just bullshitting at Google. I don't think Google was bullshitting when they wrote, documented and released Tensorflow, BERT and f
by smoldesu 3y ago
> Now it turns out they were just bullshitting at Google.
I don't think Google was bullshitting when they wrote, documented and released Tensorflow, BERT and flan-t5 to the public. Their failure to beat OpenAI in a money-pissing competition really doesn't feel like it reflects on their capability (or intentions) as a company. It certainly doesn't feel like they were "bullshitting" anyone.
- renewiltord 3y agoEveryone told us they had secret tech that they were keeping inside. But then Bard came out and it was like GPT-3. I don’t know man. The proof of the pudding is in the eating. > The innovation is largely happening within the megacorps anyway That was the part I was replying to. Whichever megacorp this is, it’s not Google.
- smoldesu 3y agoHey, feel free to draw your own conclusions. AI quality is technically a subjective topic. For what it's worth though, Google's open models have benched quite competitively with GPT-3 for multiple years now: https://blog.research.google/2021/10/introducing-flan-more-generalizable.html https://blog.research.google/2021/10/introducing-flan-more-g... The flan quantizations are also still pretty close to SOTA for text transformers. Their quality-to-size ratio is much better than a 7b Llama finetune, and it appears to be what Apple based their new autocorrect off of.