7 ms·
Google has far better models than llama based models. They just simply don't put them facing the public. It is pretty ridiculous that they essentially just set
by chaxor 3y ago
Google has far better models than llama based models. They just simply don't put them facing the public.
It is pretty ridiculous that they essentially just set a marketing team with no programming experience to write Bard, but that shouldn't fool anyone into believing they don't have capable models in Google.
If Deepmind were to actually provide what they have in some usable form, it would likely be quite good. Despite being the first to publish on RLHF (just right before OpenAI) and bring the idea to the academic sphere, they mostly work in areas tangential to 'just chatbots' (e.g. how to improve science with novel GNNs, etc). However, they're mostly academics, so they aren't set on making products, doing the janitorial work of fancy UIs and web marketing, and making things easy to use, like much of the rest of the field.
- whimsicalism 3y agoI work in this field. I would love to see what you are basing these assertions off of. > they mostly work in areas tangential to 'just chatbots' (e.g. how to improve science with novel GNNs, etc) Yes, Alphabet has poured tons of money into exotic ML research whereas Meta just kept pouring more money into more & deeper NLP research.
- renewiltord 3y agoGoogle's LLMs are all vaporware. No one's ever seen them. They're supposedly mind-blowing but when they are released they always sound like lobotomized monkeys. All the AlphaGo/AlphaFold stuff is very cool, but since no one has seen their LLMs this is about as convincing as my claiming I've donated billions to charity.
- jll29 3y agoI can assure you Google BERT isn't vaporware. It was probably a challenge to integrate it into search, but they did that. So your assertion has been refuted based on your use of "all", at the very least.
- renewiltord 3y agoHaha, that's right. Google has BERT. Their AI stuff isn't all vaporware. There's always BERT.
- jahewson 3y agoI’ve been hearing “Google has secret better models” for 7 months now. Maybe some UFOs in the hangers at Moffett Field too?
- PeterStuer 3y agoWould you believe OpenAI has vastly better models that they are not releasing publicly?
- whimsicalism 3y agoNo
- mirekrusin 3y agoGPT models were internally available 6-12 months before they've seen public beta, of course OpenAI has more capable internal models.
- foobiekr 3y agoThere's no reason to believe this. The training time and cost is so substantial that they are almost certainly building their next release, but it isn't sitting there rotting.
- int_19h 3y agoMuch of that training time is RLHF, the absence of which does not make the model less capable of carrying out useful tasks (indeed, in case of GPT-4, it actually made the model slightly less capable).
- PeterStuer 3y agoOpenAI themselves have said they hat GPT-4 internally before they ever released the first version of ChatGPT.
- airgapstopgap 3y ago
- GreedClarifies 3y agoHard disagree. Google has made it plainly clear that they don't have anything useable in this space. Bard scores below all other commercial model. Google is getting the asses handed to them, badly. I figured that the code red would whip them into shape but the rot runs deep.
- rfoo 3y agoBard is a 4.5B or so model.
- onlyrealcuzzo 3y ago> Google has made it plainly clear that they don't have anything useable in this space. Google hasn't made their best models public because they're too expensive to run for free. > Google is getting the asses handed to them, badly. Bard has 30M active users and isn't even available in large parts of the world. They're in 2nd place - when they were pretty late to the game - that's an odd way to say someone is getting their ass handed to them.
- rvnx 3y ago> Google hasn't made their best models public because they're too expensive to run for free. ? It's the same issue with paid models. I am paying per each request sent to Google Generative AI and this is what I get: https://i.ibb.co/4KCmz55/bard1.png https://i.ibb.co/4KCmz55/bard1.png ...
- andsoitis 3y agoWhy do you think Google had even bothered with Bard? And then, given that, why is it worse than the competition?
- chaxor 3y agoIt seems you didn't quite hear the argument. I agree with you that the models Google has released to the public are absolutely worthless. That certainly does not mean they don't have extremely performant models at all however. If you actually have worked in the area of NLP for about 10 years, you would recognize how the work from Deepmind is much more novel and innovative than other groups. OpenAI certainly has great public facing services, and Meta should be congratulated for releasing these models (although I would still prefer the Galactica training data), but academically Deepmind is one of the best groups around.
- Miraste 3y agoThis reminds me of how any day now their self driving cars are going to work right.
- austinkhale 3y agoTheir self driving cars do work? I rode in one for 30 minutes one-way on Sunday. Used it for my return trip too. No driver. Take at least 2 - 3 rides a week and have been for a few months now.
- Miraste 3y agoThey work (most of the time) in Phoenix and SF because they've mapped every single inch of the cities by now and there are no adverse conditions. It's not scalable.
- cudgy 3y agoWhy is that not scalable? Mapping out two large cities for an experimental project in a few years seems scalable, expand to new cities over time with additional resources.
- Miraste 3y agoI suppose it is, but not in a Silicon Valley way. They could scale to "large Southwestern city taxi service," but it wouldn't earn back the investment or deliver on the hype. If that becomes the ceiling I bet Google will simply shut Waymo down. If they work out how to deal with, say, New York weather conditions, there's potential, but they don't seem to be any closer.
- andsoitis 3y agoI think you’re conflating doable and scalable. Or perhaps my threshhold for “scalable” takes different parameters and weigh these inputs differentfly from you.
- wing-_-nuts 3y agoLol google saying they have better models in private is like that one kid that insists he has an awesome girlfriend, but 'she goes to another school, you wouldn't know her'. I'm pretty sure if google had something much better, the board and C-suite execs would have at least ensured we saw previews of it by now...
- eshack94 3y agoSource?
- bouteille 3y agohttps://github.com/facebookresearch/llama/blob/main/LICENSE#L65 https://github.com/facebookresearch/llama/blob/main/LICENSE#...