5 ms·
I work for Google Brain. I remember meeting Brian at a conference and I have nothing but good things to say about him. That said, I think Brian is underestimati
by simonster 3y ago
I work for Google Brain. I remember meeting Brian at a conference and I have nothing but good things to say about him. That said, I think Brian is underestimating the extent to which the Brain/DeepMind merger is happening because it's what researchers want. Many of us have a strong sense that the future of ML involves models built by large teams in industry environments. My impression is that the goal of the merger is to create a better, more coordinated environment for that kind of research.
- gowld 3y agoThe goal of the merger is for execs to look like they are doing something to drive progress. Actual progress comes from the researchers and developers.
- anonylizard 3y agoWell, where exactly is this progress? Where is Google's answer to GPT-4? Why weren't the 'researchers and developers' making a GPT-4 equivalent? Turns out you sometimes you need a top down, centralised vision to execute on projects. When the goal is undefined, you can allow researchers to run free and explore, now its full on wartime, with clear goals (make GPT-5,6,7....).
- oofbey 3y agoGoogle is fundamentally allergic to top-down management. Most googlers will reject any attempt to be told what to do as wrong, because lots of IC's voting with their feet are smarter than any (google) exec at figuring out what to do. Last time Google got spooked by a competitor was Facebook, and they built Google Plus in response. We all know that was an utter failure. Googlers could escape that one with their egos in tact because winning in "social" is just some UX junk, not hard-core engineering like ML. It's gonna be super hard for them to come to grips with the fact that they are way behind on something that they should be good at. Plan for lots of cognitive dissonance ahead.
- cubefox 3y agoI don't think they are behind just because they have released less stuff. They had LaMDA way before ChatGPT, and they had multimodal models (both by DeepMind and by Google Brain) well before OpenAI.
- oofbey 3y agoThey are behind because what they have released sucks. Have you tried Bard? It's dumb. Like you're talking to some 20th century gimmick dumb. GPT4 is far from perfect, but when it makes mistakes and you point them out, it understands and tries to adapt. Bard just repeats itself saying the same stupid things like a casette-tape answering machine. If you ask a googler about this, they typically assume GPT is just as stupid as bard. Or say something like "so GPT is just trained on more data - we can do that." As if nothing's wrong.
- cubefox 3y agoBard uses a smaller model currently, which was announced before release. > We’re releasing it initially with our lightweight model version of LaMDA. This much smaller model requires significantly less computing power, enabling us to scale to more users, allowing for more feedback. [1] > Bard is powered by a research large language model (LLM), specifically a lightweight and optimized version of LaMDA, and will be updated with newer, more capable models over time. [2] [1] https://blog.google/technology/ai/bard-google-ai-search-updates/ https://blog.google/technology/ai/bard-google-ai-search-upda... [2] https://blog.google/technology/ai/try-bard/ https://blog.google/technology/ai/try-bard/
- m00x 3y agoGPT-4 and chatGPT are developed from mostly Google papers and Facebook code/frameworks. OpenAI just focused on making it a great product.
- gradstudent 3y agoA car is basically 4 wheels and a combustion engine. Henry Ford just focused on making it a great product. (In case it's not clear, I think you might be underestimating the size of the subsequent contributions)
- cratermoon 3y agoI'm having trouble keeping Brain/Brian straight.
- Nevermark 3y agoThe first is an object that extends into a natural number of spacial dimensions. It arises in string theory. The second is our Lord and Savior.
- cratermoon 3y agoFollow the gourd!
- drawkbox 3y agoMonty Python's Life of Brain
- gopalv 3y ago> Many of us have a strong sense that the future of ML involves models built by large teams in industry environments The gradient of current moment is that whatever approach is optimized to use more data and more compute is much easier to invest in than something which can do more with less, but with a significant number of possible dead-ends. At some point, this will have diminishing returns, but until that is hit, this makes sense as a purely return-on-investment for both research progress and business returns.
- deleted 3y ago[deleted]
- ugh123 3y agoWould you say the majority (super majority?) of Google Brain and DeepMind employees are happy about the merge?
- deleted 3y ago[deleted]