10 ms·
Google literally publish the attention paper. Have people not been paying attention? Google has been the only company I’ve been watching that really understands
by scoofy 11mo ago
Google literally publish the attention paper. Have people not been paying attention? Google has been the only company I’ve been watching that really understands what they are doing.
- causal 11mo agoIMO Google struggles to productize things, so they sit on great ideas a while or do the wrong thing with them, but OpenAI really showed the way and Google can probably take it from here.
- deleted 11mo ago[deleted]
- raw_anon_1111 11mo agoGoogle has great technology, their ability to make and focus on great product development without getting distracted is the issue
- tokioyoyo 11mo agoIf Google wasn’t threatened by OpenAI et al., it wouldn’t be making Gemini today though.
- energy123 11mo agoI never understood this line of reasoning. I found it much more impressive that OpenAI's ML researchers realized this is the thing and bet big on it first, than to come up with it in the first place. It's underappreciated how much talent and insight it takes to see the obvious.
- scoofy 11mo agoThe TPU architecture is the most impressive thing I care about. They developed them and have been using them internally for years. This shows they grok what they're actually doing. There are serious philosophical problems with betting big on an interesting outcome like ChatGPT, even though it seems obvious (Google also did this of course), but creating the best architecture to do that job seems like a first-principles intelligent move, because there was no reason to keep using graphics cards except that they "did the job."
- paxys 11mo agoThe company didn't publish the paper, employees did. And all of them have since moved on to other companies, including OpenAI.