5 ms·
Google has all the pieces of the puzzle to infuse better LLM tech into their products, infact most of the technology in ChatGPT came from Google research effort
by cloudking 4y ago
Google has all the pieces of the puzzle to infuse better LLM tech into their products, infact most of the technology in ChatGPT came from Google research efforts. If they want to compete they need to remove the red tape bureaucracy they have around launching products. There may be too much randomness in this tech to get past the launch line, but it depends how they integrate it. An actually useful Google Assistant infused into products, that helps you find information, complete tasks and create content seems like a no-brainer.
- jjcon 4y ago> most of the technology in ChatGPT came from Google research efforts Google is also a bit notorious in the ML space for taking concepts from other companies and academy, making a couple changes and slipping a google logo on it and then dubiously claiming superior performance (see the inception convnets, photo coloration and object removal etc, even the transformer itself to some degree) They deserve credit for the transformer but I’m not sure that means they will have a leg up here overall. I agree though it is likely to be the bureaucracy that will take them down if they in fact do not succeed.
- Mockapapella 4y agoWell, "Transformers" as a concept were first published by Google in 2017. Other than that I don't know enough about ChatGPT's architecture (maybe others can fill in the gaps) to make a call one way or the other.
- cma 4y agoFast weight programmers: https://arxiv.org/abs/2102.11174 https://arxiv.org/abs/2102.11174