4 ms·
> most of the technology in ChatGPT came from Google research efforts Google is also a bit notorious in the ML space for taking concepts from other companies a
by jjcon 4y ago
> most of the technology in ChatGPT came from Google research efforts
Google is also a bit notorious in the ML space for taking concepts from other companies and academy, making a couple changes and slipping a google logo on it and then dubiously claiming superior performance (see the inception convnets, photo coloration and object removal etc, even the transformer itself to some degree)
They deserve credit for the transformer but I’m not sure that means they will have a leg up here overall. I agree though it is likely to be the bureaucracy that will take them down if they in fact do not succeed.
- Mockapapella 4y agoWell, "Transformers" as a concept were first published by Google in 2017. Other than that I don't know enough about ChatGPT's architecture (maybe others can fill in the gaps) to make a call one way or the other.
- cma 4y agoFast weight programmers: https://arxiv.org/abs/2102.11174 https://arxiv.org/abs/2102.11174