2 ms·
Amazing points. The day of the dorm-room student billionaire is already over. This said, GP's comment has some value. If we take "relatively small company" to m
by Vt71fcAqt7 4y ago
Amazing points. The day of the dorm-room student billionaire is already over. This said, GP's comment has some value. If we take "relatively small company" to mean number of employees (although this wasn't made clear) then there is some truth to the idea that a new, unencumbered company can do more than an established one. But I feel GP is minimizing Microsoft, Google and Nvidia's contributions to ML research, and perhaps overplaying OpenAI's role in pitting it against other players when clearly everyone is building on each other's result. GPT uses a transformer architecture, which was created by Google Brain, and the first GPT paper alone cites 71 other papers, each, in turn, citing their own...