6 ms·
The concern isn't so much the existing model, as impressive and promising as it is, but equitable access to future models. When this thing gets 10x better, whi
by CamperBob2 4y ago
The concern isn't so much the existing model, as impressive and promising as it is, but equitable access to future models.
When this thing gets 10x better, which it will, it will be capable of passing a Turing test against any human interlocutor. It will also pwn the field at any programming competition at that point, given further progress in areas described in the link at https://news.ycombinator.com/item?id=33914122 https://news.ycombinator.com/item?id=33914122 .
Massive economic advantages will accrue to the company or companies who control these models -- as in "Awesome, now we can fire a bunch of expensive programmers and engineers." A few weeks ago I'd have said that was the dumbest idea ever. Now it's obviously inevitable.
The C-suite shouldn't get too cocky, though, because it's possible that the lowly "language model" will be better at running the company than they are. New funding and business models can be expected to emerge on this basis.
Things are about to change in ways that seemed absurd to expect just a few years ago, and in areas where even the most well-informed people weren't expecting it. Full access to these models will be a very big deal, almost as big a deal as ownership of money and property is now. It will be very hard to compete with entities who have that access.
- asar 4y agoCan it get 10x better with the current approach though? As it is trained with content written by humans isn't that a natural ceiling ?
- CamperBob2 4y agoUnless you're religious or a UFO cultist, what non-human-authored content is available for anyone, including humans, to learn from? Individual human knowledge workers aren't limited by the breadth and depth of available knowledge, the way they were up to about 100 years ago, but by their ability to assimilate and leverage it. That's also what limits the machine models. But the models will keep getting better, while we won't.
- pulvinar 4y agoIt's possible we're at the limit, but there's also no inherent reason it couldn't be better than humans. Its limits seem to be tied to conceptual capacity, not training material. We've seen it generate output that was its input combined in novel ways, and not found anywhere else. AlphaGo is a clear-cut case of this.
- CamperBob2 4y agoOf course, the history of AI is one of punctuated equilibrium, so it might be 30-50 years before the next 10x advance shows up, with nothing very interesting happening in the meantime. But my thinking is that 30-50 years isn't that long, compared to the magnitude of the changes in the nature of knowledge work that may become possible.