3 ms·

But, I'm sure the people who wrote the book mentioned in the article can rest easy: creativity, knowledge, and originality are still valuable, and LLMs are not

• visarga 3y ago
  I think the source of creativity and knowledge is the world. Without access to the world we can't do science. LLMs are like brains in a jar, but when they get tools they can integrate external signals and actually become creative and even discover knowledge - like [1] and AlphaGo's move 37 (it has access to the go table, which is the "world" of Go) But this "access to the world" needs massive scale, we are billions of humans all experiencing the world, AI needs probably a similar number of agents doing massive trials and search. AlphaGo sure did need lots of self-play games, not just a couple. AlphaTensor learned to improve matrix multiplication by the same method. Biological evolution produced us the same way. It's an open-ended exploration problem. A closed system can't do it, and the scale needed makes it expensive. [1] - Evolution through Large Models - https://arxiv.org/abs/2206.08896 https://arxiv.org/abs/2206.08896