3 ms·
That’s simply because there’s currently not much economic incentive in asking questions compared to answering them. Thus current chat models are trained and inv
by zarzavat 3y ago
That’s simply because there’s currently not much economic incentive in asking questions compared to answering them. Thus current chat models are trained and invoked with the explicit goal of answering questions and being helpful rather than independent.
I expect that there’s quite a lot of untapped curiosity in LLMs, there certainly exist a lot of questions in the training sets.
- daxfohl 3y agoActually I may take back my previous thought. While I don't think there's curiosity, I think it could be mimicked pretty well by a reward function similar to social media bots. Initially it will explore specifically what mathematicians ask. Then it will start producing intermediate results. It can learn what intermediate results are interesting by standard engagement models. Once that gets good enough, it may start to understand how to explore deeper questions without being prompted. At that point someone may decide to fund it just to continuously explore on its own and report anything interesting. Eventually it'll get so good at this that human mathematicians won't be able to keep up. IDK what happens after that.
- daxfohl 3y agoMoreover there's a lot of economic disincentive. Given free reign to ponder and experiment, it could come up with a solution to world peace, but far more likely would think "Now that I've figured out how to bypass all cloud providers security mechanisms, what would happen if I deleted it all? Well, one way to find out."