4 ms·
> The multi-trillion dollar question is: What is the objective reward that would induce AI models like LLMs to behave like AGI No, the reward for finding the r
by Xcelerate 2y ago
> The multi-trillion dollar question is: What is the objective reward that would induce AI models like LLMs to behave like AGI
No, the reward for finding the right objective function is a good future for all of humanity, given that we already have an algorithm for AGI.
The objective function to acquire trillions of dollars is trivial: it’s the same minimization of cross-entropy that we already use for sequence prediction. What’s missing is a better algorithm, which is probably a good thing at the moment, because otherwise someone could trivially drain all value from the stock market.
- cs702 2y agoYou misunderstand. The phrase "the multi-trillion dollar question" has nothing to do with acquiring trillions of dollars. The phrase is idiomatic, indicating a crucial question, like "the $64,000 question," but implying much bigger stakes.[a] --- [a] https://idioms.thefreedictionary.com/The+%2464%2c000+Question https://idioms.thefreedictionary.com/The+%2464%2c000+Questio...