3 ms·
If large language models trained on cross entropy loss for the next token prediction in the limit aren’t dangerous, then they aren’t enough by themselves for AG
by drdeca 4y ago
If large language models trained on cross entropy loss for the next token prediction in the limit aren’t dangerous, then they aren’t enough by themselves for AGI.
An AGI, by virtue of being at least as general as a human, would be able to effectively form a plan for how to act in the world to achieve fairly general goals, in fairly general conditions.
Even if it isn’t agentic, if a program can formulate these plans in a way people can use, then the combined program+user still implements the optimization process.
- sinenomine 4y agoThat's why we have to make sure the user (committee) is safe and aligned. The usual silicon valley tech execs, or east coast financial bros aren't going to cut it this time. The democratic solution here looks better than the expected rule of the (very) few.
- drdeca 4y agoThat isn’t enough if the plans which are enacted have unintended undesirable consequences.