4 ms·
AI safety discourse is mostly still in 2000s, with outdated intuitions informing loads of rigid concepts specific to this time and community. Large language mo
by sinenomine 4y ago
AI safety discourse is mostly still in 2000s, with outdated intuitions informing loads of rigid concepts specific to this time and community.
Large language models trained on cross-entropy loss for next token prediction aren't going to be dangerous per se, even in the limit - simply due to the nature of the objective and the distribution they are set to approximate.
We should make sure these powerful tools don't fall into a small exclusive set of power-hungry interests, though. Transformative tools such as these should benefit all of humanity and let it prosper.
- drdeca 4y agoIf large language models trained on cross entropy loss for the next token prediction in the limit aren’t dangerous, then they aren’t enough by themselves for AGI. An AGI, by virtue of being at least as general as a human, would be able to effectively form a plan for how to act in the world to achieve fairly general goals, in fairly general conditions. Even if it isn’t agentic, if a program can formulate these plans in a way people can use, then the combined program+user still implements the optimization process.
- sinenomine 4y agoThat's why we have to make sure the user (committee) is safe and aligned. The usual silicon valley tech execs, or east coast financial bros aren't going to cut it this time. The democratic solution here looks better than the expected rule of the (very) few.
- drdeca 4y agoThat isn’t enough if the plans which are enacted have unintended undesirable consequences.