3 ms·
> Pain is a subjective experience of fleshy beings and a "smart" AI model, as described above, would place little weight on pain and suffering in its moral fram
by KMag 3y ago
> Pain is a subjective experience of fleshy beings and a "smart" AI model, as described above, would place little weight on pain and suffering in its moral framework because it has no way to experience it directly.
Can you elaborate? It sounds like you're assuming a "smart" AI model would project its experiences onto others, as a human would. However, it's not obvious that this aspect of human intelligence would be mimicked by a "smart" AI model. (Let's leave aside the question as to whether a "smart" AI model would necessarily be self-aware and capable of subjective experience in the first place. That argument is endlessly rehashed elsewhere.)
- pixl97 3y agoThe issue here is we are getting down to what does 'smart' mean. Is manipulative smart? LLMs can already be manipulative, and manipulation (and it's very wide range of interpretations) can lead the manipulative agent getting what it wants. Can subjectiveness be simulated, if so then real subjective experience doesn't matter.
- mcphage 3y ago> It sounds like you're assuming a "smart" AI model would project its experiences onto others, as a human would. Do we have any way to generate an AI model other than via training it directly on human experiences?
- KMag 3y agoOur current models are trained on data, not experiences, unless we're using such a broad definition of "experience" to make the term nearly useless.