2 ms·
>Without this need to survive, there can be no motivation, and without motivation there can be no intent. I'm not sure that's as clear cut as you make it sound
by coldtea 4y ago
>Without this need to survive, there can be no motivation, and without motivation there can be no intent.
I'm not sure that's as clear cut as you make it sound.
For example curiocity could be a fine engine for motivation as well, even if you don't care if you'll survive or not.
- s1mplicissimus 4y agotry being curious while starving and let us know how that goes :)
- coldtea 4y agoWhether you can be "curious while starving" might or might not be possible, but it is irrelevant to the point. For starters, because the claim argued is that you can have motivation (say, through curiocity) even without a survival instinct. And it's perfectly possible to have no survival instinct and yet not to be starting anyway. It's enough that you have access to food or are fed, to avoid starvation. So lack of survival instict is not the same as starvation. If we substitite "starvation" for "access to electricity" (as AGIs don't eat food), as long as an AGI is provided by electricity by us, even if it has no survival instict, can still have curiosity, and thus motivation.
- jensensbutton 4y agoI don't see why you think it would be easier to encode "curiosity" than "survival".
- Robotbeat 4y agoAll these things possible to encode. Novelty seeking of “curiosity”, or survival drive. LLMs are trained on next word prediction but there’s no fundamental reason we can’t go in other directions.