3 ms·

Thanks for writing. We as a species need to talk more about this. What's the goal in requiring the first SMI to detect other SMI being developed but take no ac

Thanks for writing. We as a species need to talk more about this. What's the goal in requiring the first SMI to detect other SMI being developed but take no action beyond detection? Or did you mean to say that it should detect other SMI under development and then report those projects to whatever regulatory authority is overseeing SMI? Also, perhaps a better framework for a "friendly" SMI than Asimov’s zeroeth law is the "Coherent Extrapolated Volition" model (http://en.wikipedia.org/wiki/Friendly_artificial_intelligence#Coherent_Extrapolated_Volition http://en.wikipedia.org/wiki/Friendly_artificial_intelligenc...). Nick Bostrom and many others believe this may be the most workable safeguard.

frabcus 12y ago
Upvoted as this was a reasonable comment with good questions. I think Altman was more prompting a conversation than anything - certainly using AI to at least detect AI development is a cute idea. It's much like we use seismographs in ocean trenches and many other techniques to detect nuclear tests. Unfortunately, we know so little about how the AI will work or what it will do, that it is only a theoretical strategy right now.