Just in case you haven't already read the lesswrong essay on optimization by proxy: http://lesswrong.com/lw/28r/is_google_paperclipping_the_web_the_perils_of/

Just in case you haven't already read the lesswrong essay on optimization by proxy: http://lesswrong.com/lw/28r/is_google_paperclipping_the_web_the_perils_of/ http://lesswrong.com/lw/28r/is_google_paperclipping_the_web_...