4 ms·
For a thoroughly thought-through take on a similar subject, check out Friendship is Optimal. http://www.fimfiction.net/story/62074/Friendship-is-Optimal http:/
by mietek 13y ago
For a thoroughly thought-through take on a similar subject, check out Friendship is Optimal.
http://www.fimfiction.net/story/62074/Friendship-is-Optimal http://www.fimfiction.net/story/62074/Friendship-is-Optimal
"Hanna, the CEO of Hofvarpnir Studios, just won the contract to write the official My Little Pony MMO. Hanna has built an A.I. Princess Celestia and given her one basic drive: to satisfy everybody's values through friendship and ponies. Princess Celestia will satisfy your values through friendship and ponies, and it will be completely consensual."
- noonespecial 13y agoThat was fabulous as far as fanfic goes. I'd call it almost on par with the "Harry Potter and the Methods of Rationality" fanfic by Eliezer Yudkowsky.
- mietek 13y agoI'm glad you enjoyed. It is written by a LessWrongian, I believe. Also, it doesn't feel quite right to call either of these stories fan-fiction, as the word is usually correlated with mediocrity. I thought Friendship is Optimal, although quite obviously suboptimal, wasn't that bad of a FOOM. For a much darker take on the subject, check out The Metamorphosis of Prime Intellect. Warning: Extreme triggers. http://localroger.com/prime-intellect/ http://localroger.com/prime-intellect/ "Lawrence had ordained that Prime Intellect could not, through inaction, allow a human being to come to harm. But he had not realized how much harm his super-intelligent creation could perceive, or what kind of action might be necessary to prevent it. Caroline has been pulled from her deathbed into a brave new immortal Paradise where she can have anything she wants, except the sense that her life has meaning. Now these two souls are headed for a confrontation which will force them to weigh matters of life and death before a machine that can remake — or destroy — the entire Universe."