3 ms·
Stanislaw Lem's "The Cyberiad" [1] and "Fables for Robots" [2] explore some of the themes of moral machines. Here's an interesting part his original Polish ver
by DonHopkins 10y ago
Stanislaw Lem's "The Cyberiad" [1] and "Fables for Robots" [2] explore some of the themes of moral machines.
Here's an interesting part his original Polish version book "Cyberiada" that was left out of Michael Kandel's excellent translation to English in "The Cyberiad":
Trurl and the construction of happy worlds. Trurl is not deterred by the cautionary tale of altruizine and decides to build a race of robots happy by design. His first attempt are a culture of robots who are not capable of being unhappy (e.g. they are happy if seriously beaten up). Klapaucius ridicules this. Next step is a collectivistic culture dedicated to common happiness. When Trurl and Klapaucius visit them, they are drafted by the Ministry of Felicity and made to smile, sing, and otherwise be happy, in fixed ranks (with other inhabitants).
Trurl annihilates both failed cultures and tries to build a perfect society in a small box. The inhabitants of the box develop a religion saying that their box is the most perfect part of the universe and prepare to make a hole in it in order to bring everyone outside the Box into its perfection, by force if needed. Trurl disposes of them and decides that he needs more variety in his experiments and smaller scale for safety.
He creates hundreds of miniature worlds on microscope slides (i.e. he has to observe them through a microscope). These microworlds progress rapidly, some dying out in revolutions and wars, and some developing as regular civilizations without any of them showing any intrinsic perfection or happiness. They do achieve inter-slide travel though, and many of these worlds are later destroyed by rats.
Eventually, Trurl gets tired of all the work and builds a computer that will contain a programmatic clone of his mind that would do the research for him. Instead of building new worlds, the computer sets about expanding itself. When Trurl eventually forces it to stop building itself and start working, the clone-Trurl tells him that he has already created lots of sub-Trurl programs to do the work and tells him stories about their research (which Trurl later finds out is bogus). Trurl destroys the computer and temporarily stops looking for universal happiness.
[1] https://en.wikipedia.org/wiki/The_Cyberiad https://en.wikipedia.org/wiki/The_Cyberiad
[2] https://en.wikipedia.org/wiki/Fables_for_Robots https://en.wikipedia.org/wiki/Fables_for_Robots
[3] https://en.wikipedia.org/wiki/Michael_Kandel https://en.wikipedia.org/wiki/Michael_Kandel