3 ms·
This is No.2 in the list of existential AI risks [1] > A deluge of AI-generated misinformation and persuasive content could make society less-equipped to handl
by nologic01 3y ago
This is No.2 in the list of existential AI risks [1]
> A deluge of AI-generated misinformation and persuasive content could make society less-equipped to handle important challenges of our time.
One way to think about it as significant chunks of information exchange turning into a Market for Lemons. Namely the information asymmetry between the producer of AI junk and the receiver of said junk means that the receiver cannot distinguish between a high-quality message (a "peach") and a zero (or negative) value "lemon". Then receivers are only willing to pay a fixed price for a message that averages the value of a "peach" and "lemon". Given the zero marginal cost of producing junk, this will mean that in the limit receivers will be willing to pay exactly zero. Information exchange is completely discredited.
But is this really an "existential risk" or an opportunity to think deeply about human relations, trust and the meaning of exchange?
Maybe the transactional, "a fool is born every second", buyer beware, caveat emptor society we have built was never fit-for-purpose in the first place?
[1] https://www.safe.ai/ai-risk#Misinformation https://www.safe.ai/ai-risk#Misinformation
[2] https://en.wikipedia.org/wiki/The_Market_for_Lemons https://en.wikipedia.org/wiki/The_Market_for_Lemons