> A lot of people seem to have the idea (or at least SELL the idea, I'm not sure if they actually believe it) that this all leads to superhuman intelligence AGI

> A lot of people seem to have the idea (or at least SELL the idea, I'm not sure if they actually believe it) that this all leads to superhuman intelligence AGI and whoever hits that first is the "winner takes all" winner. ... Wait, why would making the basilisk give you a monopoly? Do they think their magic super intelligence would do their bidding or something? Have they never seen any sci-fi? (The idea that LLMs will lead to superhuman intelligence seems ludicrous on the face of it, but even going along with that it doesn't make any sense.)