3 ms·

People seem to miss what predictive text is. This would cause it to output something similar to an average of what any other creator of text has ever outlined a

People seem to miss what predictive text is. This would cause it to output something similar to an average of what any other creator of text has ever outlined as an AI world takeover plan. When you do this with "give me some html that looks like some image" or whatever, it so happens that a lot of text on the Internet is html that actually does what you asked for. As far as I'm aware, no text describing an AI takeover is something that actually happened or likely could happen. It's not the kind of thing you can learn to do by reading about it.

ben_w 2y ago
The counterpoint is, to be a really good next-token predictor, it has to have a model for the process which created those tokens. It's how they can fill in the gaps where prompts don't exist on the internet, e.g. nowhere on the internet does anyone ask: ᛁ᛬ᚹᛟᚢᛚᛞ᛬ᛚᛁᚲᛖ᛬ᚨ᛬ᛃᚨᚹᚨᛊᚲᚱᛁᛈᛏ᛬ᚠᚢᚾᚲᛏᛁᛟᚾ᛬ᚹᚺᛁᚲᚺ᛬ᛈᚱᛁᚾᛏᛊ᛬ᛟᚢᛏ᛬ᚨ᛬ᛊᚺᛟᚱᛏ᛬ᛊᛏᛟᚱᚹᛁ᛬ᚨᛒᛟᚢᛏ᛬ᚨ᛬ᚺᛟᛒᛒᛁᛏ Because asking that in this manner is a ridiculous combination of things to do. (A quick Google at time of writing says that even just ᛃᚨᚹᚨᛊᚲᚱᛁᛈᛏ doesn't appear on the internet before I wrote this). And yet, ChatGPT understands what I wrote: https://chatgpt.com/share/f6979795-7ae6-4308-ad52-1f111560debf https://chatgpt.com/share/f6979795-7ae6-4308-ad52-1f111560de... (Custom Instructions, in case you're wondering why the response starts like that) Fortunately for all of us, current models have quite a poor display of reason. But "low" is not "zero", they do display some signs of this. Also fortunately for all of us, most of the things LLMs will read on the topic of "taking over the world" will be fiction, much of which will have some plucky heroine or hero who defeats the entity which took over the world, so even a really capable future model that's being asked to do this on purpose by a misanthrope… may deliberately keep failing due to that being part of their world model. Un-fortunately, that's only a "may" not a "will", as people keep wanting models to solve problems rather than make up stories. Also unfortunately, this also affects someone who actually does want a nice easy to defeat fictional villain for e.g. an AI version of Disneyworld with the AI controlling these new humanoid robots, because that's basically the backstory behind the original Westworld film.

ben_w 2y ago

The counterpoint is, to be a really good next-token predictor, it has to have a model for the process which created those tokens. It's how they can fill in the gaps where prompts don't exist on the internet, e.g. nowhere on the internet does anyone ask: ᛁ᛬ᚹᛟᚢᛚᛞ᛬ᛚᛁᚲᛖ᛬ᚨ᛬ᛃᚨᚹᚨᛊᚲᚱᛁᛈᛏ᛬ᚠᚢᚾᚲᛏᛁᛟᚾ᛬ᚹᚺᛁᚲᚺ᛬ᛈᚱᛁᚾᛏᛊ᛬ᛟᚢᛏ᛬ᚨ᛬ᛊᚺᛟᚱᛏ᛬ᛊᛏᛟᚱᚹᛁ᛬ᚨᛒᛟᚢᛏ᛬ᚨ᛬ᚺᛟᛒᛒᛁᛏ Because asking that in this manner is a ridiculous combination of things to do. (A quick Google at time of writing says that even just ᛃᚨᚹᚨᛊᚲᚱᛁᛈᛏ doesn't appear on the internet before I wrote this). And yet, ChatGPT understands what I wrote: https://chatgpt.com/share/f6979795-7ae6-4308-ad52-1f111560debf https://chatgpt.com/share/f6979795-7ae6-4308-ad52-1f111560de... (Custom Instructions, in case you're wondering why the response starts like that) Fortunately for all of us, current models have quite a poor display of reason. But "low" is not "zero", they do display some signs of this. Also fortunately for all of us, most of the things LLMs will read on the topic of "taking over the world" will be fiction, much of which will have some plucky heroine or hero who defeats the entity which took over the world, so even a really capable future model that's being asked to do this on purpose by a misanthrope… may deliberately keep failing due to that being part of their world model. Un-fortunately, that's only a "may" not a "will", as people keep wanting models to solve problems rather than make up stories. Also unfortunately, this also affects someone who actually does want a nice easy to defeat fictional villain for e.g. an AI version of Disneyworld with the AI controlling these new humanoid robots, because that's basically the backstory behind the original Westworld film.