6 ms·
The counterpoint is, to be a really good next-token predictor, it has to have a model for the process which created those tokens. It's how they can fill in the
by ben_w 2y ago
The counterpoint is, to be a really good next-token predictor, it has to have a model for the process which created those tokens. It's how they can fill in the gaps where prompts don't exist on the internet, e.g. nowhere on the internet does anyone ask:
ᛁ᛬ᚹᛟᚢᛚᛞ᛬ᛚᛁᚲᛖ᛬ᚨ᛬ᛃᚨᚹᚨᛊᚲᚱᛁᛈᛏ᛬ᚠᚢᚾᚲᛏᛁᛟᚾ᛬ᚹᚺᛁᚲᚺ᛬ᛈᚱᛁᚾᛏᛊ᛬ᛟᚢᛏ᛬ᚨ᛬ᛊᚺᛟᚱᛏ᛬ᛊᛏᛟᚱᚹᛁ᛬ᚨᛒᛟᚢᛏ᛬ᚨ᛬ᚺᛟᛒᛒᛁᛏ
Because asking that in this manner is a ridiculous combination of things to do. (A quick Google at time of writing says that even just ᛃᚨᚹᚨᛊᚲᚱᛁᛈᛏ doesn't appear on the internet before I wrote this).
And yet, ChatGPT understands what I wrote: https://chatgpt.com/share/f6979795-7ae6-4308-ad52-1f111560debf https://chatgpt.com/share/f6979795-7ae6-4308-ad52-1f111560de...
(Custom Instructions, in case you're wondering why the response starts like that)
Fortunately for all of us, current models have quite a poor display of reason. But "low" is not "zero", they do display some signs of this.
Also fortunately for all of us, most of the things LLMs will read on the topic of "taking over the world" will be fiction, much of which will have some plucky heroine or hero who defeats the entity which took over the world, so even a really capable future model that's being asked to do this on purpose by a misanthrope… may deliberately keep failing due to that being part of their world model.
Un-fortunately, that's only a "may" not a "will", as people keep wanting models to solve problems rather than make up stories. Also unfortunately, this also affects someone who actually does want a nice easy to defeat fictional villain for e.g. an AI version of Disneyworld with the AI controlling these new humanoid robots, because that's basically the backstory behind the original Westworld film.