3 ms·
> AI psychosis I think most of us have an acute sort of it > next token predictor model (nondeterministic) next token predictor = capable of outputing any te
by sometimelurker 5mo ago
> AI psychosis
I think most of us have an acute sort of it
> next token predictor model
(nondeterministic) next token predictor = capable of outputing any text
if MLPs optimize over the space of functions, and sequence to sequence models (RNNs, transformers ect) optimize over the space of programs/algorithms, what exactly is left to figure out to make a machine that can do anything? their bet is nothing, that all we need is a very complex algorithm that can found with SDG/AI training. I think its obvious such an algorithm exists, and I think SDG can probably find it.
here's an interesting take i heard (from vladimir_Nesov): LLM technological progress is logarithmic, but the resources being put into them are exponential.
all this can be made smarter (-than human) just by making it larger