2 ms·
It’s fundamental, IMO. LLMs have to have something ‘true’ (or at least statistically probable) to validate against for training. Taking the output from it and
by lazide 2y ago
It’s fundamental, IMO.
LLMs have to have something ‘true’ (or at least statistically probable) to validate against for training.
Taking the output from it and feeding it back into itself is, essentially, an Ouroboros. Or like locking a human in solitary.
The more/longer it happens, the more deranged it’s going to get.