4 ms·
> Another explanation, though, is that there is something intrinsic to the narrative prompting that allows the Transformer architecture to make more accurate pr
by karaterobot 3y ago
> Another explanation, though, is that there is something intrinsic to the narrative prompting that allows the Transformer architecture to make more accurate predictions even outside of the confounding set by OpenAI’s terms of service. This may be related to how the hallucination fabricrations work within the machine learning environment of attention mechanisms.
The possibility I'd like to see eliminated before paying much attention to this is simply that they've given it additional training data newer than 2021 without making that public.
> The backbone of the current forefront of LLMs is an architecture called pre-generative transformers, or GPT.
Hmm!
- refulgentis 3y agoIf you read the whole thing, it's amazing: it went from predicting the right answer 1% of the time to 2% of the time, when given a closed set of nominees. "Can predict the future" achieved.