4 ms·
A moderately well-known physicist and I talked about this a few years ago. He had been given access to the raw (non-instruct) version of GPT 4 as an early teste
by tekacs 6mo ago
A moderately well-known physicist and I talked about this a few years ago. He had been given access to the raw (non-instruct) version of GPT 4 as an early tester.
He explained that when he fed it snippets of the beginning of text, it would complete it in his voice and then sign it with his name.
I think this has been true for a while, probably diminished a little bit by the Instruct post training, and would presumably vary by degree as the size of the pretrain.
- nextaccountic 6mo ago> He explained that when he fed it snippets of the beginning of text, it would complete it in his voice and then sign it with his name. Is this public text already in the training set, or private text that might as well be written on the spot for the AI? I don't doubt AI can "fingerprint" you through your text (ideas, vocabulary, tone, etc), but those are different things, capability-wise
- giancarlostoro 6mo ago> I don't doubt AI can "fingerprint" you through your text (ideas, vocabulary, tone, etc), but those are different things, capability-wise The entire point of AI is pattern recognition, everything else is icing on the cake.
- orbital-decay 6mo agoImagine a cake with a truckload of icing on top.
- tekacs 6mo agoPrivate / freshly written text, naturally. Public would've been relatively unsurprising.