4 ms·
The text it compressed is from Wikipedia, so I'm not convinced it isn't primarily relying on having memorized it. I tried with text that was published in the pa
by Imnimo 4y ago
The text it compressed is from Wikipedia, so I'm not convinced it isn't primarily relying on having memorized it. I tried with text that was published in the past week (and so definitely isn't in GPT-4's training). GPT-4 refused to even attempt to decode, but after resampling the response a few times, it made an attempt. It was completely unrelated to the original text.
- PoignardAzur 4y agoTo be clear, you attempted to give GPT-4 custom text and asked it to compress it / decompress the result?
- Imnimo 4y agohttps://imgur.com/a/uahlB4H https://imgur.com/a/uahlB4H Here's exactly what I did. I used the prompts in the original tweet, but substituted in text that was published too recently to be in GPT-4's training data. I ran the compression and decompression in separate sessions. You can see in the second screenshot that I'm on my 3rd output, the first two were refusals to even attempt decoding.