3 ms·
When you describe ChatGPT as just a model with weights that can create a string of tokens, is it any different from any lossless compression algorithm? I'm sur
by Philip-J-Fry 2y ago
When you describe ChatGPT as just a model with weights that can create a string of tokens, is it any different from any lossless compression algorithm?
I'm sure if I had a JPEG of some copyrighted raw image it could still be argued that it is the same image. JPEG is imperfect, the result you get is the same every time you open it but it's not the same as the original input data.
ChatGPT would give you the same output every time, and it does if you turn off the "temperature" setting. Introduce a bit of randomness into a JPEG decoder and functionally what's the difference? A slightly different string of tokens for ChatGPT versus a slightly different collection of pixels for a JPEG.
- CyberDildonics 2y agoDid you mean lossy compression algorithm? That would make sense.