4 ms·
How do you explain people issuing the same prompt over time as a test and getting worse and worse responses?
by ryanklee 3y ago
How do you explain people issuing the same prompt over time as a test and getting worse and worse responses?
- ChatGTP 3y agoWell because it's just what the parent said, it's all a subjective experience, and maybe the anthropomorphism element to it blew people away more than the actually content of the responses ? Ie, you're just used to it now. The human mind is ridiculously fickle, it takes a lot to be impressed for more than a few days / weeks. It did seem radically cool at first but over time I got quite sick of using it too.
- ryanklee 3y agoYeah I'm sure that explains many of the complaints. I would be surprised if there weren't changes happening that has degraded quality, though, even if only marginally but perceptively.
- YeGoblynQueenne 3y agoRemember that everytime you're interacting with ChatGPT you're sampling from a distribution, so there's some degree of variation to the responses you get. That's all you need to have regression to the mean. If the results are really getting worse monotonically then that's a different matter, but the evidence for that is, as far as I can tell, in the form of impressions and feelings, rather than systematic testing, like the sibling comment by ChatGTP says, so it's not very strong evidence.
- gwd 3y agoFWIW here's a coding interaction that impressed me a month ago: https://gitlab.com/-/snippets/2535443 https://gitlab.com/-/snippets/2535443 And here it is again just now: https://gitlab.com/-/snippets/2549955 https://gitlab.com/-/snippets/2549955 I do think the first one is slightly better; but then again, the quality varies quite a bit between run to run anyway. The second one is certainly on-point and I don't think the difference would count as being statistically significant.