3 ms·
That's an odd explanation, given the unexpected responses were still (somewhat) coherent: https://twitter.com/seanw_m/status/1760115118690509168 https://twitter
by minimaxir 3y ago
That's an odd explanation, given the unexpected responses were still (somewhat) coherent: https://twitter.com/seanw_m/status/1760115118690509168 https://twitter.com/seanw_m/status/1760115118690509168
If the logit calculation broke, you'd expect complete cascading nonsense like if you set the temperature parameter too high: https://twitter.com/minimaxir/status/1758732017477525792 https://twitter.com/minimaxir/status/1758732017477525792
- swyx 3y agoagreed. does not feel consistently candid.
- SkyPuncher 3y agoTo, me it reads like displaying the wrong clock time to the user. Under the hood, everything is working in UTC, but something went wrong converting that to the user's local timezone. If the whole system works in UTC, actual business logic shouldn't be affected.
- danielmarkbruce 3y agoIt doesn't sound like logit calculation breaking. It sounds like the text decoding (ie sampling from the probabilities) that broke. It's also part of the model which they are likely constantly tinkering with. It's easy to imagine how that could result in sometimes coherent sometimes incoherent outputs.