3 ms·
Well, not recently. That was from at the ChatGPT launch when they were still using a quick hack that made the client too-privileged, so more or less a year ago.
by gwern 3y ago
Well, not recently. That was from at the ChatGPT launch when they were still using a quick hack that made the client too-privileged, so more or less a year ago.
However, I definitely am wondering if they have poisoned the logits somehow. As long as the logits rank the tokens in order (are monotonic), preserving their utility for the suggested applications like ranking autocompletions, you presumably could screw with the magnitudes arbitrarily.