3 ms·
Ask HN: Would ChatGPT semantic token coloring give insight into its replies?
For example, it could highlight important tokens in the context window as it outputs each word in its reply.
- minimaxir 3y agoThose token highlighters work by using the token selection probability, which you can do already with the logprobs parameter to the API. The old GPT-3 web UI had it and it was removed since it's not as valuable as you would think.