4 ms·

I'm not 100% sure what you mean by this, but there is token probability available in some providers: https://cookbook.openai.com/examples/using_logprobs https:

• madacol 2y ago
  I think logprobs functionality was removed because it allowed to exfiltrate the last layer of weights of their propietary models