Oh interesting thank you, I thought they were using it. There's nice stuff you can do with the probabilities, a shame it's more restricted with the chat models

Oh interesting thank you, I thought they were using it. There's nice stuff you can do with the probabilities, a shame it's more restricted with the chat models. I hope they add some lightweight thing you could pass with your request to constrain the response.