3 ms·
You can get all the necessary log probabilities from the GPT-3 API.
You can get all the necessary log probabilities from the GPT-3 API.
Seems to me you might be able to guess without the weights by manually changing a word or two and seeing how much gpt wants to change.
Hmm seems you may be right. You can get the top 5 out of the box but you’ll need to file for an exception to get any more than that.