It would be helpful to see the prompt structure used for gpt-3: state of the art prompting methods do significantly better than naive ones, and randomness and o

It would be helpful to see the prompt structure used for gpt-3: state of the art prompting methods do significantly better than naive ones, and randomness and other settings can make a big difference in quality as well. There are also cyclical prompt methods which can help derandomize gpt3, for example, you could generate three to five answers per question then feed the set back to gpt-3 and ask it which is the most correct; the first round would use high randomness settings the last very low. My own experience is that you sort of have to work with gpt3 to get on the same page sometimes, and when you do the results can be remarkable. Anyway, fun idea!