4 ms·
It depends on how you construct the prompt. If you only give it "Here are the countries whose population exceeds 1 million:" the model has a chance to go on a
by minimaxir 6y ago
It depends on how you construct the prompt.
If you only give it "Here are the countries whose population exceeds 1 million:" the model has a chance to go on a tangent / inconsistently structured output / inconsistent values in output (examples when generating at temp=0.7: https://gist.github.com/minimaxir/86e09253f9e05058eb1e96de2b73c079 https://gist.github.com/minimaxir/86e09253f9e05058eb1e96de2b... )
If you give it the same prompt with a doubleline break and a "1.", it behaves much better.
- deleted 6y ago[deleted]