4 ms·
How would I do this reliably? Eg give me 10 different values, all in one prompt for performance reasons? Might not need JSON but whatever format it outputs, it
by janpieterz 2y ago
How would I do this reliably? Eg give me 10 different values, all in one prompt for performance reasons?
Might not need JSON but whatever format it outputs, it needs to be reliable.
- jncfhnb 2y agoDon’t do it all in one prompt.
- janpieterz 2y agoRight, but now I’m basically running a huge performance hit, need to parallelize my queries etc. I was parsing a document recently, 10-ish questions for 1 document, would make things expensive. Might be what’s needed but not ideal.
- jncfhnb 2y agoLLM performance is a function of the number of tokens, not queries