4 ms·
Key things for debugging: * What is the data format it gets? Does it unambiguously correspond to output (i.e. without mistaking rows for cols, or indexes start
by stared 2y ago
Key things for debugging:
* What is the data format it gets? Does it unambiguously correspond to output (i.e. without mistaking rows for cols, or indexes starting at 0 or 1)?
* What is the prompt?
* Is the model allowed to think? (If it is just JSON response, I expect it to suck, as tokens are units of thinking.)