3 ms·
This has been my experience with any model with a large response token limit. I've had to work around this by running it through several times with specific que
by film42 2y ago
This has been my experience with any model with a large response token limit. I've had to work around this by running it through several times with specific questions about the data: extract text, extract tables, extract <specific detail>. They seem to do well on large input though so I just concat all the extracted info and things seem to work just fine.