2 ms·
What is the average paragraph length? I would consider using one of the 32k context windows. Define a delimiter for the paragraphs and prefix the prompt to pr
by tmaly 3y ago
What is the average paragraph length?
I would consider using one of the 32k context windows.
Define a delimiter for the paragraphs and prefix the prompt to process each then write out with a delimiter the result you need.
Maybe wrap your call in a simple try catch and do exponential back-off.