3 ms·
Seems to truncate the input to only 2048 input tokens
by croemer 1y ago
Seems to truncate the input to only 2048 input tokens
- simonw 1y agoOops! That's an Ollama default setting. You can fix that by increasing the num_ctx setting - I'll try running this again. The num_predict setting controls output size.