3 ms·
This paper shows that 200-800 is the ideal chunk size; if you go above, the model starts getting confused / distracted. https://arxiv.org/pdf/2406.14497 https:/
by CuriousJ 2y ago
This paper shows that 200-800 is the ideal chunk size; if you go above, the model starts getting confused / distracted. https://arxiv.org/pdf/2406.14497 https://arxiv.org/pdf/2406.14497
- zaptrem 2y agoMakes sense. Thanks!