2 ms·
You're asking if they break the user prompt into multiple chunks? All I can find is counting number of tokens and trimming to make sure the current turn conver
by dataviz1000 1y ago
You're asking if they break the user prompt into multiple chunks?
All I can find is counting number of tokens and trimming to make sure the current turn conversation fits. I can not find any chunking logic to make multiple requests. This logic exists in the classes that extend IIntentInvocation which as buildPrompt() method.
- _boffin_ 1y agoI believe it's this paper, but... not certain: https://arxiv.org/abs/2210.02406 https://arxiv.org/abs/2210.02406 will update when i find more info.
- deleted 1y ago[deleted]