4 ms·
Care to also check if they do prompt decomposition into multiple prompts?
by _boffin_ 1y ago
Care to also check if they do prompt decomposition into multiple prompts?
- dataviz1000 1y agoYou're asking if they break the user prompt into multiple chunks? All I can find is counting number of tokens and trimming to make sure the current turn conversation fits. I can not find any chunking logic to make multiple requests. This logic exists in the classes that extend IIntentInvocation which as buildPrompt() method.
- _boffin_ 1y agoI believe it's this paper, but... not certain: https://arxiv.org/abs/2210.02406 https://arxiv.org/abs/2210.02406 will update when i find more info.
- deleted 1y ago[deleted]