35 ms·
Very cool. When you hit the generate key sequence mid way through a document, how much of that text is included in the prompt?
by saintsfc 4y ago
Very cool. When you hit the generate key sequence mid way through a document, how much of that text is included in the prompt?
- typpo 4y agoThis is configurable in Settings, but by default it sends the last ~1024 characters and asks the AI to generate up to 256 tokens.