4 ms·
I would imagine the context takes up valuable input tokens that you would otherwise need to use for your request. So you'll run out at some point and then you j
by daemin 2y ago
I would imagine the context takes up valuable input tokens that you would otherwise need to use for your request. So you'll run out at some point and then you just have a simple model rather than a skilled engineer.
- helloplanets 2y agoCan't you just cache the context?