4 ms·
I have a system prompt of around 100k which includes a couple of internal schema definitions. Having this cached could be super useful to us.
by config_yml 2y ago
I have a system prompt of around 100k which includes a couple of internal schema definitions. Having this cached could be super useful to us.
- BonoboIO 2y ago100k … I hear and use all of these high token context LLMs, but often they fail to include all information that should be in their context. Does your approach work for you?
- social_quotient 2y agoWould love if you could de identify and share a bit more detail on a prompt that big.