2 ms·

Note that you also might need to think a little bit about caching: https://openrouter.ai/docs/guides/best-practices/prompt-caching https://openrouter.ai/docs/gu

by KronisLV 11mo ago

Note that you also might need to think a little bit about caching: https://openrouter.ai/docs/guides/best-practices/prompt-caching https://openrouter.ai/docs/guides/best-practices/prompt-cach... Depending on the way how the context grows, it can matter quite a bit!

hivetechs 11mo ago
Great call out! Yes I have tried to follow these, to make Consensus compliant with OpenRouter's prompt caching best practices.