3 ms·
They sort of are, in that they want subscription users to have clients that behave well with the KV cache etc. If you don't use a subscription, and pay per tok
by robbie-c 3mo ago
They sort of are, in that they want subscription users to have clients that behave well with the KV cache etc.
If you don't use a subscription, and pay per token instead, you can easily move to another harness.