3 ms·
Is it not a conflict of interest for a model provider to supply the harness? They are not motivated to minimize your costs.
by hackingonempty 3mo ago
Is it not a conflict of interest for a model provider to supply the harness? They are not motivated to minimize your costs.
- robbie-c 3mo agoThey sort of are, in that they want subscription users to have clients that behave well with the KV cache etc. If you don't use a subscription, and pay per token instead, you can easily move to another harness.