3 ms·

You can’t verify that you’re paying what you should be if you can’t see the hidden tokens.

• sebzim4500 2y ago
  With the conventional models you don't get the activations or the logits even though those would be useful. Ultimately if the output of the model is not worth what you end up paying for it then great, I don't see why it really matters to you whether OpenAI is lying about token counts or not.
  • dartos 2y ago
    As a single user, it doesn’t really, but as a SaaS operator I want tractable, hopefully predictable pricing. I wouldn’t just implicitly trust a vendor when they say “yeah we’re just going to charge you for what we feel like when we feel like. You can trust us.”