Yeah, agreed. We’re one of those types of customers. We wrote an OpenAI API compatible gateway that automatically batches stuff for us, so we get 50% off for b

Yeah, agreed. We’re one of those types of customers. We wrote an OpenAI API compatible gateway that automatically batches stuff for us, so we get 50% off for basically no extra dev work in our client applications. I don’t care about speed, I care about getting the right answer. The cost is fine as long as the output generates us more profit.