4 ms·Everyone serious batches together short prompts so the cost is roughly proportional to the tokens.by sebzim4500 3y agoEveryone serious batches together short prompts so the cost is roughly proportional to the tokens.