4 ms·
No they can't, that's what you don't seem to get. Reloading those tokens takes around the same effort as processing them in the first place. It's ok to be ign
by pixl97 6mo ago
No they can't, that's what you don't seem to get.
Reloading those tokens takes around the same effort as processing them in the first place.
It's ok to be ignorant of how the infrastructure for LLMs work, just don't be proud of it.
- charcircuit 6mo agoThey literally can. They could make the API free to use if they wanted. There is no law that states that costs have to equal the cost it takes to process the request.