3 ms·
>not sure why It is to reduce abuse of their API because these requests are very expensive to serve as it requires 100s of gigabytes of VRAM to serve a request
by charcircuit 4y ago
>not sure why
It is to reduce abuse of their API because these requests are very expensive to serve as it requires 100s of gigabytes of VRAM to serve a request, requests take a few seconds at a time, and they are handling a ton of free requests. If you were paying for their API you could be paying up to about $0.10 per text generation.