3 ms·
Looking at your pricing, is that per seconds of GPU usage or per total seconds the app is running? Eg. might have only a few minutes of usage in an hour and th
by senko 4y ago
Looking at your pricing, is that per seconds of GPU usage or per total seconds the app is running?
Eg. might have only a few minutes of usage in an hour and the rest of the time is spent waiting for requests. How's that billed?
- edunteman 4y agohttps://docs.banana.dev/banana-docs/core-concepts/billing https://docs.banana.dev/banana-docs/core-concepts/billing You're only billed for active replica time. Call comes in, we start a replica, it handles the request, it waits around for a 10s (configurable) idle timeout to handle any additional calls, and shuts down if no other calls to serve. The idle timeout is to prevent cold boots when not necessary, but is billed, so you can get closer to pure pay-per-call pricing by reducing idle timeout.