3 ms·
The problem is (as always) the "bad user" case. You get some users who run at 100% utilization full time (or more because depending on your model they might be
by nl 4y ago
The problem is (as always) the "bad user" case. You get some users who run at 100% utilization full time (or more because depending on your model they might be able to have multiple instances). They'll be the ones doing things like running a Discord bot in a popular server, or reselling the image generation or something.
This kills your margin.