3 ms·
If this logic applied, then there would be no purpose in them having the 5 hourly limit.
by farfatched 5mo ago
If this logic applied, then there would be no purpose in them having the 5 hourly limit.
- cbg0 5mo agoThe purpose is to control the total amount of requests they need to handle in a given timeframe. If everyone could use up their whole weekly limit in 5 hours, many would do so, thus pushing the GPU/TPU clusters to or above their capacity limits.