3 ms·
OpenAI GPU wont be idle for long because they have all other requests to serve. Over time there will be a certain % of idle GPUs, amortized across all hundreds
by bijowo1676 6mo ago
OpenAI GPU wont be idle for long because they have all other requests to serve. Over time there will be a certain % of idle GPUs, amortized across all hundreds of millions of requests they receive.
- aoeusnth1 6mo agoAnd idle% is causally connected to whether you make a request or not, surely? I don't understand how your mental model works.