3 ms·
Wouldn't it be better to arrange the network and software to run the GPUs continuously at optimal usage? Otherwise a lot of expensive GPU capital is idle betwe
by Merrill 1y ago
Wouldn't it be better to arrange the network and software to run the GPUs continuously at optimal usage?
Otherwise a lot of expensive GPU capital is idle between bursts of computation.
Didn't DeepSeek do something like this to get more system level performance out of less capable GPUs?