2 ms·
Most LLM providers have batch mode. Not sure why you are calling them out.
by dist-epoch 1y ago
Most LLM providers have batch mode. Not sure why you are calling them out.
- okdood64 1y agoI'll take it further. Regular cloud compute have batch workload capabilities at cheaper rates, as well since forever.