3 ms·You can run a model locally on much less expensive hardware. It's training that requires the really big GPUs.by simonw 1y agoYou can run a model locally on much less expensive hardware. It's training that requires the really big GPUs.