4 ms·
Most people don't just rent a single GPU to run something outside of training. A10 tensors are a faster version of T4, which are cheaper for running inference (
by aljarry 5y ago
Most people don't just rent a single GPU to run something outside of training. A10 tensors are a faster version of T4, which are cheaper for running inference (albeit slower than typical GPU).
Cheapest reasonable GPU instance you can get on EC2 is P3.2xlarge with $3.06/h.