5 ms·
Still way too expensive for individuals and startups imo. These A10 cards are just slightly slower than RTX3090, which makes it an easy comparison. $1/hour for
by Jack000 5y ago
Still way too expensive for individuals and startups imo. These A10 cards are just slightly slower than RTX3090, which makes it an easy comparison. $1/hour for the cheapest option means renting for 62 days is equivalent to buying outright (add a few weeks to account for the price of the other computer components)
A big part of the difference is in Nvidia's datacenter tax (The A10 is basically a 3090, just double the price). Hopefully AMD's new accelerators will bring some much needed competition to the market.
- dougSF70 5y agoGiven 5 year old cards can still perform at some level, buying makes much more sense than renting at $1 per hour.
- scottcodie 5y agoThere are a lot of other costs to consider than only the total cost of the physical item. If you need full time dedicated tensor cards and willing to foot the datacenter and staffing costs then maybe purchasing the cards out right is a better option.
- postalrat 5y agoWhy do you need to put them in some expensive datacenter?
- aljarry 5y agoMost people don't just rent a single GPU to run something outside of training. A10 tensors are a faster version of T4, which are cheaper for running inference (albeit slower than typical GPU). Cheapest reasonable GPU instance you can get on EC2 is P3.2xlarge with $3.06/h.