3 ms·
The main use case is on demand neural net inference 24/7 availability. Kind of like hosting a website that must be on 24/7, this neural net must be on 24/7. I
by etaioinshrdlu 7y ago
The main use case is on demand neural net inference 24/7 availability.
Kind of like hosting a website that must be on 24/7, this neural net must be on 24/7.
It runs on the order of 50x faster on an nvidia GPU compared to a CPU.
But it will sit idle most of the time.
Price per hour per GB of GPU ram is the most important metric when choosing a server.
- somuchtyler 7y agoI really like nocix servers, they are out of Kansas City. They got their "i7-6700K 32GB + 2x 480GB SSD + GTX 1080" for $105/mo https://www.nocix.net/cart/?id=338 https://www.nocix.net/cart/?id=338
- etaioinshrdlu 7y agoThis sounds great but they are also out of stock!
- rpedela 7y agoWould AWS Elastic Inference work for your use case? https://aws.amazon.com/machine-learning/elastic-inference/ https://aws.amazon.com/machine-learning/elastic-inference/
- etaioinshrdlu 7y agoNo, I need NVIDIA CUDA support. Also, the most important metric for me is cost per month per GB of GPU RAM, and AWS elastic inference is pretty bad in that metric.