3 ms·
I think the expense is mostly because these are GPU instances, which are not yet commoditized. Unlike VMs, multi-tenancy on GPUs is just a little bit harder.
by wenc 8y ago
I think the expense is mostly because these are GPU instances, which are not yet commoditized. Unlike VMs, multi-tenancy on GPUs is just a little bit harder.
- ilaksh 8y agoRegular AWS EC2 is still a lot more expensive than the alternatives that I mentioned.
- Namidairo 8y agoThe 15 tables in the nvidia grid documentation kind of shows how much of a mess it is. Different resolutions and maximum tenants depending on card and license type, and you can't allocate resources homogeneously.
- vidarh 8y agoActually the savings on this server looks to me to be low compared to what I'd usually expect. You should use AWS for convenience, not cost. They're expensive for cloud services, and even the cheapest cloud providers are expensive compared to renting dedicated for all but the most transient workloads, and of dedicated hosting providers I only know Hetzner to get close to the costs I could get for renting colo space or doing truly on-prem hosting. Even then the only reason Hetzner is competitive is because I'm in London where space/power is expensive, and they're in Germany, where it is cheap (e.g. they rent out colo space as well, and prices are at 1/3 to 1/4 of what I've paid in London).
- coleca 8y agoHetzner rents out 1080Ti GPUs which are not available in most regions or from most cloud providers, hence the lower cost. This article refers to the much more expensive Tesla V100 GPUs. From what I understand the NVidia license for the 1080Tis prevents cloud providers from offering them for uses other than blockchain. Since AWS can't control what you actually do with it, they simply don't offer 1080Tis. Source: https://www.theregister.co.uk/2018/01/03/nvidia_server_gpus/ https://www.theregister.co.uk/2018/01/03/nvidia_server_gpus/