4 ms·

I have never seen this tool. Thanks for sharing! The Alibaba price you cited is for interruptible/spot. For V100 on-demand (uninterruptible) Oracle is least ex

I have never seen this tool. Thanks for sharing! The Alibaba price you cited is for interruptible/spot. For V100 on-demand (uninterruptible) Oracle is least expensive from that list at $1.275/hr.

freediver 4y ago
Thanks, I created this tool to exactly find cheapest GPUs then expanded to everything else. Interruptible is sufficient for model training which is what these high end GPUs are typically used for (and you want cheapest possible)
- wintermute9124 4y ago
  Didn't realize you made this tool. It's super useful. Some unsolicited feedback, if you're still actively developing: - You should consider some of the lesser known cloud providers (e.g. Coreweave/Lambda Labs/TensorDock). - Add information about whether the servers support NVLink/NVswitch. For example, A100s come in 3 flavors: PCIe without NVLink bridges, PCIe with NVLink bridges, and SXM with NVlink/NVSwitch fabric.
  - freediver 4y ago
    There are hundreds of smaller providers, each having a different API , if having it at all, so this is not possible for a one man operation. CloudOptimizer is already the largest cloud comparison tool on the web (12 cloud providers listed)
- jonathanlei 4y ago
  Wow, cool! Yes - interruptible can be very cheap... I'll add it to our backlog so we do that instead of idly mining I was wondering, do you happen to have an API for listing servers? We're launching a marketplace later in August (https://www.tensordock.com/product-marketplace https://www.tensordock.com/product-marketplace), and we expect pricing to be really really cheap. Like #1 in industry cheap while retaining. Interruptible, if we add that, would probably be even less than those prices listed. It'd be really cool if we could auto-update availabilities of GPU servers through an API so that we can list our servers on your tool as well :)
  - freediver 4y ago
    If your prices really end up being industry cheapest let me know and we can make it happen.

I have never seen this tool. Thanks for sharing! The Alibaba price you cited is for interruptible/spot. For V100 on-demand (uninterruptible) Oracle is least expensive from that list at $1.275/hr.

freediver 4y ago

Thanks, I created this tool to exactly find cheapest GPUs then expanded to everything else. Interruptible is sufficient for model training which is what these high end GPUs are typically used for (and you want cheapest possible)

wintermute9124 4y ago
Didn't realize you made this tool. It's super useful. Some unsolicited feedback, if you're still actively developing: - You should consider some of the lesser known cloud providers (e.g. Coreweave/Lambda Labs/TensorDock). - Add information about whether the servers support NVLink/NVswitch. For example, A100s come in 3 flavors: PCIe without NVLink bridges, PCIe with NVLink bridges, and SXM with NVlink/NVSwitch fabric.
- freediver 4y ago
  There are hundreds of smaller providers, each having a different API , if having it at all, so this is not possible for a one man operation. CloudOptimizer is already the largest cloud comparison tool on the web (12 cloud providers listed)
jonathanlei 4y ago
Wow, cool! Yes - interruptible can be very cheap... I'll add it to our backlog so we do that instead of idly mining I was wondering, do you happen to have an API for listing servers? We're launching a marketplace later in August (https://www.tensordock.com/product-marketplace https://www.tensordock.com/product-marketplace), and we expect pricing to be really really cheap. Like #1 in industry cheap while retaining. Interruptible, if we add that, would probably be even less than those prices listed. It'd be really cool if we could auto-update availabilities of GPU servers through an API so that we can list our servers on your tool as well :)
- freediver 4y ago
  If your prices really end up being industry cheapest let me know and we can make it happen.