3 ms·
If you have 2x DGX Spark it will run quite nicely. They cost only $8000 or so and use less power so you may be able to rent them cheaper than the MI300X. I fou
by Tepix 2mo ago
If you have 2x DGX Spark it will run quite nicely. They cost only $8000 or so and use less power so you may be able to rent them cheaper than the MI300X.
I found an offer to rent two at $1.65 per hour https://spark.enverge.ai/#pricing https://spark.enverge.ai/#pricing
The MI300X will vastly outperform it for only a slightly higher price.
- K0IN 2mo agoAs other calculated, even with a Mi300 you could not saturae it enough with one stream to break even with the DS API, so I think renting sparks would make it even harder cause they are considerably slower. (274gb/s vs 5.3tb/s)
- Tepix 2mo agoPrivacy is often a requirement.
- tudorizer 2mo agoThey've gone up in price a bit now, just like most of the market. Still a fair option for renting a DGX Spark.