5 ms·
Gpulist – Craigslist for GPUs
- dartos 3y agoAm I misunderstanding something, or are these prices insane?
- AnotherGoodName 3y agoWell the cost of the gpus themselves is insane. A single h100 you can hold on your hand costs the around the same as an entire Tesla model 3.
- sjwhevvvvvsj 3y agoLess chance of fatal-to-operator malfunctioning tho.
- rvnx 3y ago$30K<->$40K and it apparently costs Nvidia around $3.3K to manufacture an H100 GPU for info
- __loam 3y agoCost to produce doesn't matter. The reason these things are so expensive is demand and the limited capacity of fabs to produce them.
- WithinReason 3y agoYou pay mostly for CUDA, not the GPU
- mikeweiss 3y agoAnyone have any predictions about when the prices will start going down significantly? Anyone think we could see price per hour per GPU cut in half by July?
- CamperBob2 3y agoWhen some more EUV fabs come online. So... 5-10 years min.
- mikeweiss 3y agoLooks like we have a bunch of start-up cloud companies who have money being thrown at them by god knows who buying thousands of H100s and other GPUs. These are all going to come online around the same time in early spring. I think we will see prices drop rapidly by June .
- stonogo 3y agoThey're not only insane (i.e. offering H100s for rent at a quarter the price they'd be to purchase) they're also impossible, since every listing claims to have deployed an Infiniband fabric speed which is firmly in the future.
- jonathanlei 3y agoJonathan from TensorDock (https://tensordock.com/ https://tensordock.com/) here - we listed two of our A100 and H100 clusters on the site. The IB equipped on our clusters (can't speak to others) is 8x 400 Gbps. Most customers training foundational models are able to fully utilize that fabric in parallel.
- stonogo 3y agoWhich HCAs are enabling that? You're using eight 4-link QSFPs here?, presuming this is NDR? And out of curiosity, is aggregate bandwidth the normal marketing metric in this industry? In my neck of the woods this would be reported as an NDR400 system.
- KeplerBoy 3y agoIsn't 2-3$ per hour the standard rate for A100s and H100s spot pricing?
- helsinki 3y agoYeah, looks like you’re expected to spend a minimum of $3,000,000 to meet the minimum requirement for some of the offerings.
- throwaway81523 3y agoThis is like vast.ai right? Or is it even the same place?
- pizza 3y agoCan you add the cost of the minimum reservation inline too? E.g. if it were $1/gpu/hr and "Minimum 1 GPU for 1 week" then make that text "Minimum 1 GPU for 1 week ($168)". This would allow faster comparison between options when on a budget.
- IanCal 3y agoThis would particularly help with the second entry that's $2.30/HR but a minimum cost of over ten million dollars.
- dishsoap 3y agoThat's more to rent them for 2 years than it would be to buy the gpus outright, it seems. I guess adding on the cost of all the supporting hardware might exceed it though.
- padolsey 3y agoHmm who's this for? vast.ai seems far more reputable and competitive: https://cloud.vast.ai/create/ https://cloud.vast.ai/create/ Why would I bother getting in touch with a random seller when there's a whole eco-system already in existence?
- deleted 3y ago[deleted]
- ryukoposting 3y agoI'm trying to figure this out too. The great thing about CraigsList is that sellers are physically local, and you can haggle with them. From a seller's perspective, a physically localized audience means less competition. None of that applies here. Aesthetics? I guess?
- natfriedman 3y agoDoes vast do clusters? This is for clusters.
- jasonjmcghee 3y agoWow, H100 for $2.80/hr, A100 for $1.80/hr. How reasonable are those prices? Seems pretty reasonable.
- erikaww 3y agoShould take it to the next level and make it automatic- AirBnB for gpus
- kaycebasques 3y agocraigpu would have also been acceptable
- petepete 3y agoGPUber?
- sjwhevvvvvsj 3y agoTruth is indeed stranger than fiction - none of my cyberpunk bingo cards had this on it.
- Williams77 3y ago[dead]
- KomoD 3y agoI expected this to be actual GPUs for sale
- VyseofArcadia 3y agoYeah, Craigslist for GPUs is a terrible tagline. My first thought was, isn't Craigslist Craigslist for GPUs?
- natfriedman 3y agocraigslist for gpu cluster rentals?
- Osiris 3y agoIt's not? Craigslist is for buying other people's old used stuff. I assume that means this site is for buying old used GPUS, maybe sourced from reputable sources.
- adastra22 3y agoThese are rentals. With the exception of housing, craigslist is mostly used for sales.
- ilaksh 3y agoIs TensorDock a vast.ai wrapper?
- jonathanlei 3y agoHi! Jonathan from TensorDock here :) We have our own supply base (sourced through https://tensordock.com/host https://tensordock.com/host), operate some of our own servers, and are not related to any other marketplace :) We think we have better security & reliability than Vast.ai due to virtualization rather than Dockerization, as well as more strict access controls [1]. Additionally, you can run Windows VMs on us if you want :) [1]https://tensordock.com/security https://tensordock.com/security
- minimaxir 3y agoRelevant context: this is being headed by Daniel Gross and Nat Friedman. https://twitter.com/natfriedman/status/1757923480434323521 https://twitter.com/natfriedman/status/1757923480434323521
- ttul 3y agoWho the hell are they? /s
- Linda231 3y ago[dead]
- silisili 3y agoIf it doesn't have creepy guys making missed connection posts about women they saw and were too afraid to talk to, it's not Craigslist.
- latchkey 3y agoLimited to only 3 types of GPUs?
- peter_d_sherman 3y agoI can almost visualize future commodity/options/derivatives trading market around underlying GPU per hour rental prices... You know, a contract to rent a cetain GPU at a certain price per hour for a certain number of hours -- would be sort of like a commodity delivery contract. Once those are created, then options, but more broadly, financial derivatives -- could be created on top of those... Once those are created -- they could then be traded, held long, sold short, and otherwise "invested in" and/or "speculated on" -- depending on what terminology one prefers... Also, to be clear, I'm not saying that this should be done -- only that it could be done... That is (and pardon this exceptionally bad pun!) -- with respect to trading possibilities around the GPU rental prices market, you could say I am only speculating! :-) <g> :-) Anyway, thumbs up for GPUlist!