4 ms·
One of the perks of crypto losing value. GPUs finally being used for breakthrough research, rather than pyramid schemes.
by Thorentis 4y ago
One of the perks of crypto losing value. GPUs finally being used for breakthrough research, rather than pyramid schemes.
- nindalf 4y agoThis claim feels truthy, but is it true? Most of the big models were being trained on specialised hardware like tensor chips right? And the biggest drop isn’t because crypto is worth less, it’s because Ethereum doesn’t use proof of work since November (Bitcoin hasn’t used GPUs for years). The explosion in novel AI models we saw last year predates this change.
- bfgoodrich 4y ago[dead]
- lajamerr 4y agoMost big AI is trained on Nvidia GPUs but usually not the standard consumer ones found in the GeForce line-up. Instead it's usually their data centre GPUs like the current A100 or soon to be H100 that's just hitting the market. Google does have their TPUs(Tensor Processing Units), however it is not cost efficient budget wise, so unless you have some kind of deal with Google or compute credits it doesn't make sense. They have pods upon pods of TPU clusters though so the main selling point of TPU training is that you can get your training done really fast with just the ease of scaling your workload to more TPUs. So if you needed a big model like GPT-3 trained in a single day, you could spend an ungodly amounts of money and get it done with Google TPUs. Otherwise if you can wait weeks or months you can go with the standard Nvidia data centre solution and it'd be cheaper at the end by a significant margin.
- kybernetyk 4y agoCrypto has been running on ASICs for years. The "evil crypto miners make your GPUs so expensive" psyop is a NVIDIA campaign to rise GPU prices.
- DonHopkins 4y agoTrue, but that doesn't mean that crypto miners aren't still evil.
- 2342346666 4y agoCrypto has some real use cases... have you ever tried to transfer money to another country? That's just one of many.