4 ms·
Where does the EleutherAI computing resource and the money required to pay for it come from? Edit: I think they got a grant from the TPU Research org [1] http
by syntaxing 5y ago
Where does the EleutherAI computing resource and the money required to pay for it come from?
Edit: I think they got a grant from the TPU Research org
[1] https://sites.research.google/trc/ https://sites.research.google/trc/
- Tenoke 5y agoAs it says in the post the free compute from Google's TFRC and also a collaboration with Coreweave who pledged more.
- syntaxing 5y agoMissed it when I was skimming the article but saw a reference to them in the repo
- Tenoke 5y agoAlso for what is worth TFRC is not really a grant grant. You just sign up and if they like you they give you access.
- ma2rten 5y agoI think they do ask you what you are planning to use the resources for, what your qualifications are and make a decision to allocate and how many tpus based on that.
- Tenoke 5y agoYes, they do but it's not really a grant and they don't really follow up on what you do unless you contact them yourself. You just fill a form and if you get accepted get an email later with access. At least that's how it was when I got accepted but things might've changed since last I've heard.
- syntaxing 5y agoInteresting, TIL! I never heard about them until today
- sillysaurusx 5y agoApply to TRC! You personally can get the same computing resources. https://blog.gpt4.org/jaxtpu https://blog.gpt4.org/jaxtpu For some reason, everyone is reluctant to apply. I wrote that to dispel some of the hesitation. Wanting to play with TPUs is a fine reason to join. Some reasons why TRC is awesome: https://news.ycombinator.com/item?id=27728225 https://news.ycombinator.com/item?id=27728225
- lostmsu 5y ago> For some reason, everyone is reluctant to apply We just don't want another vendor lock-in. Especially for research projects. Maybe if TPUs were sold in the open market.
- stellaathena 5y agoTurning down hundreds of thousands of dollars of cloud credits because of vendor lock-in is extremely shortsighted for the overwhelming majority of projects.
- lostmsu 5y ago> extremely shortsighted I think it is extremely LONG-sighted: an individual research institute might save $100k right now, but the lock-in might force 10x pay in 5 years to continue research. Not to mention it might affect ability of smaller institutes and individual researchers to enter the field, which is also worse for research as whole.
- syntaxing 5y agoThis is super interesting, the way its worded, I honestly expected it to be for research scientist or ambitious projects like EluetherAI. Really appreciate the HN comment and blog post for that perspective!
- nerderloo 5y agoIf Google jacks up the price of TPU or terminate the TPU usage because they don't like you, you're screwed. It's quite a high risk for commercial product companies.
- nceqs3 5y agoThey didn't go through Google. Some other DL company paid for it. It's on their discord.
- mm983 5y agothey did both, tpu is provided by google and coreweave offers gpu runtimes