3 ms·
something to keep in mind is this datacenter will be doing so many other projects as well. it's not a dedicated LLM maker. Maybe the LLM training won't have acc
by ftxbro 3y ago
something to keep in mind is this datacenter will be doing so many other projects as well. it's not a dedicated LLM maker. Maybe the LLM training won't have access to all those GPUs, or maybe it will have only time sharing access split with the other projects.
- godelski 3y agoNot really a datacenter, it is a supercomputer. And yes, it is important to keep in mind that there aren't just single users. But with almost 64k nodes it isn't unreasonable for multiple teams to get 10k+ nodes at a time. I've seen runs on Summit use >50% capacity. Let's be clear, the teams aren't just going to start off using all the nodes at once. You step up.
- ftxbro 3y ago> Not really a datacenter, it is a supercomputer. ok but when openai made one it was called a datacenter