3 ms·
The 500b isn’t to retrain a model with same performance as R1, but something better and don’t forget inference. Those servers are not just serving/training LLMs
by m3kw9 2y ago
The 500b isn’t to retrain a model with same performance as R1, but something better and don’t forget inference. Those servers are not just serving/training LLMs, it training next gen video/voice/niche subject and it’s equivalent models like bio/mil/mec/material and serving them to hundreds of millions of people too. Most people saying “lol they did all this for 5mill when they are spending 500bill” just doesnt see anything beyond the next 2 months