3 ms·
I think the point is that Sam Altman the CEO of OpenAI has been in Japan visiting the prime minister and looking for collaboration opportunities. The Fugaku sup
by ftxbro 4y ago
I think the point is that Sam Altman the CEO of OpenAI has been in Japan visiting the prime minister and looking for collaboration opportunities. The Fugaku supercomputer is the flagship public supercomputer in Japan, so it's interesting to see how long it would take it to train GPT-4. According to that article it looks like it's on the order of 10x slower (as opposed to equally fast or like 100x slower).
To me the most interesting thing is that they seem to be revealing (or assuming?) that GPT-4 costs 10x the computer power of GPT-3.5. I'm not sure that was public information before. Maybe it wasn't.
- MichaelZuo 4y agoIt still doesn't seem clear what the comparison is for. Unless someone in Japan didn't believe that OpenAI/Micrsoft had access to 100x the FP16 compute that Fugaku can perform?