4 ms·
> The cost of computing decreases over time. No one will pay $100 Billion to train GPT-6. That is absurd. The current top supercomputer in the world (Frontier)
by anko 3y ago
> The cost of computing decreases over time. No one will pay $100 Billion to train GPT-6. That is absurd. The current top supercomputer in the world (Frontier) cost $600M.
Just wanted to ask the question - do you think frontier has provided more or less value to the world than gpt-4?
- xcv123 3y agoGPT-4 is not a piece of hardware. The comparison makes no sense. GPT-4 was enabled by hardware. The idea is that you use something like a Frontier to create something like a GPT-4. My point was about cost of computing. What kind of GPT can you train with a $600M computer?