3 ms·
I do not know with what hardware GPT-5 will be trained, but GPT-6 will be trained on something with similar levels of efficiency as an OPU (and probably distrib
by pizza 4y ago
I do not know with what hardware GPT-5 will be trained, but GPT-6 will be trained on something with similar levels of efficiency as an OPU (and probably distributable via consumer-accessible hardware)
- p1esk 4y agoGPT-5 level models could very well be distributed, training on millions of internet connected iphones. This is all pure speculation, we don't even know know what GPT-4 will look like.
- visarga 4y agoDistributed training is inefficient ATM.
- optimalsolver 4y agoAnd GPT-7 will be built with sticks and stones.
- yetihehe 4y agoWith rod logic machines from Diamond Age.
- ben_w 4y agoIf the time between successive GPT releases halves after each successive release, we'll have to do what Bungie did with the third game in the Marathon trilogy and call it GPT-∞. And then the post-singularity open source release, GPT-ℵ₁