4 ms·
The largest models have 10 ^ 9 parameters? There is still a lot of "scaling" to be done if we want to reach 10 ^ 18 parameters, the number of synapses in the br
by andreyi 4y ago
The largest models have 10 ^ 9 parameters? There is still a lot of "scaling" to be done if we want to reach 10 ^ 18 parameters, the number of synapses in the brain.
- ausbah 4y agoif one FLOP is one parameter we do have the capacity with modern day supercomputers? bottleneck then probably becomes data unless overparameterization holds?