4 ms·
Evolution has scaled the brain to hundreds of trillions of synapses (parameters) and hundreds of billions of neurons (processing nodes). Current models have aro
by red75prime 8mo ago
Evolution has scaled the brain to hundreds of trillions of synapses (parameters) and hundreds of billions of neurons (processing nodes). Current models have around 1/1000 of that number of parameters. The top data centers operate at around 1 exaflop (on par with the brain). Inference uses significantly less than that.
I’ll wait until the effective number of parameters in ML models is comparable to that of the brain. Then it will be clear whether the brain has something up its sleeve.