2 ms·
> If you think you're "starting from scratch", you really aren't. Our genomes have ~600MB, so where are you claiming that humans transmit millions of years of
by marcosdumay 3y ago
> If you think you're "starting from scratch", you really aren't.
Our genomes have ~600MB, so where are you claiming that humans transmit millions of years of language optimization between generations?
- zo1 3y agoYou could store a pretty gigantic graph using 600MB. They're not saying we store the weights, they're saying that we store the "architecture" that you overlay the weights on with training.
- lukeschlather 3y agoThat 600MB is the result of millions of years of optimization. For every human genome that exists today there are many other genomes which were tried and discarded over the years. It also contains a remarkable amount of compression. Even if you assume that a genome contains a complete template for a human (it likely doesn't) the fact that the compressed version is 600MB doesn't really relate to the unpacked amount of information. Especially since the compression has seen millions of years of optimization.