> The human brain isn't randomly initialized. It's undergone 500m years of pretraining. All of the information accumulated by evolution gets passed through DNA

> The human brain isn't randomly initialized. It's undergone 500m years of pretraining. All of the information accumulated by evolution gets passed through DNA. For humans, that's well under 1GB. Probably a very tiny fraction of that determines how the brain works at the algorithmic level. You should think of this information as the "software" of the brain, not pretrained LLM weights (350GB for GPT-3).