2 ms·
>If GPT-4 has 100 trillion parameters It doesn't. >Synapses are a lot simpler than parameters Not true but someone else has explained why. >a 100 trillion p
by famouswaffles 3y ago
>If GPT-4 has 100 trillion parameters
It doesn't.
>Synapses are a lot simpler than parameters
Not true but someone else has explained why.
>a 100 trillion parameter model is unambiguously larger than the language processing portions of the human brain.
GPT-4 is not that big. The technology to run such a model at scale is simply not feasible yet.
>The human genome is 24 gigabits long. It's negligibly small compared to a language model.
I'm sorry bit this makes no sense. How many gigabits long the genome is has no bearing on how impactful it is in steering the development of the human brain in comparison to a ML model.