4 ms·
> it will be something that is not an LLM I think it will be very similar in architecture. Artificial neural networks already are approximating how neurons in
by Sohcahtoa82 2y ago
> it will be something that is not an LLM
I think it will be very similar in architecture.
Artificial neural networks already are approximating how neurons in a brain work, it's just at a scale that's several orders of magnitude smaller.
Our limiting factor for reaching brain-like intelligence via ANN is probably more of a hardware limitation. We would need over 100 TB to store the weights for the neurons, not to mention the ridiculous amount of compute to run it.
- codedokode 2y ago> not to mention the ridiculous amount of compute to run it. How does the brain computes the weights then? Or maybe your assumption than brain is equivalent to a mathematical NN is wrong?
- yahoozoo 2y agoHow much compute do you think the human brain uses? They're training these LLMs with (hundreds of) thousands of GPUs.