3 ms·
I’m assuming you are asking if the brain uses transformer-like structures or otherwise exhibits similar behavior. I don’t know, but it does share some processes
by willy_k 3y ago
I’m assuming you are asking if the brain uses transformer-like structures or otherwise exhibits similar behavior. I don’t know, but it does share some processes with simpler ML ideas, and I’d be very interested to see if it uses anything resembling a transformer.
- patcon 3y agoForward-forward algorithm is more like the brain. As I understand, backpropagation transformers require storing data, doing calculations on that aggregate, and sending it back through, which no neural structures can do anything like. https://medium.com/@Mosbeh_Barhoumi/forward-forward-algorithm-ac24d0d9ffd https://medium.com/@Mosbeh_Barhoumi/forward-forward-algorith...