4 ms·
Not really, there are clearly epigenetic changes to neuron DNA w/r to memory formation and I don't think anyone has estimated what kind of computational firepow
by varelse 11y ago
Not really, there are clearly epigenetic changes to neuron DNA w/r to memory formation and I don't think anyone has estimated what kind of computational firepower that represents.
Second, the 3D topology of a neuron is IMO more complex than reducing it to an FP32 activation threshold (all IMO of course).
Finally, I have to admit as a former biologist, I'm intrigued by microtubule activity and it seems like Dileep George and even Geoffrey Hinton are heading towards smarter but fewer neurons as opposed to just increasing the neuron count. Not surprisingly, the deep learning digerati are resisting this notion mightily just like the SVM peeps harped on neural networks until they kicked them in the keester.
TLDR: It's still early, and I'm biased that there are some interesting twists and turns yet to unfold here.
- deleted 11y ago[deleted]
- alextgordon 11y agoAlso, brain chemistry. You can't give psychoactive drugs to a circuit board...
- zaroth 11y agoI'll bet in a matter of time we will find that indeed you can give something quite analogous to "psychoactive drugs" to a strong AI!
- antocv 11y agoTurbo button suddenly has a real meaning.
- Lambdanaut 11y agoI've done some thinking on this. If you can computationally define how different common neurotransmitters affect the function of neurons at a broad, high level, then you can create your "psychoactive drug" by just writing a routine that excessively applies the function that those neurotransmitters represent. An artificial serotonin reuptake inhibitor would just allow the serotonin-like activity to more active in the model.
- tim333 11y agoThe parameter Karpathy call 'temperature' seems not dissimilar in effect to a psychoactive drug, low temperature corresponding roughly to sober and high to being a bit, well, high.