9 ms·
You know that's a good point that I didn't consider in my comment. LLMs use 16bit floats, which is approximately the same number of values. But then you get in
by crowbahr 3y ago
You know that's a good point that I didn't consider in my comment. LLMs use 16bit floats, which is approximately the same number of values.
But then you get into the nuance of spiking vs non spiking neurons etc, which to my knowledge isn't emulated. The brain is extremely complex. I don't believe LLMs do anything similar to inhibitor neuronal function for example.