3 ms·
We dont understand LLMs but we certainly understand matrix multiplication.
by aydyn 4y ago
We dont understand LLMs but we certainly understand matrix multiplication.
- wongarsu 4y agoWe also have a good idea of how individual neurons work, but struggle a lot with understanding brains. Both LLMs and human brains have a lot of emergent behavior, which is why our understanding the low-level primitives only provides very limited insight.
- deleted 4y ago[deleted]
- pfdietz 4y agoWe still don't have a good lower bound on the complexity of matrix multiplication.