4 ms·
Transformers != Modern LLMs. It is 100% an important invention, but other important tech like hidden markov chains existed long before.
by jsemrau 2y ago
Transformers != Modern LLMs.
It is 100% an important invention, but other important tech like hidden markov chains existed long before.
- woodson 2y agoWell, strictly speaking modern LLMs are transformers (not counting state space models like Mamba, for the moment). Not sure what hidden Markov chains have to do with modern LLMs.