2 ms·
To be fair the theory behind it is old. Only that hardware wasn't up to the task yet. For example here's language prediction from 1991 https://onlinelibrary.wil
by gammalost 3y ago
To be fair the theory behind it is old. Only that hardware wasn't up to the task yet. For example here's language prediction from 1991 https://onlinelibrary.wiley.com/doi/pdf/10.1207/s15516709cog1503_2 https://onlinelibrary.wiley.com/doi/pdf/10.1207/s15516709cog....
- cubefox 3y agoThat's not true. Modern language models use modern theory, such as the transformer architecture.