4 ms·
What's cool is that it's now possible to use large language models to predict the probability of a given word, which doesn't only take into account the probabil
by isaacimagine 5y ago
What's cool is that it's now possible to use large language models to predict the probability of a given word, which doesn't only take into account the probability of a word appearing in a corpus, but also the probability in the context of the exact sentence you're writing. This makes the spell checker more robust, and even able to correct small grammatical errors. There's a lot of interesting research on how people tend to misspell words, and even more research on how to correct based on these patterns. Interesting read, this subjet is—on the whole—very fun to dive into.
- Gigachad 5y agoThis would be a massive improvement. It’s frustrating when an extremely obscure word is the same as a common misspelling but spell check is no use since technically it is a word.
- mromanuk 5y agoI would love to do that for an iOS keyboard, without a backend. I've built my own spell corrector going though the rabbit hole of tries and many other structures. iOS keyboards are constrained to 40Mb of RAM, I presume it's still too big to use a language model without a backend. Would be really cool to finally achieve a smarter prediction in-device, though.