4 ms·
> Unfortunately, it doesn't seem like the creators of sqlite are that interested in solving this problem since theoretically you can just use extensions to do w
by rogerbinns 3y ago
> Unfortunately, it doesn't seem like the creators of sqlite are that interested in solving this problem since theoretically you can just use extensions to do whatever you need.
Small. Fast. Reliable. Choose any three. :)
> sqlite FTS doesn't allow fuzzy searches where it returns the best ranked results even if they don't include all the input tokens
I'm busy updating my Python SQLite extension with full text search and this is one of things I'll be addressing. You can do a fuzzy search by having the query OR all tokens for the match, and then use a ranking function to figure out an appropriate score.
I'm also doing other things like query expansion (find statistically similar search terms), and other issues like spelling correction (playystation -> playstation), split tokens (noone -> no one), combining (play station -> playstation), larger tokens (one -> gone, phone, opponent).
- resoluteteeth 3y ago> I'm busy updating my Python SQLite extension with full text search and this is one of things I'll be addressing. You can do a fuzzy search by having the query OR all tokens for the match, and then use a ranking function to figure out an appropriate score. > I'm also doing other things like query expansion (find statistically similar search terms), and other issues like spelling correction (playystation -> playstation), split tokens (noone -> no one), combining (play station -> playstation), larger tokens (one -> gone, phone, opponent). That's nice but it just seems unfortunate that people have to keep reimplementing this stuff in different languages on top of sqlite