2 ms·
How long did this take? Did you consider something like openrefine or fuzzy matching / levenshtein distance? Seems like a common data cleaning ask with a smal
by djoldman 4y ago
How long did this take?
Did you consider something like openrefine or fuzzy matching / levenshtein distance?
Seems like a common data cleaning ask with a small amount of data.
- vimota 4y agoI played around with that and pgtrgm (https://www.postgresql.org/docs/current/pgtrgm.html https://www.postgresql.org/docs/current/pgtrgm.html) a bit but unfortunately didn't have great results. I did do a bunch of manual data cleaning though, and also had some overriding logic if certain keywords match it would avoid semantic search and default to a result (for common ones).