3 ms·
How to Highlight Duplicates in Google Sheets with Flookup
In the 10+ years that I have been a Data Analyst, I have never come across any dataset that is free of irregularities e.g. spelling variations. These can be very frustrating to anyone who is trying to clean their dataset in a reasonable amount of time.
There is a principle that I recently learnt about: It is called the 1-10-100 principle and it states that you will spend $1 to verify the quality of your dataset, $10 to clean each item in it and $100 to store each item that is not cleaned.
With this in mind, the task of having to manually work through the aforementioned irregularities become more than just a frustrating task; it becomes very expensive!
To help our clients combat this, we decided to introduce the power of fuzzy matching to the task of highlighting duplicates. Unlike most tools online, Flookup can work through the dirty data and shave off many hours from your workweek.
When we "tasted our own medicine", we reduced our task time from a week to 30 minutes and, ever since we released Flookup publicly, many users have reported experiencing the same benefits.
HOW WE DO IT:
Flookup is a Google Sheets add-on/toolkit for data cleaning by using advanced fuzzy matching and lookup techniques.
It can be used to highlight duplicates in 2 modes: by percentage similarity and by sound similarity.
The former calculates the percentage similarity between text in the dataset and then highlights those that satisfy the parameters set by the user. The latter uses the SOUNDEX algorithm to determine which text is similar.
HOW TO HIGHLIGHT DUPLICATES BY PERCENTAGE SIMILARITY: https://www.getflookup.com/documentation#h.p_ISj-lgqVN94u
HOW TO HIGHLIGHT DUPLICATES BY SOUND SIMILARITY: https://www.getflookup.com/documentation#h.p_jWhuAaUhYZSk
Highlighting duplicates this way is much better than assuming that the dataset will be kind to you or your business. I invite you install Flookup today and try it for yourself; you will not be disappointed.