3 ms·
joins are one of the biggest causes of data quality and integrity issues in the data space.
by nojito 4y ago
joins are one of the biggest causes of data quality and integrity issues in the data space.
- VeninVidiaVicii 4y agoYeah maybe, but chaining a bunch of joins together when exploring some new data is a thing I do all the time. Then, 4-5 warnings push my results off the screen. It’s infuriating.
- naijaboiler 4y agoI avoid joins in R like a plague. Been burned. If I am working with a finite number of colummns, I just use base R match and add column by column. yes it breaks DRY but I don't get weird surprises. and I can re-run any section of the code at any time from any point without breaking things or joining the same and creating unintended duplicate columns
- LaserPineapple 4y agoWhat kind of weird surprises have you run into? Are they specific to R?
- victorbohr 4y agoTake a look at the powerjoin package. It let's you specify strict rules for your joins, for example requiring unique keys in the right-side table when doing a left join. It's got some other neat features as well.