2 ms·
Why can't Amazon or Yelp, etc. weigh the trustworthiness of their reviewers? Newcomers low till proven otherwise, long-time reviewers who prove trustworthy hig
by mc32 11y ago
Why can't Amazon or Yelp, etc. weigh the trustworthiness of their reviewers? Newcomers low till proven otherwise, long-time reviewers who prove trustworthy higher. Trust low reviews more than high reviews, except for trustworthy reviewers. Punish reviewers with lower weight when they break the trust.
How to know what's trustworthy? That's more difficult to establish, but someone like an Amazon has the capacity to build something like this. So would Yelp and they both have incentives to make the reviews published on their platforms believable -else we'll all believe it's just spammy astroturfing.
- davmre 11y agoI'm sure they do this to some extent, but I'd guess that prolific users are rare, and the vast majority of reviews are written by users who have only written a small number of other reviews. So the danger is that downweighting or hiding reviews from newcomers might mean throwing away the vast majority of your data, and also discouraging new users from contributing.
- mc32 11y agoThey could possibly incentivize (honest) reviewers or new reviewers with a next day prime upgrades on a future purchase, for example. Still, a few honest reviews are better than a flood of unbelievable reviews because at that point it's as if there were zero reviews. Moreover, it's my understanding most of the astroturfing is from "bought" reviews. They ought have a way to detect that (accurately), or at least give them suspicion.
- digisth 11y agoIt's not as easy as it seems. Many systems have already been devised, but fake reviewers adapt; it's an arms race, just like with email spam. Bing Liu, who has done work on sentiment analysis, has written about some techniques dealing with spam/fakes on review sites. Here's just a sampling of popular methods and flags: - Duplicate checking (same user on different products with similar reviews, for example) - Meta-reviews ("was this review helpful?" - can also be gamed) - user rating averages (all highs or all lows sometimes considered a flag) - ratio of "first product reviews" to total reviews on a per-product basis - "Super-reviewer" status (questionable, but often a flag) - Products with low sales ranks - Review ring detection (IP block, post times, etc.) - Early reviews - Users who give high ranks, while most other reviews are low - Positive reviews for one brand's products, and negative for others - "Verified" purchases A lot of these already have countermeasures, and fake reviews have already come up with counter-counter measures (like review-time staggering, using multiple IP blocks, shipping empty boxes to defeat verified purchases, etc.) The "how to know what's trustworthy?" is the million dollar question, and it has many answers that happen to change over time. Not easy to solve.
- mc32 11y agoThanks for the rundown, that's pretty thorough. Could they add a kind of 2FA when they ship product to the customer? Understandably, this would drive down the rate of buyers posting reviews, but could minimize astroturfing rings. In your confirmation email you get a link which can only be used to review that product, if product is subsequently returned, then weigh review less, specially if positive, if too many products are returned, remove reviews for those products.
- digisth 11y agoI'm not aware of any efforts in that direction. As far as the review link, I don't think that would defeat the newer countermeasure involving 3rd party sellers shipping an empty box (which never gets returned.) It still looks like a verified purchase. Second-parties could require all items be shipped through them (meaning they receive the item and inspect it, then reship it to the customer), but the added expense seems like something they'd be unlikely to spring for.