3 ms·

Zagat?

ghaff 11y ago
Zagat is (still) pretty decent if you're interested in restaurants in one of the metropolitan areas that it covers and you're in their foddie-ish demographic. However, I don't think Zagat, which had a pretty long pre-Web history in what we now call crowdsourced restaurant reviews, offers a lot of insight for how we might do a small business review site today.
- CodeWriter23 11y ago
  The question didn't qualify "useful" as being crowdsourced or not. And that gets to my point, a review site that has its own reviewers is pretty much the only thing that is going to be useful. Otherwise the system will be gamed by vendetta seekers and the business itself. And I believe it is inevitable that a crowdsourced site will ultimately end up gaming the system to try to offset those effects.
  - ghaff 11y ago
    >pretty much the only thing that is going to be useful IMO that's an overstatement. I find Zagat, Yelp, and Amazon reviews all useful--however imperfect. That said, however unpopular this opinion may be in our crowdsourced world, professional reviews/ratings tend to be more reliable than random ones on the Internet. The problem is that professional reviews don't scale, especially for local businesses. The New York Times restaurant reviews aren't bad but that's NYC and, even in that case, a lot of the reviews are going to be quite old. So, in an ideal world, there might be armies of professional evaluators of hotels, restaurants, and other businesses--but that's not the world that we live in. (Films are one of the few areas where you can get a pretty good pool of professional and semi-professional reviewers.)
    - jacobr1 11y ago
      I think smart pay systems might help here. I'm not an avid reviewer - I just don't care enough for it to be worth my time. However, uber makes it part of the workflow. To get another ride I either need to make a rating or skip making a rating - so I make a rating. And it only takes one click. I suspect if Apple Pay or Google's equivalent had a similar process they would be able to generate some very sold scores for local businesses since they have both identify and proof of purchase.
      - ghaff 11y ago
        Yeah but with Uber, the expectation isn't that you're going to leave a nuanced review about the comfort of the car seat and the smoothness of the ride, but to basically leave 5 stars so long as there was nothing horribly wrong. Which is fine. It's more or less a commodity service. With restaurants, on the other hand, there is a wide range of quality. Even if the average shopping mall restaurant delivers a hot meal in a reasonable timeframe, I'm probably not going to give it 5 stars.
        arebop 11y ago
        If reports are to be believed, then clearly Uber expected that it would be 5 stars or nothing, and their low tolerance for 4 stars makes reality more consistent with that belief. But as a user from the early days, nothing in the app clued me into this expectation and accordingly I gave 3 stars for "meets expectations", 4 stars when I was offered refreshments and USB connections, 5 stars when I couldn't imagine a better ride... It's only lately and due to the prevailing rumor of Uber's mercilessness that I give 5 stars to meet "don't fire the driver on my account" and less than 5 stars to mean "I demand a refund and the head of the driver."
        ghaff 11y ago
        Back in the day when it was primarily an "Internet flea market", although it didn't use a star system, eBay was similar. Both sellers and buyers expected positive feedback accompanied with a comment like "A++++++++++ turned water into wine" so long as the reality wasn't "sent me a box full of bricks and axe murdered my extended family." Neutrals for a transaction that didn't quite go right even if issues were resolved were NOT appreciated.
  - mseebach 11y ago
    The bigger problem with crowdsourcing is that the reviews doesn't have a calibrated baseline. As a business traveller at 150+nights/year, my demands on a hotel are different from a leisure traveller's. Having a nightclub in the hotel is cool if you're going to that nightclub, but it's a special kind of hell to get back from a long day and have to fight your way through a nightclub line to get into your $600/night hotel (never mind having to deal with the noise from the nightclub). Another pet peeve of mine is to deal with clever/funky/cool "concepts", like that one time I tried to order a drink in a all-organic bar (according to the bartender things dry and bitter can't be sourced organically, so they only did sweet drinks). Trip Advisor (most relevant for hotels) and Yelp is supremely bad for surfacing the aspects I care about from the depths of things I don't. It's better with restaurants, as most people seem to agree to a much higher degree on the baseline.

Zagat?

ghaff 11y ago

Zagat is (still) pretty decent if you're interested in restaurants in one of the metropolitan areas that it covers and you're in their foddie-ish demographic. However, I don't think Zagat, which had a pretty long pre-Web history in what we now call crowdsourced restaurant reviews, offers a lot of insight for how we might do a small business review site today.

CodeWriter23 11y ago
The question didn't qualify "useful" as being crowdsourced or not. And that gets to my point, a review site that has its own reviewers is pretty much the only thing that is going to be useful. Otherwise the system will be gamed by vendetta seekers and the business itself. And I believe it is inevitable that a crowdsourced site will ultimately end up gaming the system to try to offset those effects.
- ghaff 11y ago
  >pretty much the only thing that is going to be useful IMO that's an overstatement. I find Zagat, Yelp, and Amazon reviews all useful--however imperfect. That said, however unpopular this opinion may be in our crowdsourced world, professional reviews/ratings tend to be more reliable than random ones on the Internet. The problem is that professional reviews don't scale, especially for local businesses. The New York Times restaurant reviews aren't bad but that's NYC and, even in that case, a lot of the reviews are going to be quite old. So, in an ideal world, there might be armies of professional evaluators of hotels, restaurants, and other businesses--but that's not the world that we live in. (Films are one of the few areas where you can get a pretty good pool of professional and semi-professional reviewers.)
  - jacobr1 11y ago
    I think smart pay systems might help here. I'm not an avid reviewer - I just don't care enough for it to be worth my time. However, uber makes it part of the workflow. To get another ride I either need to make a rating or skip making a rating - so I make a rating. And it only takes one click. I suspect if Apple Pay or Google's equivalent had a similar process they would be able to generate some very sold scores for local businesses since they have both identify and proof of purchase.
    - ghaff 11y ago
      Yeah but with Uber, the expectation isn't that you're going to leave a nuanced review about the comfort of the car seat and the smoothness of the ride, but to basically leave 5 stars so long as there was nothing horribly wrong. Which is fine. It's more or less a commodity service. With restaurants, on the other hand, there is a wide range of quality. Even if the average shopping mall restaurant delivers a hot meal in a reasonable timeframe, I'm probably not going to give it 5 stars.
      - arebop 11y ago
        If reports are to be believed, then clearly Uber expected that it would be 5 stars or nothing, and their low tolerance for 4 stars makes reality more consistent with that belief. But as a user from the early days, nothing in the app clued me into this expectation and accordingly I gave 3 stars for "meets expectations", 4 stars when I was offered refreshments and USB connections, 5 stars when I couldn't imagine a better ride... It's only lately and due to the prevailing rumor of Uber's mercilessness that I give 5 stars to meet "don't fire the driver on my account" and less than 5 stars to mean "I demand a refund and the head of the driver."
        ghaff 11y ago
        Back in the day when it was primarily an "Internet flea market", although it didn't use a star system, eBay was similar. Both sellers and buyers expected positive feedback accompanied with a comment like "A++++++++++ turned water into wine" so long as the reality wasn't "sent me a box full of bricks and axe murdered my extended family." Neutrals for a transaction that didn't quite go right even if issues were resolved were NOT appreciated.
- mseebach 11y ago
  The bigger problem with crowdsourcing is that the reviews doesn't have a calibrated baseline. As a business traveller at 150+nights/year, my demands on a hotel are different from a leisure traveller's. Having a nightclub in the hotel is cool if you're going to that nightclub, but it's a special kind of hell to get back from a long day and have to fight your way through a nightclub line to get into your $600/night hotel (never mind having to deal with the noise from the nightclub). Another pet peeve of mine is to deal with clever/funky/cool "concepts", like that one time I tried to order a drink in a all-organic bar (according to the bartender things dry and bitter can't be sourced organically, so they only did sweet drinks). Trip Advisor (most relevant for hotels) and Yelp is supremely bad for surfacing the aspects I care about from the depths of things I don't. It's better with restaurants, as most people seem to agree to a much higher degree on the baseline.