7 ms·
I saw my girlfriend rate our driver 3/5 stars for a ride that was perfect. When I asked her what problem she had with the driver to rate him so low, she said "h
by hombre_fatal 7y ago
I saw my girlfriend rate our driver 3/5 stars for a ride that was perfect. When I asked her what problem she had with the driver to rate him so low, she said "huh? it was just an average ride, nothing special."
I think of this whenever people suggest that a star rating system is ideal.
- Nition 7y agoThat's how you'd rate a film. 3 stars for something that's fine, five for something that blows you away. Plenty of people see 3 stars = Average, 5 = Amazing, but companies have decided that 3 = Bad, 5 = Acceptable.
- tlogan 7y agoPlenty of people see 1 star = not free, 5 = free
- incompatible 7y ago> companies have decided that 3 = Bad, 5 = Acceptable. Does Uber actually give instructions on how to rate? Does it say a normal, acceptable trip should be 3 or 5? What would a really great trip be anyway, perhaps if the driver says "hey, I just won a lottery and I'm celebrating with my passengers, take $10k", or perhaps something sex related? Once Uber kicks out all the below-average passengers / drivers, will they take into account that the average will be pushed up for those remaining, so they will need to do further rounds of kicking?
- goerz 7y agoThey do give pretty clear instructions, and say that a ride that didn’t have any problems should be rated 5 stars.
- orloffm 7y agoYes, 3 stars is "disappointing", for example.
- incompatible 7y agoIn that case, I'm unclear why the prior-mentioned girlfriend selected the "disappointing" option. I can't check myself, I've never used Uber. I've been unable to sign up due to some problem where my "email address is already registered", which apparently can't be fixed. I could just use a different email, but I don't really want to deal with a company that has such issues.
- Slartie 7y agoIn my perception that wasn't the idea of any company, but companies just decided to adapt to how the majority of users use the 5-star rating system: basically like a one-star-system, where 5 means "all ok" (1 star), and 1 star means "crap" (0 stars), and in between there's a wasteland nobody uses anyway. I think it started to go wrong on eBay back in 2000. People gave any seller overly enthusiastic comments on any sale that somehow made its way to their door, as if that was something special and totally unexpected. And the sellers gave best ratings to buyers in return. Soon, both expected the other to provide a perfect rating for any transaction.
- CM30 7y agoWonder if it started before that to be honest. It's pretty common knowledge that game reviews have ridiculously inflated scores for example, with anything lower than 70% being seen as bad and people not bothering with anything under 80-90% when choosing what to buy. So perhaps the average for a review score/rating has just steadily crept upwards over time, til the scale collapsed into a two choice system with 'bad' and 'great' being the only options.
- Fnoord 7y agoYes, gaming scores were inflated indeed. This gaming magazine from the 90s called Hoog Spel [1] never gave ratings to games. Instead they gave a summary of plus and minus points. Such a summary takes slightly more time to read (but not a lot) and gives the reader a good idea on the positive and negative sides of the story. [1] https://en.wikipedia.org/wiki/Hoog_Spel https://en.wikipedia.org/wiki/Hoog_Spel
- nearbuy 7y agoCoincidentally, the inflated subjective scores from game reviews tends to match the percentage of players that rate a game as "recommended" on Steam. The median rating on Steam is about 80% positive (meaning 80% of players who rated it would recommend it). A game with a 70% Steam rating tends to be mediocre. It's interesting that even though a rating system where you choose between "recommended" and "not recommended" is much less subjective than trying to rate a game on a scale from 0-100, in aggregate, you get similar scores.
- Rapzid 7y agoMay harken back to the adoption of net promoter scores. Back then so many companies were giving such terrible service that "average" was bad. So then every interaction needed a 10 out of 10 so you could secure those promoters. So many people came up working at companies where anything below a 9 or 10 reflected bad on their work it doesn't surprise me that max scores became the new norm. You don't want to get any fired, do you?
- Scoundreller 7y agoUgh, I’d hate to have this kind of system when providing internal support. I like saying things like “The reason why your account isn’t letting you do anything is because you haven’t completed your mandatory training”, without having to spend too much time sugar coating it.
- xyphoid 7y agoNPS is so horrid. I get ticket responses sometimes with sig lines explaining that anything not a 9/10 in the survey counts as bad for them, and it's so embarassing for the organisation that they have to do this.
- polishTar 7y agoI imagine this is fairly common actually. If it is, it's not difficult to introduce a system to deal with it (and they may already have such a system). All it'd need to do is normalize ratings or at least reduce the weight of negative ratings if the rater always gives negative ratings.
- Redoubts 7y agoI think they have. For anything that wasn't 5* , you're asked to pick an aspect that sucked to justify it. I think that helps avoid 3* / 4* is "normal" problem. At least for me it did.
- benatkin 7y agoHaving 3 or 4 stars be normal isn't a problem though. The expectation that 4.6 is normal is a problem that AirBnb, Uber, and more and more companies now are creating. They show 5* ratings on the app to people who just signed up for apps. The average rating should be much lower than 5* in order to not mislead unsuspecting users. I don't expect it to be 3, but a 4 should be considered a good rating, and if it isn't, the app is engaging in false advertising. (Yes, I recognize that my cutoff is arbitrary, but 5 stars is supposed to mean excellent, and it has for time immemorial.)
- im3w1l 7y agoI wouldn't be surprised if a desired outcome of ubers rating system is to manipulate people into thinking of the rides as excellent by forcing 5's.
- Slartie 7y agoThey should ask people for justification on 5 star ratings as well, like "What was the absolutely exceptional, one-of-a-kind aspect in this ride?". Because if 5 stars means "everything's normal" and it is the maximum, what do you do to express the deviation from normal into the positive direction?
- 7y ago
- unreal37 7y agoTell your girlfriend that Uber drivers might lose their job if they drop to a 4.6 star average. 3 seems savage for a good ride. "If your rating over the most recent 100 trips is below a 4.6, your profile may be at risk of deactivation."
- cowwithbeef 7y agoHis girlfriend is trying to make the system useful for communicating both great and terrible service while everyone else has gamed it down to a reporting mechanism. His girlfriend is right and everyone else is wrong.
- p1necone 7y agoThe drivers income depends on their star rating remaining high. I don't see how it's "right" to jeopardize this.
- JohnFen 7y agoIt is "right" to provide an honest rating. What you seem to be saying is that it is the rider's duty to provide dishonest ratings.
- EpicEng 7y agoWell I hope giving that 3 makes you feel really good about yourself when the guy did his job and you're just hurting him for it. You know how they are judged and you do it anyway out of some misguided notion of what the rating system _should_ be and an insatiable urge to always be "right". It makes you a jerk, nothing more really.
- JohnFen 7y ago> Well I hope giving that 3 makes you feel really good about yourself when the guy did his job and you're just hurting him for it. Since I had no idea that 3 stars was a bad rating that hurt drivers until I read the comments here, I think that your condescension is very misplaced.
- gagege 7y agoI've never taken an Uber, but that's probably how I also would rate a good, but not exceptional, ride. Just like how I rate movies. So yeah, a star rating for this seems like a bad idea.
- Meekro 7y agoThe typical Uber driver will serve thousands of passengers. People like your girlfriend drag down every driver's average, but they don't explain why one driver has a 4.8 and another has a 3.5.
- p1necone 7y agoOn the other hand I rate every single driver 5/5 almost without fail, even if they were rude. I figure if their livelihood relies on it then I'd be an asshole if I didn't metagame the system.
- throwaway66666 7y agoI do the same, unless I feel my life is in danger (reckless driving). Why punish someone who might be working for less than minimum wage?
- dragonwriter 7y agoYou aren't metagaming the system, you are being gamed by the system. Uber isn't as concerned that all the drivers are polite, but they do want them all to have near 5-star ratings, so if anything goes badly they can say “Hey, he had great reviews from riders up to that point”. If they guilt you into rating 5-stars for rude service, mission accomplished.
- cmg 7y agoI don't drive Uber, but on Lyft if a driver or passenger gives a 3-star or below rating it's considered such a poor ride that they won't be matched up again. Far from "average."
- JohnFen 7y agoThat genuinely surprises me. I really would have thought 3 stars means "it was fine". This issue would actually make me think twice about using Uber or Lyft. Is it OK not to rate a driver at all?
- rsl7 7y agoIt genuinely surprises me that you expect more from a ride than getting there.
- JohnFen 7y agoWhat makes you think that I expect more than that?
- cmg 7y agoAs of late 2018, if you don't rate your Lyft driver we automatically get a 5-star rating for that ride. That further emphasizes how crucial keeping a high rating to Lyft for the driver.
- deleted 7y ago[deleted]
- JohnFen 7y agoI'm more in line with your girlfriend -- if the majority of ratings I'm giving out aren't 3 stars (on a 5 star system), then I'm doing it wrong. 3 means average, after all. And I agree with you -- this sort of disparity is why ranking systems like that aren't terribly useful. Take Amazon, for instance. People there seem to weight their ratings according to price, so something that is cheap and mediocre can get 4 or 5 stars. All of this sort of nonsense taught me to ignore ratings.
- smogcutter 7y agoThe problem when it comes to uber/lyft in particular is that as the customer you're never really comparison shopping scores the way you can on amazon, yelp, etc. The audience for the scores is Uber itself, not other customers. So the real question isn't "how was the ride", it's "do I want to fuck with this person's livelihood." If the answer is no, there's no reason not to give 5 stars.
- JohnFen 7y ago> So the real question isn't "how was the ride", it's "do I want to fuck with this person's livelihood." If the answer is no, there's no reason not to give 5 stars. If that's the actual game that Uber & Lyft expect people to be playing (as it appears that it is), then screw that. I'm not going to be using the services at all.
- Spivak 7y agoThis seems like a generational thing but I have never met someone my age or younger that thinks that 3/5 or a 'C' is average. How people like me give ratings. 5/5 - No problems 4/5 - Minor problems 3/5 - Major problems satisfied 2/5 - Major problems unsatisfied 1/5 - Horrible How average ratings are interpreted: 4-5: Excellent 3.5-4: Okay <3.5:Terrible This pretty much mirrors how my grades were given in school. But how I actually give ratings is 5/5 regardless of problems as long as the service was delivered and 4/5 if not because I have anxiety. I couldn't bare to get a bad rating at my job after a mistake so I don't do it to others.
- 7y ago
- sucrose 7y agoI never thought of it that way. I always think of it like the A thru F grading scale back in high school. But from your girlfriends perspective, nobody gets a 5 unless they went out of their way to make the ride special. I actually like that much better.
- dual_basis 7y ago1. The grading system in school is supposed to / used to be very similar, in that a C was actually average and very few people got As. 2. I don't want the driver to do anything "special", and I can't even imagine what that would be. Balloons? Played my favorite song on the radio? Just get me from here to there, I'm looking for transportation not an "experience".
- tuesdayrain 7y agoThe thought of only special, out of the ordinary rides getting a 5/5 is amusing to me. That's absolutely not the culture I want to experience as a rider. Even above-average levels of conversation can be distracting when I just want to quietly think about what I'll be doing at my destination. My ratings are basically either 5/5 or 1/5.
- leetcrew 7y agoregarding 2), it's certainly fine if all you want is a ride from A to B, but there are plenty of other things that meaningfully improve the ride for me. maybe the driver is actually familiar with the area and knows a faster or more pleasant route than the one google maps picks. maybe it's a long ride and you have a genuinely interesting conversation that helps pass the time. maybe it's a hot day and they have bottled water in a cooler. maybe they have a much more comfortable car than you expected. there should be room to acknowledge people that go above and beyond the requirements of their job without being punitive towards the people who do a fine but unremarkable job. I tip most drivers who don't completely fuck up the transportation part of the job, and I tip extra for really good rides, but I wish there were a way to recognize this in the ratings too.
- JohnFen 7y ago
- SilasX 7y agoUber could certainly be doing more to give an operational definition of what the stars mean. It's a difficult UX and communication problem, I'll grant. But I saw several unforced errors on their part, like (from memory) marketing copy about "Uber only allows exceptional drivers on our platform". Um, no dude. That sounds nice, but it doesn't lead to usable ratings.
- JohnFen 7y ago> It's a difficult UX and communication problem, I'll grant Is it? It seems to me that they could just use imoji-like images instead of stars, ranging from Angry for the lowest rating to Ecstatic for the highest. The 3 star position would be neutral.
- SilasX 7y agoYes, it is, because of wide variation in what experience someone will associate with and expect for a given face.
- bobjr 7y agoThis is slightly detrimental to the driver. Anything less than 5-stars is basically negative. I’ve had a perfect 5.0 rating over 500 rides but would occasionally get lower ratings or 1-star for reasons I didn’t know. Bad smell outside comes through the vent? May a strong short stop in ridiculous traffic? The ratings were meaningless to me, there’s no actionable result you can make. It just tormented me with some anonymous, ambiguous criticism of a already super stressful job that paid $20/hour.
- Scoundreller 7y agoIdeally it looks at the delta from the average scores that you awarded when determining de-activations.
- munk-a 7y agoI feel like that's giving Uber far too much credit.
- maire 7y agoI am surprised that nobody has mentioned the Netflix rating system which seems more accurate. Netflix scales the rating against your other ratings. If you always say 3 = OK then 5 = great. If you always say 5 = does not suck then 3 = sucks but not horrible. I don't even rate AirBNB hosts (for instance) because I know that a good enough host will be punished. I only rate the top and the bottom because those are the only two ratings that have meaning any more.
- Karunamon 7y agoThat would only work as long as they're not figuring null ratings into the score, which would still decrease the host's average. I'm not sure how it works for either company - is it (transactions/rating score) or (ratings/rating score)? Downthread, we learn that Lyft gives null ratings an automatic 5.
- deleted 7y ago[deleted]
- walterbell 7y agoTime to invent the bell curve..
- Pyxl101 7y agoNetflix switched to a thumbs up / thumbs down rating system in 2017: https://www.businessinsider.com/why-netflix-replaced-its-5-star-rating-system-2017-4 https://www.businessinsider.com/why-netflix-replaced-its-5-s...
- kerbalspacepro 7y agoPeople got very mad at this, but it seems preferable. Movies/TV shows that you "like a lot" versus movies that you "just like" are both movies that you'd watch, and watching is what you're buying.
- advarckcal 7y agoNot getting enough ratings also causes punishment.
- JCharante 7y agoI really like grab for this reason. I have a friend who will think an Uber driver should get a 3/5 stars for a ride that was perfect fine. If you give a non-perfect rating in grab, it asks for a specific reason why, giving you a dialog with common reasons why. If you give a low enough rating, grab will reach out to you to understand what happened during the ride and to try to make things right.