4 ms·
No, that's precisely how it works. All of science is based on making assumptions.
by dekhn 9y ago
No, that's precisely how it works. All of science is based on making assumptions.
- xiphias 9y agoIf an assumption can give 2x difference, the whole study is flowed. He should extend the study to check the assumption itself.
- nopriorarrests 9y agoOK, let's imagine he we will re-run the study with optimistic assumptions and the result would be that Uber drivers are compensated lavishly (and if we take more moderate assumptions, they are making adequate money). And with another set of assumptions result was that they are serverly underpaid. So, exactly what we have learned here, other then different assumptions yield different results?
- Eridrus 9y agoWe learn that the outcome we care about is highly sensitive to the initial assumptions and we should get data on those assumptions.
- 1337biz 9y agoWe learn that there are no absolutes when using quantitative methods to measure human actions.
- twic 9y agoNothing. But learning that different assumptions yield different results is useful in its own right. It tells you that this study is not capable of answering the question it set out to answer, and you will need to do a better study. Perhaps you have come across interval arithmetic: https://en.wikipedia.org/wiki/Interval_arithmetic https://en.wikipedia.org/wiki/Interval_arithmetic
- deleted 9y ago[deleted]
- dekhn 9y agonot much, which is a big part of the problem.
- pdpi 9y agoIf the re-run concludes that even more optimistic assumptions still lead to underpaid drivers, though, that’s useful information. The key aspect here is the study’s author is willing to change his study based on criticism, to try and determine whether it still produces the same conclusions. That is precisely what science is about!
- stochastic_monk 9y agoBut should those assumptions really be based on angry tweets from someone with a colossal vested interest?
- makomk 9y agoUber's complaint was that he assumed that when the questionnaire asked about the hours per week people worked across all on-demand services, their answer only included the hours they worked driving for companies like Uber, but that for the next question about money earned across all on-demand services their answer was their total income and should be multiplied by the percentage of their total income that came from driving given in a later question to get their Uber income. Those assumptions are basically incompatible with each other. See https://medium.com/uber-under-the-hood/an-analysis-of-ceeprs-paper-on-the-economics-of-ride-hailing-1c8bfbf1081d https://medium.com/uber-under-the-hood/an-analysis-of-ceeprs...
- stochastic_monk 9y agoIt's quite clear that the survey was flawed. However, I'd rather consider all responses tainted and require re-surveying rather than trying to account for it post hoc.
- dekhn 9y agoIf somebody with a colossal vested interest makes an angry tweet that also happens to point out the study author made basic errors (that's what this is about: the author of the study likely made invalidating errors; no amount of changing assumptions is going to fix that).
- luispedrocoelho 9y agoThe reply in the uber blog is less "angry tweet" than "good peer review": it points to a very specific methodological weakness which has bearing on the final conclusions.
- subroutine 9y agoI can't tell if this is sarcasm. In case not, the scientific process is about gathering data to test the validity of hypotheses. Your phrasing makes it sound like science is mainly about spewing conjecture.
- dekhn 9y agoAssumptions are an essential part of science. Any modelling study (that's what this was) starts with a collection of assumptions (even true for ab initio simulations). Those assumptions are literally coded into the analysis. They should also be clearly stated in the analysis writeup.
- subroutine 9y agoCalling this 'a study' is a stretch. This seems more like pure analysis to me. No non-trivial assumptions are necessary to compute the average wage of Uber employees. In this case is was simply a calculation error.
- mannykannot 9y agoA hypothesis is a conjecture - we hope not a fanciful one, but a conjecture nevertheless.