2 ms·
Sure, if by unobservable you mean in the same way that we can't truly "observe" the population average height of humans, even if we can probably get a pretty da
by whimsicalism 4y ago
Sure, if by unobservable you mean in the same way that we can't truly "observe" the population average height of humans, even if we can probably get a pretty darn good estimate.
You can observe the results of the experiment and then make statistical inference about the "true" incrementality. You don't even have to perform inference necessarily, you can just provide the direct results of your experiment to the advertiser and let them do the inference.
But I do fail to see how a third-party could possibly infer this measure, given that they have no capacity to do a true incrementality experiment on the platform.
- TeMPOraL 4y agoAre you running the incrementality study, or is your provider (e.g. Google)? Because one of the points here is that providers also have an incentive to fudge the numbers - they're not in business of being accurate, they're in business of making it seem their services help you. To riff off the average height example - you can get a pretty darn good estimate based on sampling and good statistical practice... unless the people doing the sampling have a reason to bias the measurement, or - if you're sampling on your own - people who control where you go and who you meet...
- whimsicalism 4y agoOh that could definitely be the case, although I'll note that the larger actors have more to lose and are at more risk of being caught for engaging in fraud. I think my usage of "you" was confusing because I work in sell-side advertising.
- tomrod 4y agoYou nailed this. Tirole discusses this in his paper hierarchy on bueracracies. Your internal stakeholders aren't always aligned to the company, sometimes it is to a vendor.