17 ms·
There was a freakonomics podcast recently about advertising (online and traditional). No one can actually prove it has any ROI at all. No one is willing to run
by jedberg 6y ago
There was a freakonomics podcast recently about advertising (online and traditional).
No one can actually prove it has any ROI at all. No one is willing to run the experiments necessary. In the few cases of natural experiments, where ads got turned off for some people by accident, there was no change in buying behavior.
https://freakonomics.com/podcast/advertising-part-1/ https://freakonomics.com/podcast/advertising-part-1/
https://freakonomics.com/podcast/advertising-part-2/ https://freakonomics.com/podcast/advertising-part-2/
- deleted 6y ago[deleted]
- Ericson2314 6y agoYes, the advertising industry is just obfuscated basic income for the twitter class.
- jefftk 6y ago> No one can actually prove it has any ROI at all. No one is willing to run the experiments necessary. Depends enormously what sort of business you're in. I used to work for a company where all of our sales came from ads, 100%. It was trivially true that if we stopped advertising we would have no sales. We were also committed to running experiments: we knew how well all of our many advertising channels performed, and we ran A/B tests for every change.
- posedge 6y agoListening to the podcast just a minute ago as I found this post... What a coincidence. I second that recommendation.
- Ericson2314 6y agoGreat subject matter, but boy does reading the transcription remind me why I hate podcasts. Stop infantilizing the audience with these coo-coo-ing sounds bites and get to the damn point already!
- marcinzm 6y agoThese experiments are run all the time even before the internet. I remember reading about how for broad brand advertising they used to segment by city. Half the cities got an ad for Coca Cola and half didn't. Then you compare sales of Coca Cola. No one will publicly publish numbers because it's a mix of sensitive sales data and competitive advantage (ie: otherwise your competitors don't have to burn money running their own tests). Also, smaller shops turn their online advertising campaigns on and off all the time to test impact.
- otabdeveloper4 6y ago> No one can actually prove it has any ROI at all. That's a philosophical question of whether you consider statistics to be "proof". > No one is willing to run the experiments necessary. You're nuts if you think this is true. I assure you that companies in traditional industries (i.e., without venture capital) can and do run these experiments. The Uber story is about venture capital and its anti-market incentives, not about the ad industry.
- jedberg 6y agoRead the podcast transcript. An economist proposed turning off print ads in one market to find out if they mattered, and the head of marketing said he’d rather not know.
- aerosmile 6y agoOnly because the head of marketing realized it would expose his past misjudgments - not because he didn't realize it would actually be a good thing for the company. You'll see this type of behavior in every department - people trying to cover up their mistakes.
- SilasX 6y agoWait, so their marketers are unwilling to do anything that would reveal ad ineffectiveness, and you consider that an argument in favor of the claim that ads are effective (the topic at this point in the thread)? Like, you take that as a signal that marketers would converge on effective ads?
- aerosmile 6y agoMy point is that we have to differentiate between bad employees and the overall effectiveness of ads. The latter is all about incrementality. When you adjust for it, you get the true effectiveness of ads. In some instances, the incrementality will be significant, in others it won't. It looks like that in Uber's case, the incrementality was low. Btw, if you're not familiar with this term, please look it up - there's a ton of literature on it: https://www.adroll.com/blog/marketing-analytics/beginners-guide-to-incrementality https://www.adroll.com/blog/marketing-analytics/beginners-gu... Which brings me to the point about bad employees - marketers who are not adjusting their performance measurement based on incrementality should be fired (and it certainly looks like this was not being done at Uber at that time).
- guerby 6y ago"No one is willing to run the experiments necessary." Tesla is one natural experiment about not spending money on advertising in the mass media compared to traditional car companies that spend HUGE amount of money advertising. https://www.motorbiscuit.com/gm-spends-an-embarrassing-amount-of-money-on-advertising/ https://www.motorbiscuit.com/gm-spends-an-embarrassing-amoun... "Hyundai spent $4,006 per Genesis vehicle sold in 2018. Ford’s Lincoln brand came in second with $2,106 per vehicle sold. After Jaguar and Alfa Romeo, GM’s Cadillac brand came in fifth with $1,242 spent per vehicle sold. Tesla was the lowest at just $3 spent per vehicle sold."
- morelisp 6y agoTesla's marketing spend is whatever it costs them in legal fees and fines to keep the mouthy celebrity CEO - and their high-profile campaigns in 2018 seemed pretty effective.
- toast0 6y agoTelsa is in an enviable position of selling most of their cars before they're produced. In that position, you don't really need to advertise much. They also get a lot of PR to keep up brand awareness. If Hyundai couldn't keep Genesis vehicles on the dealer lots, they'd advertise them less too. Having a dealer network means dealers that want manufacturer support in advertising to keep dealers happy, even if the new cars sell themselves, dealers need to get people in to sell used cars.
- zamalek 6y ago> there was no change in buying behavior. I suspect that if our browser isn't blocking ads then our brain is. It's complete conjecture, but I assume that adblockers eliminate this cognitive load explaining a portion of why they became successful before they were necessary for security/malvertising.
- indymike 6y agoBeware extremes like "no one can actually prove". One difference between internet ads and their more ethereal tv and radio predecessors is that adviews, clicks and purchases can be tracked. Also, there are techniques that can make even TV, radio, print and even digital to physical world ad performance more visible: coupons, response codes and campaign-specific phone numbers and URLS. That Uber was buying hundreds of millions in ads and could not attribute performance (sales, for example) speaks more to poorly designed campaigns and potentially very bad actors in the supply chain.
- karaterobot 6y agoThere was a good piece of reportage on this subject last year: https://thecorrespondent.com/100/the-new-dot-com-bubble-is-here-its-called-online-advertising/13228924500-22d5fd24 https://thecorrespondent.com/100/the-new-dot-com-bubble-is-h...
- jazzdev 6y agoThis story was on the Freakonomics podcast too. It definitely seems like a bubble, but there's no external pressure to make the bubble pop. With the mortgage crisis, eventually, people can't make the mortgage payments and the bubble bursts. But with people happily spending money on ads that don't work, there's no external pressure to stop. Will this bubble ever burst?
- mgh2 6y agoBack in 2017, Uber sued Dentsu for ad fraud https://www.japantimes.co.jp/news/2017/09/19/business/corporate-business/uber-sues-dentsus-fetch-40-million-alleged-click-fraud-right-wing-news-site-breitbart/ https://www.japantimes.co.jp/news/2017/09/19/business/corpor...
- Wowfunhappy 6y agoI'm only about halfway through the first of the podcast episodes you linked (thanks!), but just thinking about this logically for a moment: I would not be shocked to learn that advertising for a specific product or event is not particularly effective. However, I'm inclined to believe it has a huge effect on overall brand recognition. Let's say you go to Amazon to buy a roll of toilet paper. How do you choose from the literally hundreds of options? You could spend a day of your life reading reviews, and trying to parse which ones are fake. Or you could buy the toilet paper from Scott because you recognize the brand. As I see it, buying brand advertising is a lot like buying an expensive suit. It's not that the suit makes you more productive, but it is a sign of professionalism, and—frankly—of wealth. If a brand is advertising everywhere, you know they aren't a fly-by-night company, and their products likely meet some standards of quality.
- dehrmann 6y agoThere's also the bit about luxury (mostly) car commercials. Half their purpose is to remind you that you made a good decision buying your <brand> car, and maybe your next car should be the same brand.
- mgh2 6y agoAdditional resource discussed in the past: https://news.ycombinator.com/item?id=21465873 https://news.ycombinator.com/item?id=21465873
- alibrarydweller 6y agoI'm a fan of the podcast but one argument they cited seemed to have a pretty glaring error - they looked at the case where eBay was comparing incremental gain on search ads over no ads. It's methodologically hairy because eBay is a very major player with significant brand recognition. "When Tadelis was working for eBay, the company was in the practice of buying brand-keyword ads. Which meant that if you did an online search for “eBay,” the top result — before all the organic-search results — was a paid ad for eBay." This doesn't show that advertising doesn't work per se, it shows that eBay didn't hire a competent ad buyer. Whether or not you can prove the efficacy of advertising as a whole, this is not a valid approach.
- megablast 6y agoYes of course they can. They can run trials in different areas, and see if there’s an increase in spend. They run tests all the time.
- tempsy 6y agoit’s funny how trillions of dollars in market cap are built on top of some service with unprovable and questionable value.
- legitster 6y agoI work in digital marketing and this episode made me want to tear my ears off. First of all, they didn't differentiate between display or PPC advertising. PPC you only pay if the user actually engaged with the ad. Nearly all of the anecdotes they used where about online display advertising - a known crock. And we absolutely run experiments all the time! In fact, we tie our ad spend directly to conversions. If anything, the market is too efficient - it's really hard to get more than what you are paying for.
- jedberg 6y agoBut the experiments you run pit one ad type or channel against another. Have you ever run any experiments comparing ads to no ads?
- xenospn 6y agoI have. When I run ads, I grow. When I stop running ads, I don’t.
- legitster 6y agoAbsolutely. You can give a campaign its own website or URL if you want to test something like the effect of a specific billboard or radio ad. Or you can do the equivalent of an excess mortality study but for client acquisition or product sales. You take something like the month of January and you say "this is what we expect for web traffic given our standard traffic for that month, and extrapolate it with your average web activity growth". And so long as you have "clean" months to compare it to (with no ads running), you can get a pretty decent back of envelope about what your ad campaign did. Like, there's so many different ways you can cut the apple, it's patently ridiculous they made those claims. To give them a bit of credit, there's something to be said for there being a lot of bad ad spending out there. But like the stock market, there's a tacit understanding that it's more or less efficient.
- masonic 6y agoPPC you only pay if the user actually engaged with the ad Who defines that "engagement" legitimately occurred? The ad network. Example: TVguide.com/listings. On most devices, I get a nondismissable audio ad when I'm looking at telecast schedules. I kill the audio immediately. I never experience the bulk of the ad, and even if I can identify the product being advertised, I'll form a strongly negative impression of them. I don't count this as "engagement", but it's charged as that.
- mgraczyk 6y agoThis is completely false. Large advertising platforms have many A/B tests that show significant differences in consumer behavior between groups that receive different ad treatments. Ads might be less efficient than some believe, but it's super easy to see that they "work", and advertising platforms do it constantly.
- spoonjim 6y agoThis is nonsense. I had a startup completely powered by Google Ads. Ads brought in nearly 100% of the traffic. When my billing information with Google got mixed up and the ads stopped, the traffic went to 0 immediately.
- Mountain_Skies 6y agoThough not an intentional test, we found out what happens when a movie gets a wide release but does not advertise. In 2008, the movie 'Delgo' was released on over 2000 screens with nearly no advertising. Because the production company could not find a distributor, they spent their ad money on renting the screens for a week, with the hope that some people would randomly see it and word of mouth would spread, leading to the theaters wanting to keep it for additional weeks. It became the lowest earning wide release movie up to that point in time. Each screening averaged two people per screening. More people saw Conan O'Brien making fun of the movie in his monologue than actually saw it in the theater. The reviews for the movie were poor but it had lots of household names as its voice talent, including Anne Bancroft in her final film. Good or bad, advertising likely would have lead to more people seeing it than two per screening. Of course there's no way to know for sure how many more would have been enticed by the ads but we do know that going with zero advertising resulted in a huge disaster.
- johnsoft 6y agoSo the movie was bad, and people didn't go see it? Doesn't seem related to advertising. Eminem released his last two albums without even announcing them. Word of mouth got them both to #1 on the charts. If you tried that same movie experiment with something like Avengers, I bet the results would look a lot closer to Kamikaze than Delgo.
- UpsilonAlpha 6y agoThese are not fair comparisons. Eminem and the Avengers have already established identities. Music cannot even compare to movies due to the sheer quantity of modern musicians. There are plenty of fantastic (IMO) bands out there that release music without advertising and they get nowhere. As for movies, Avengers got to where they are today through lots and lots of advertising.
- josefx 6y ago> It became the lowest earning wide release movie up to that point in time. Each screening averaged two people per screening. On the other hand it got displaced by Oogieloves which had $40 million in marketing costs. Critics found it mostly bad and the only award it won was for films produced in Brazil. Maybe there was a reason no one wanted to spend ad money on that movie?
- newbie2020 6y agoMaybe not for companies of uber’s size/current reach, but small businesses definitely do benefit from ads. They see an immediate uptick in sales when they start advertising on various platforms.
- zm262 6y agoAds are somewhat like propaganda. There's no proving it will work or not in short terms, but nobody can deny that persistent propaganda has a long-term effect on the whole population. You have think about a kid/youth who listens to some propaganda for years when growing up. If say you show an ad for a new Apple product. A small part of it is to inform consumers about it, the longer larger part is to enforce the Apple brand which has been happening over many years. You can't say well it is not quite working so let's stop doing Ads.
- m12k 6y agoThis article also sheds a lot of light on the whole issue of why people don't realize when digital ads don't work: https://thecorrespondent.com/100/the-new-dot-com-bubble-is-here-its-called-online-advertising/13228924500-22d5fd24 https://thecorrespondent.com/100/the-new-dot-com-bubble-is-h...
- mlthoughts2018 6y agoThis is really, really not true. Advertising lift has been well studied, especially in metastudies spanning hundreds of digital campaigns across Facebook and Google. These are independent academic metastudies, with hundreds of millions of impression data samples. Positive lift in the range of 0-20% is very common, and many statistical aspects of causal inference on ad impacts are well understood. Negative lift and flat campaigns are real phenomena too, and it does deserve more widespread publicity that negative lift happens in an appreciable number of campaigns, but that doesn’t take away from the overwhelming evidence that digital advertising works and that the mechanics of positive lift are well studied. Here are two of the foundational papers in this area: - https://www.kellogg.northwestern.edu/faculty/gordon_b/files/kellogg_fb_whitepaper.pdf https://www.kellogg.northwestern.edu/faculty/gordon_b/files/... - https://www8.gsb.columbia.edu/media/sites/media/files/Garrett%20Johnson%20paper.pdf https://www8.gsb.columbia.edu/media/sites/media/files/Garret... Particularly Figure 1 (page 26) in the second link. That figure alone utterly refutes any nonsense claim that digital advertising doesn’t have provably positive ROI.
- jedberg 6y agoDid you read the transcript the for episode and the associated links and notes? They back up their claims with studies of their own as well as metanalysis.
- Reebz 6y agoI did, and I think there's a lot of p-hacking going on. Leading with TV advertising is disingenuous at best. The ebay example twists the concept of user acquisition (new customers) and purchases (new or old customers). It is a common tactic to buy advertisements defensively, for example, if you're a product manager, and have determined that some of your user base are more transactional rather than frequent. Another pet peeve I have is how they conflate direct response advertising and marketing.
- mlthoughts2018 6y agoIt would seem their backing research and metastudy totally missed the boat and ignored well-known academic experts on the matter. I definitely trust the academic studies over an entertainment podcast.
- specialist 6y agoI get downvoted whenever I propose digital advertising bubble will pop once people wise up to the fraud.
- lern_too_spel 6y agoThe ad buyers aren't smart enough to measure the actual effectiveness of their ads, and the ad sellers are not incentivized to teach them how to do it. This can go on for an arbitrarily long time.
- choward 6y agoI think the next major recession is going to be triggered by this bubble popping.
- missedthecue 6y agoWhy would it cause a recession? Google and Facebook would report lower numbers, literally every other company on earth would save more money.
- specialist 6y agoIDK. It's a risk worth chewing on. eg If Google and Facebook tanked, bringing down the stock indexes and all the institutional investors, triggering a sell off... What would the knockon effects be? I don't know (no clue). The 2008-9 crisis largely happened when CDS stuff popped. Is there a similar house of cards on top of FAANG stocks or the digital ad market or...?
- missedthecue 6y ago2008 was bad because of excessive leverage. Top tech companies have little to no debt and there aren't any leveraged securities to do with ads.
- paulsutter 6y agoEcommerce sites have very fine grained measurement of their advertising spend and know exactly the ROI (which is why they focus so much on retargeting)
- handedness 6y ago> No one is willing to run the experiments necessary. This is incorrect.
- tnt128 6y agoDepending on what kind of advertising you are talking about. Direct response advertisers measure ads to the cents. And they know exactly what the ROI is and where the customer is coming from.
- OmarShehata 6y agoThey mention the common retort to this which is very bizarre to me: "If online ads don't work, then huge companies wouldn't spend billions of dollars on them. Therefore they must work. You academics are just missing something." Ok, how does those companies know it works? They don't have any real data to show that it does, just the fear that if they stop they'll lose a lot of business.
- manigandham 6y agoThey do have data. It's pretty easy to see sales without ads vs sales with ads and then do further testing to narrow down results from there. This has been done for over a century since the first billboards were put up. The amount of data generated by adtech today is staggering. The problem isn't data or advertising, it's the wrong people running the wrong campaigns for the wrong reasons.
- hammock 6y ago>No one can actually prove it has any ROI at all. No one is willing to run the experiments necessary. In the few cases of natural experiments, where ads got turned off for some people by accident, there was no change in buying behavior. This may be true but it's a separate issue than the fraudulent clicks. Brand advertisement (the kind you are talking about, as opposed to closed-loop direct advertising) is an investment in a brand, that doesn't get paid off in a day, or a week, or a month, or even a year. It adds fractions of a penny onto a customers value, every day from today into eternity. It's an investment in your mind, but the long time horizon makes it, as you point out, nigh impossible to measure ROI. However, this is one of those cases where despite being immeasurable, it still works. Imagine doing a study on low-fat or low-fat diets and trying to measure health outcomes like lifespan, or heart disease, or cancer after just one month. You can't do it. The best you can do is measure markers of these outcomes, like insulin resistance, blood triglycerides etc. Brand advertising is similar. You measure markers of long-term purchase intent. It's not perfect. And just like actually doing a long-term study of diet for example is riddled with confounding variables and very hard (nigh impossible) to do well, so it is with advertising.
- crakhamster01 6y ago> No one can actually prove it has any ROI at all. No one is willing to run the experiments necessary. This is entirely false. I work in adtech, and almost all companies run experiments in order to optimize their ad spend (everything from Ad A vs Ad B, to Ad vs No Ad, to Channel A vs Channel B, and more). This isn't to say that advertising always produces ROI. Quite often, experiments will be run that will show a certain strategy isn't performing well, and the company will adjust accordingly. It's incredibly naïve to think that companies are flushing half a trillion dollars a year down the toilet on advertising without any attempt to validate their investments.
- voxl 6y agoThat's great, thanks for your experience, but can't comment on the argument provided? Isn't it possible that these experiments you talk about are fatally flawed? I have serious doubts that a company can run and do well designed statistical experiments when academic experts are plagued by p-hacking and other foot guns.
- Spivak 6y agoThat’s kinda a weird take when there’s every incentive to be the the person/manager/director who saves tens to hundreds of millions of dollars in ad spend. Sure marketing people want to protect their jobs but the odds of “advertising is entirely worthless” being this closely guarded secret kept by millions of people in the industry or being a collective delusion is pretty darn low. The reward for defectors is just too high.
- skronch 6y agoIMO large social media platforms are actually much more capable of running these experiments than academics. (Disclaimer: I work on ads at one of these companies). Platforms can accurately determine who engaged with an ad (basic logging on their sites), they have infrastructure to create statistically balanced ad experiments, and can also accurately determine whether a conversion happened (either through a conversion pixel or through data brokers). Running these tests on behalf of advertising clients, or for internal research is fairly standard. If we couldn't prove statistically that our ads were working, I would have left a long time ago.
- xapata 6y ago> No one is willing Counter-example: I know of at least one consumer goods company that has studied the long-term effects of certain kinds of sponsorship deals on consumer behavior. The study had tracked people for at least 10 years at the time I learned of it. Of course, this company would never publish the results, because they provide a competitive advantage in structuring and bidding on sponsorship deals.
- srtjstjsj 6y agoYou are conflating value of the marginal ad with value of any ads at all.
- srtjstjsj 6y agoYou are conflating value of the marginal ad with value of any ads at all, and also exaggerating what those articles say One of them said tracking cookies only boosted conversion 4%, and another said P&G did better with some traditional media advertising than some digital advertising.
- mr_toad 6y ago> No one is willing to run the experiments necessary. Because advertising is like military spending. It takes a lot of money to maintain the status quo.
- actuator 6y agoThis is patently false. I have friends who have worked years developing solutions for doing ad effectiveness comparisons. They are A/B tests in most cases but some methodologies require a lot of sophistication because of problems tracking conversions. Traditional ad platforms like TV, newspapers might not have done this but online ones surely do. Infact that is one point they consider an advantage as you can measure effectiveness unlike the traditional platforms.
- thehappypm 6y agoThis is blatantly false. It’s incredibly easy to prove that digital advertising is effective using A/B testing.
- beardedscotsman 6y agoI think they did the A/B testing by switching off 100m of ads and having the same results.
- samstave 6y agountil you realize that ads are meant to make FB and Google rich, not you, you're going to have a bad quarter.
- manigandham 6y agoThis was a superficial analysis at best. Adtech produces petabytes of data every day proving that advertising works. There's a reason why two of the most valuable internet companies sell ads. The problem is knowing exactly which formats and campaigns are working down to the dollar, but part of that is just the reality of fuzzy attribution and it's only getting harder as privacy regulations get stronger. However you can definitely tell the difference when turning everything off, and if you can't then you were advertising to the wrong people in the first place. Uber's mistake isn't that advertising didn't work, but rather that they didn't vet their vendors or even bother doing any checking and optimization of their own.
- polk 6y agoThe implication here is that money spent on ads is largely wasted. Companies like Uber and Ebay have turned off all their adspend and saw little to no change in their acquisition metrics. You can argue that they were just doing it wrong. But the point is that, if even they are doing it wrong - and getting nothing in return for the millions they're spending on ads - then it's very likely most others are in the same situation. You are right that this doesn't mean _all_ advertising is useless, there are absolutely profitable usecases. But the larger points still stands: most money being spend on advertising right now is likely not returning anything. We now have some strong precedents being set. I believe this will cause more major companies to run the ultimate experiment: turn off all ads and see what happens. It's too early to tell, but it's not impossible we'll see adspend drop significantly across the industry once everyone finds out they're just burning money.
- manigandham 6y agoWhy the ad spend isn't working is a critical detail. It's definitely not most money but yes there's a lost of waste because it's a 12 figure industry with lots of politics, perverse incentives, thousands of vendors, and a complex global supply chain. Fraud is a special case because it's criminal activity and has nothing to do with advertising. It happens in every industry but it's especially easy with online technology spanning multiple countries and data that can be easily faked. Uber was exceedingly oblivious here but I wouldn't extrapolate advertising efficacy from these examples.
- pfalke 6y agoAt least in e-commerce it’s very much possible. The company that I work for does such experiments regularly (there’s a dedicated Data Science team for measurement) and I’ve personally been involved in lift studies for Google Ads. They work, you just have to be careful with the ‘how much’ combined with ‘for what’. Happy to chat with anyone who is interested in the topic (pfalke at pfalke dot com). Haven’t had a chance to listen to the podcast, apologies if that made me miss the point of the parent post!
- trophycase 6y agoIt's an arms race. In theory advertising should give you an edge over non-advertising competitors, but if everyone is doing it demand remains unchanged and also you're wasting money
- hardtke 6y agoLewis and Rao published a meta-analysis of 25 large scale controlled advertising experiment [1]. Here's the abstract: Twenty-five large field experiments with major U.S. retailers and brokerages, most reaching millions of customers and collectively representing $2.8 million in digital advertising expenditure, reveal that measuring the returns to advertising is difficult. The median confidence interval on return on investment is over 100 percentage points wide. Detailed sales data show that relative to the per capita cost of the advertising, individual-level sales are very volatile; a coefficient of variation of 10 is common. Hence, informative advertising experiments can easily require more than 10 million person-weeks, making experiments costly and potentially infeasible for many firms. Despite these unfavorable economics, randomized control trials represent progress by injecting new, unbiased information into the market. The inference challenges revealed in the field experiments also show that selection bias, due to the targeted nature of advertising, is a crippling concern for widely employed observational methods. [1] https://academic.oup.com/qje/article-abstract/130/4/1941/1914592 https://academic.oup.com/qje/article-abstract/130/4/1941/191...
- Nextgrid 6y ago> No one is willing to run the experiments necessary The people that would have the power to run this experiment have their entire careers depending on things staying as-is. Running the experiment carries a significant risk of exposing that the advertising operations they're responsible for provide much less ROI than they pretend it does. The unwillingness of anyone to run such an experiment is already an answer. Why wouldn't someone jump at an opportunity to prove the thing/service they provide actually works, unless they were unsure about it themselves?
- deleted 6y ago[deleted]
- garciasn 6y agoI work in the field. Incrementality testing is a big part of marketing measurement at any reputable agency. Any claims to the contrary are FUD. That said, companies like P&G, Airbnb, and Uber, which are oft-cited as examples of digital not being worth it, fail to understand their own brand recognition and organic power, built through prior marketing efforts, as key to their current standing. Sure, TODAY, it doesn’t have the impact they’d like it to have but the investments PRIOR were key to ensuring their success.
- quacked 6y agoQuit and do something that isn't fundamentally detrimental to everyone's quality of life. http://jacek.zlydach.pl/blog/2019-07-31-ads-as-cancer.html http://jacek.zlydach.pl/blog/2019-07-31-ads-as-cancer.html
- dasil003 6y agoBrand is a lot more than marketing spend, and not all brands are equal. Google and Facebook have companies that depend primarily on performance marketing spend over a barrel.
- andrewjl 6y ago> as key to their current standing. It seems like it would be important to measure this standing and turn down spend once it is reached. I can see how there's a lack of incentive to help large advertising spenders understand this.
- rriepe 6y ago“Half the money I spend on advertising is wasted; the trouble is I don't know which half.” - John Wanamaker Half was true in his time (a century ago) but I think our numbers are way worse.
- mumblemumble 6y ago> No one is willing to run the experiments necessary. Not without reason. Even without the conflict of interest that Nextgrid points out in a sibling post, there's still a significant financial barrier to attempting to measure this stuff. According to a former professor of mine who spent a large chunk of his career studying this stuff, the size of study you need to conduct in order to get any kind of statistical power at all on an ROI study is just absurd. See, for example, the treatment starting on page 15 of: http://www.davidreiley.com/papers/OnlineAdsOfflineSales.pdf http://www.davidreiley.com/papers/OnlineAdsOfflineSales.pdf
- im_down_w_otp 6y agoGabriel Leydon of Machine Zone spoke to the general topic at Code/Media back in 2016. Basically discussing that they'd gone through the trouble of building internal expertise and tools for optimizing their ad spend to better ensure specific outcomes they desired/required in a way that would inevitably lead to more sophisticated ad buyers and putting a nail in the coffin of traditional media advertising. https://www.youtube.com/watch?v=oXBqzpExvrk https://www.youtube.com/watch?v=oXBqzpExvrk
- manigandham 6y agoThis made the rounds in adtech in 2016 and it's really nothing special. His entire speech comes down to a single quote: "media will be quantified". Sure, everyone wants that. Precise attribution has been the holy grail for a long time and the struggles are far larger than just a few technology products. The new battleground is first-party data and clean rooms vs privacy regulations. And that's after dealing with all the politics and perverse incentives that happen in such a massive industry.
- disgruntledphd2 6y agoAlternatively, they dumped hundreds of millions of dollars into ads based on a wildly unrealistic notion of a customer lifetime (much like the rest of Silicon Valley).
- im_down_w_otp 6y agoI didn't say they achieved their goal. Though I do think it was/is an admirable one. It would be nice if marketing budgets weren't a near limitless accountability-free money pit.
- tiahura 6y ago> No one is willing to run the experiments necessary. Or, no one is willing to share the results of the experiments.
- lumost 6y agoIt's unclear how this experiment would be done. In the case of brand advertising, it's likely that brand awareness would decay over some period of time and in turn purchase behavior would change. It's not currently possible to run an A/B experiment with a hold out group of potential customers across all channels, let alone for any longer duration experiment. So how can we separate cause and effect? (although pay per conversion channels do get gamed left and right)
- pas 6y agoCome up with some new product that requires some personal data for usage (eg. age, gender/sex, address). Start to advertise this in just one country to one demographics, and look how many out-of-target orders you get. Maybe it's even enough if you simply just sell it via mail order, you can then look at the addresses. There's probably a natural information spread in any market (word of mouth, trade magazines), and there's probably a physical dispersion of the target group of people too (people move, visitors/tourists saw the ad/product and order it at home), but it still should be a valuable to see how much effect just one campaign has. Maybe one of the best products for this could be a car. They are pretty standard, really not much difference between them, they are in all price ranges, and regularly new models come out. Advertise one in a few major US cities but don't in others.
- lumost 6y agoFor most vendors, not possible to accurately target age/sex/address online. They will certainly sell you the option, but they won't tell you how accurate the data is - or they will provide it a high accuracy with extremely low coverage. To see this in action - spend a day watching pitbull videos on youtube and see how many spanish language ads you'll get.
- pas 6y agoHm. How about simply buying ad space at a few local newspaper sites? Sure, it's noisy as hell, but maybe still a decent proxy variable. Plus, maybe it's possible to somehow offer a coupon for those who buy via the ad, and so on. After all the ad/tracking industry probably have a thousand tricks to increase accuracy of this. But, yeah, I'm not holding my breath for a conclusive answer on this.
- notional 6y agoWhy does reddit have ads if all ads are a money pit? I understand you no longer work there, but ads started in 2009 I believe, so you perhaps had some input on this?
- mattkrause 6y agoOwning the pit into which other people throw their money seems like it would be pretty lucrative.
- ABeeSea 6y agoThis is incorrect. Companies do the experiments. They just don’t publish the results. Why would they? The idea that Amazon doesn’t know the ROI on their ad/marketing spend is laughable.
- saagarjha 6y agoBut then why do they keep doing laughably bad advertising?
- vkou 6y agoBecause 50% of advertising spend is wasted, but it's hard to figure out which 50%. If you're doing an $XY,000 ad campaign, it's a waste of your time and money to figure out which 50% it is. If you're doing a $XY,000,000 ad campaign, you employ people whose job it is to figure out which 50% it is. The thing is, you usually don't go ahead and pay them to blog about it.
- Razengan 6y agoI’ve thought and said so before: The ads racket is be a case of the emperor with no clothes, at best. At worst, it’s a front for building “profiles” of everyone. I can’t recall the last time I bought anything -because- of an ad. If anything, ads have sometimes actually put me OFF from buying something!
- pas 6y agoBut someone did. "Brand awareness" is a thing. For example we can probably agree that for completely new companies spending on ads makes sense. Or giving out free samples, etc. Similarly for big companies doing media campaigns to keep the new ones at bay makes some sense. Even if word of mouth is a thing, even if there are organic searches, and even if it seems like a race to the bottom if everyone just tries to outspend each other. It'd be great to make experiments about how to sensible prevent/regulate this ad arms-race. But first better data privacy laws.
- Razengan 6y agoOh look, yet another news about how the advertisement economy fucks up more shit than it benefits: https://news.ycombinator.com/item?id=25624112 https://news.ycombinator.com/item?id=25624112 “URL shorteners set ad tracking cookies”
- soared 6y agoI don't understand this line of reasoning. P&G, Unilever, Cocacola, etc have never, not once in history, had a gung-ho C level exec who said "Screw it, I'm going to find out if our advertising works". And then either found it works and kept spending, or found out it doesn't work and saved literally billions of dollars. There is so much money at stake that could be either saved or generated, its simply not possible that no one has looked at it. I used to help Pepsi/Fritolay set up tracking to tie advertising on youtube to in-store sales. They spent millions of dollars to measure their ads, Google had a clean-room data center specifically for pepsi/frito. The idea that no one actually checked if this system works is simply not possible.
- morelisp 6y agoFor brands that large the majority of their spend isn't campaigns specific to new products, but overall brand management. The experiments would need to run for years or decades and if the prevailing belief that these are Red Queen's Races is correct, the cost if they're wrong could be the whole company.
- Ericson2314 6y agoFortune 500 is a cesspool of insane inefficiency balanced by equally ~~insane rent seeking~~ insanely secure revenue. The sooner everyone understands this, the better.
- xpe 6y agoFirst, care to define your terms? Second, inefficient relative to what? Third, so far, what you've written here looks like a rant, not a predictive theory nor a powerful explanatory theory. Would you like to quantify your claim? Or at least make it more precise? As it is, I don't think it advances your argument. I'm interested in strong logic, data, explanations, and persuasion. I see none yet.
- Ericson2314 6y ago> Second, inefficient relative to what? The sad thing is it's not inefficiency relative comparable things. But anyone that has worked at these places or sold B2B to them just knows it on intuitive level that they are garbage, and need a heavy sedative to think there are no alternative. > not a predictive theory nor a powerful explanatory theory It's not. It's about letting go of some efficient market ideal and then finding new ideas. We can look at Fortune 500 case-by-case to learn new things > Cola cola Sugar drug cartel. Despicable business with very stable revenue despite being a net drag on society. (At least "regular" drugs have a lot more upside!) > Proctor and Gamble Just as restaurants are reaching down market, and the inefficiency of everyone cooking and cleaning is starting to have market implications, we should see their reign finally dwindle. Wash-and-Fold should follow laundromats. The specialization means that stupid differentiation between products for uninformative consumers (c.f. https://en.wikipedia.org/wiki/Monopolistic_competition https://en.wikipedia.org/wiki/Monopolistic_competition) should go away and restaurants and laundromats optimize. Personal soaps and cosmetics (of course many soaps are cosmetics) however will stay as cultural reasons ensure people will continue to clean themselves and not contract that out for the foreseeable future.