17 ms·
Chase had ads on 400k sites, then on just 5k, with same results
- mjevans 10y agoEdited for elaboration: The article doesn't mention the precise methodology for reaching the 5000 sites number, other than some human filtering being involved. The precise wording of another section is also vague, the 'cost of an impressions' could mean either their total Internet marketing expenditure is the same (thus 395000 sites were largely ineffective and merely exposed them to risk and complexity) OR that they've reduced their spending by around 98+% with no appreciable change in effectiveness.
- dboreham 10y agoIf the result would have been the same with zero sites, the 5000 can be selected randomly.
- soared 10y agoThey also didn't really mention if this is 100% of their rtb or just some. I'd be really surprised is they limited their retargeting and native to 5000 sites.
- sumoboy 10y agoThe real question is how long has this been going on? I've seen these campaigns go on for years with worldwide clicks completely unchecked wasting a ton of $$. You can't trust automatic site placement but if you do, analytics will identify it quickly to exclude the loser sites. This is just complete mis-management of paid media. Fire the agency or internal people for stupidity..
- bluGill 10y agoclick is not a good measure of advertising value though. Clicks doesn't measure how many people see your ad and come back a couple months latter to buy.
- olb 10y ago> Surprisingly, the company is seeing little change in the cost of impressions or the visibility of its ads on the internet, she said. If/when other companies switch to this strategy, they’ll all be competing for less inventory and cost will go up accordingly.
- xbmcuser 10y agoAt the same time good content providers will be paid more. So overall it is a good thing for the web. Content farming won't be worth much either.
- soared 10y agoA good thing for the big players, not the web. Everyone else (like me) me pays for their hosting with a few dollars a month in ad revenue will lose out.
- manmal 10y agoWhich seems to be fair if those ads don't provide any real leads.
- pilif 10y agoI'm not so sure, but I would love to be proven wrong. The issue I'm seeing is that there are many orders or magnitude more potential content providers out there than people are willing to manually validate and white-list. This might lead us to a situation where only the largest content providers/creators still get access to ad money which in turn will make it impossible for creators targeting a more niche audience to still have a chance in the market. Case in point: lately I'm totally into science videos on YouTube. From the more mainstream "Space Time" to the now-not-as-niche-as-in-2012 "Cody's Lab". While the latter doesn't share the former's production values nor budget, it's YouTube ad revenue that allows both to exist and to me personally, both provide equal value. It concerns me that in the future, if this trend continues, only one of the two will have a chance to survive.
- 10y ago
- pryelluw 10y agoEh, same would have happened with billboards, newspapers, radio, etc. Bad marketing cannot be fixed by mass deployments.
- nerfhammer 10y agoWhat's the shape of the long tail distribution? Does the top 5000 get 99% of the traffic?
- ffumarola 10y agoTypical pareto rule I've found. It'd be closer to 99% if all of their supply was sold into the exchanges, but most sites have a much more complicated waterfall to clear out their supply such that the premium inventory gets direct sold or sold into a private marketplace and only the remnant inventory goes into public exchanges.
- jtraffic 10y ago> At some point, a human is going to take a look. I recently saw a talk by Foster Provost, a big ML guy at NYU. The main points of his talk were that using fine-grained behavioral data (like browsing history) is better than demographics (at least in his context: predicting ad lift), and he proposed a way to interpret the model (somewhat). I left feeling disappointed. His system for interpretation was super post-hoc and tenuous, IMHO. It felt like a computer scientist doing social science (because it was). I think ML is great for lots of things, but there are still lots of problems with using it in systems with humans. An example: if you do a Google search for "Amazon <some book>" then you'll almost always get an ad from Amazon. So Amazon pays for a click that would have happened anyway. Maybe Amazon does this to crowd out other advertisers, but maybe it's just the algorithm being stupid and nobody is watching.
- tgtweak 10y agoIt's not being stupid it's designed that way. "Gee that'd suck if somebody else bought ads for all your organic keywords. Sorry we don't have a better way to prevent that, you should bid on those." Even if Google did provide a provision for blocking ads for certain keywords (and they do have one), who controls that system? Amazon is also a bad example since many 3rd parties affiliated with - and driving traffic to - Amazon buy those keywords.
- stvswn 10y agoEach individual advertiser on Google can provide "negative keywords," which are keywords that the advertiser would like to make sure they never show for. Yes, you're right that buying one's own brand keywords is a defensive move. The idea that Google would show a relevant ad for a competing e-commerce site when a user is searching for "Amazon" isn't scandalous, it's the business model.
- 013a 10y agoI think that's entering an area of ad ethics. Yet, its an ethical violation that companies like Google make today. If I search for "Wealthfront", I get an ad for Wealthfront, Betterment, and TDAmeritrade, in that order, before an organic result for Wealthfront. If Wealthfront didn't pay up, even though it is _obvious_ what I am looking for, the result I am looking would be buried. That's a protection racket. Rank-based advertising, like in search results, is fundamentally unethical. To do it ethically would require perfect comprehension of what the searcher is seeking, so that you can prioritize organic, helpful results. Google never prioritizes organic results.
- blazar 10y ago"An intern then manually clicked on each of [the 12000] addresses to ensure that the websites were ones the company wanted to advertise on." - true hero of this article
- vostok 10y agoHey JPM has a meal allowance if you stay late. You can even stretch it to tomorrow's lunch if you're smart about what you get.
- upquark 10y ago$25 - two sandwiches from Toasties baby :o
- mozumder 10y agoFor better results, have that intern gather the email addresses of those 12,000 pre-approved sites, and email them a personal ad placement buy offer, or request a media kit. You'll find all sorts of personalization opportunities and you get to cut out the middle-man.
- rhizome 10y agoIt's kind of interesting that self-hosted direct advertising hasn't taken off as a technical problem to solve.
- corin_ 10y agoBecause that's a business problem, the technical side of it was solved a long time ago.
- rhizome 10y agoI'm sorry, I don't understand. Are you saying that there exists direct advertising libraries for web development frameworks and CMSes, and that they've possibly been around for a long time?
- nichochar 10y agoit's only been a few days though, I think this fact alone invalidates the data.
- soared 10y agoExactly! Who in their right mind would deliver a report to their boss and say, "Its only been a couple days, but this drastic change has been successful!" But someone instead went to the NYT and said that same thing.
- busterarm 10y agoGee, I wonder if Chase buys display ads on NYT...
- bigtimeidiot 10y ago>I think this fact alone invalidates the data It invalidates the data? How so? Or do you mean conclusion? Even so, there's nothing inherent with "a few days" that makes the analysis invalid due to sample size; that depends on the nature of the data. In my employment we are measuring changes hour to hour.
- bluGill 10y agoBecause advertising is about perception. If I see chase ads every day will remember them in 6 months when I suddenly realize I need a new credit card - today I'm happy with my card selection and no amount of advertising will get a bite from me, but when that changes I might change to a "lesser" card just because I didn't think to check chase out. thus they need numbers over months before they can state it worked.
- soared 10y agoThis is definitely an interesting tactic, but this is a pretty poor article. #1. Chase is claiming performance hasn't been affected, but it has only been a couple days since they made changes. With display you can't measure performance in only a few days. #2. The author confuses the number of sites with the number of impressions. Chase is buying the same number of impressions - if everyone else followed this strategy it wouldn't hurt exchanges. It would have weird outcomes, but if the same volume is served the exchange makes the same amount (excluding data costs and how cpm would be affected, etc).
- ffumarola 10y ago1 - agreed. A few days is nothing. 2 - The exchange would likely make more because the increased auction pressure from the same amount of advertisers trying to buy the same amount of volume (same demand) on a smaller list of websites (lower supply) would lead to higher prices being paid to show ads.
- LoSboccacc 10y ago1 - depends on volume. high enough and you can get goodp-value of the population even in a few days 2 - still a win-win-win-win, Chase get more views for the same budget, few website of good content that attract good traffic get more money out of ads, bad website spamming keywords get less money and the exchange gets the same money but displaying the ads few times as the unit price increase so it has more margin.
- ffumarola 10y ago1 - It's not really about the volume of impressions, but about typical attribution windows. Banner ads typically aren't measured on 1 day click attribution. In more DR oriented workflows the impression logs will be ingested into MMM (media mix models) to project the impact the banners had on conversions across all of your acquisition channels. In non-online conversion paths (e.g. offline retail, call centers, etc) or branding campaigns, many are measured using offline lift studies or brand lift studies which take at least a couple months to show results. 2 - Not exactly. The prices would be driven up, meaning eventually Chase would get less impressions for the same budget. If both you and I used to buy 1,000 impressions for $5 across 100,000 websites who had a total supply of 2,000 impressions, but then we limit our list of allowable websites to 5,000 websites that only have 1,200 impressions... prices will rise. The impact is not apparent when only I change my bidding strategy, because I'll buy 1,000 of the 1,200 impressions from the top tier websites, and you'll get 200 from them and then 800 from the bottom tier. But once we both change our bidding strategies, we're now both competing on the same 1,200 impressions. Prices will go up as we compete over them. This is a simplistic auction, of course. In practice, the ad exchange values different sites differently... but this is just to give a rough mental model about how the increased competition on fewer sites will lead to increased auction pressure thus driving prices up and volumes down for each advertiser. The exchange and publisher will be happy, though.
- diogenescynic 10y agoI work for a biggish company and sit near the marketing department. They report similar results, if not quite so dramatic. Advertising isn't incremental. Sometimes there's only so much demand for your product and you can only change that so much with marketing or promotion.
- doctorpangloss 10y agoIt's crazy how many apologists there are for Big Web Advertising! So many commenters are giving the customer a hard time for realizing, "99% of my budget is spent on zero value, i.e. fraud." The biggest lie the online advertising industry has sold is aggregate statistics. Of course a handful of traffic sources convert massively while the supermajority (99%) don't convert at all. Advertising intermediaries rely on the statistical mean to hide all the garbage in the gold. It should surprise no one that for the vast majority of customers, like Chase, conversion as a function of source is skewed. I suspect too many ad tech companies rely on the ignorance of their customers to make money. They monetize the basic math of "if it's more than break-even, it's working"—in other words, their objective is to take as much ad budget as possible while still delivering a profitable conversion for the customer. By simple math, ad tech uses garbage inventory until the customer's profit is close to but above zero. It works, and you'd have to be a real blowhard to believe that it's not how the ad tech ecosystem works. That ad-tech does this by laundering e-mail spam, blogspam and other forms of spam into Google AdWords: that's the real fraud. All those Googlers then go on to pretend like it's not happening. I mean, what 400,000 sites do you think Chase was advertising on? Ones that really have to do with banking? Or just ones that, by some idiotic metric, have a keyword that ".equals('banking')"? I would love for someone at Google's direct navigation ads (or whatever ridiculously obscuring name they're called now) to come out and say how "Nobody clicks twice [on spam ads] by accident." It's like they inhabit a make-believe universe. The ad exchanges aren't ignorant: they're facilitating the massive fraud of their own customers.
- ckamin5 10y ago> I mean, what 400,000 sites do you think Chase was advertising on? Ones that really have to do with banking? Or just ones that, by some idiotic metric, have a keyword that ".equals('banking')"? The reason a Chase ad ends up on 400K sites is not because all of those sites are contextually relevant, it's because of retargeting. A user goes to chase.com, gets pixeled, and then shown retargeting ads on what ever websites they happen to visit that are hooked up to the exchanges. This could be either a good or bad thing.
- dkuebric 10y agoIt's hard to tell from the article, but I don't think there was any change in Chase's advertising spend. My interpretation is that they are spending the same amount, but restricting bidding to a whitelist of sites. If so, the fact that they don't see an impact in # of impressions means more about the ad exchange's bidding system and inelastic demand (or lack thereof) for inventory on those whitelisted sites. I don't think this has anything to do with fraud.
- deleted 10y ago[deleted]
- trustfundbaby 10y ago"Half the money I spend on advertising is wasted; the trouble is I don't know which half" -- John Wanamaker
- thomed 10y agoAn important difference between buying ads on 400k sites and 5k sites is the margin for the middlemen. The money is going to get spent anyway, so the middleman needs to optimise his take. The bigger the sites; the more leverage they have over middlemen. The lower the fees exchanges/ssps can collect - for big sites (ones people have actually heard of) the fee is effectively zero, and are needed by exchanges as loss leaders to attract any demand. Little sites with no leverage will expect to pay around ~70% to the middlemen (although not all of that will be disclosed). True story: about 250 domains will get you above 98% of online population in most countries. This is plenty large enough for dvertisers to do all kinds of fancy targeting and optimisation within this pool.
- geocar 10y agoAd exchanges do not usually charge the sites. Ad exchanges usually charge a fixed rate on revenue (like 15% or 20%). If the spend is the same, then the ad exchanges don't make any more money. There are other middle men, like the audit companies and the impression counters, but they end up making less money because they usually charge by the volume of impressions: Since the same budget will be spent over a smaller number of sites, the prices for those sites will raise and the number of impressions will go down. The only people who win are the publishers of those sites who now have more money for the same users.
- ericdykstra 10y agoWhile the premise of the article is reasonable, the evidence is flimsy. This seems like an example of NY Times defending their turf. We've seen numerous [1] examples [2] lately of legacy media companies trying to drive advertisers away from new media sites and Youtube by discrediting sites as "fake news" and by running hit pieces on popular Youtube personalities. I mean, just look at the author's latest articles. 5 of the last 6 (including this one) disparage advertising on new channels! [3] Targets include Youtube, Snapchat, Breitbart, and Google (in general). The legacy media is just not well suited for the current state of the world. Breaking news comes first through Twitter now. Investigative journalism doesn't require a big budget to make high quality content any more. As for political commentary, many people would rather listen to a well-educated everyman craft videos on Youtube than listen to the millionaire personalities on Fox News talk about how the Democratic party doesn't understand the proletariat. 1. https://www.theguardian.com/culture/2017/feb/24/zoe-sugg-zoella-the-vlogger-blamed-for-declining-teenage-literacy https://www.theguardian.com/culture/2017/feb/24/zoe-sugg-zoe... 2. https://www.wsj.com/articles/disney-severs-ties-with-youtube-star-pewdiepie-after-anti-semitic-posts-1487034533 https://www.wsj.com/articles/disney-severs-ties-with-youtube... 3. https://www.nytimes.com/by/sapna-maheshwari?action=click&contentCollection=Business%20Day&module=Byline®ion=Header&pgtype=article https://www.nytimes.com/by/sapna-maheshwari?action=click&con...
- jpalomaki 10y agoWith the magic of computers you could deliver 400k versions of your ad. Each tailored to the site where the ads are being displayed (or even more - tailored also to the specific user). Probably most of these sites have very distinct audience, so you could build quite targeted ads. If you are just spamming the same ad everywhere, then I can certainly understand why it does not make difference if it appears on 5000 vs 400.000 sites if the ad display count stays the same.
- drej 10y agoMy mate worked at a giant ecommerce company, it would send hundreds of millions of e-mails a month... and with virtually no performance evaluation (only high level stats which are by no means actionable). It took a single SQL query to propose cuts to traffic in the order of 20% with ~zero loss in revenue. I remember attending a talk, where this guy talked about their freemium app used by dozens of millions of users. Their in-app popups were cut by 30% or so without losing revenue, all thanks to a few simple if statements (they tried machine learning as well, but this did it). One can only wonder how much of this excessive advertising there is, I guess it's mostly driven by absolute revenue numbers without much consideration for costs and efficiency.
- flatfilefan 10y agoOne would think this could be the perfect case for Big Data approach, web scale and all. But no - it is an intern manually clicking through 12K web sites. Somebody sell them some buzzwords, anybody?
- jack9 10y agoThis is non-news, when talking about Display Ads. Relevant: http://www.businessinsider.com/its-more-likely-you-will-survive-a-plane-crash-or-win-the-lottery-than-click-a-banner-ad-2011-6 http://www.businessinsider.com/its-more-likely-you-will-surv...
- jlebrech 10y agothis is smart, find out which sites give you revenue then trim. if only we could get Chase's list it would save others a lot of money.
- elorant 10y agoSo if advertising on questionable sites bares the same results as advertising on respectable ones the bottom line is that advertising doesn't work at all. Perhaps it's time to move away from profiling and return to the old days where the ads were correlated with the content/web site.
- fabiandesimone 10y agoBasically brand advertisers are becoming performance marketing oriented. http://www.businessinsider.com/ddb-ceo-wendy-clark-mcdonalds-2016-9 http://www.businessinsider.com/ddb-ceo-wendy-clark-mcdonalds...
- bayesian_horse 10y agoAs they say, 80% of advertising has no effect. The trouble is telling which part.
- pwg 10y ago> "99% of my [advertising] budget is spent on zero value," This has always been true for advertising. The difference is that before the internet there were zero methods for the advertising client to directly recognize this fact.
- bluGill 10y agoI believe that statement is wrong. 99% of advertising might not be worth the money spent, but it wasn't zero value. (if you spend $1 to generated $.50 that is advertising at a loss, but a much smaller loss than advertising with zero return). Advertising needs to figure out how to generate positive value. The problem is there is two types of ad. The first is "buy this now", if the user clicks and buys it was a success, but that doesn't mean a failure to click is a failure because there is a second type of ad that I believe is more important: awareness. You advertise so that people know you exist - that way when they realize their need for your product you come to mine. I think the pay per click model that the web advertising has settled on is wrong because it doesn't well account for ads that you don't want clicked. There is a reason McDonald's advertises on every radio and tv station they can every few minutes: it works. Some of those ads go to people who will never eat at McDonald's and if they could figure out how to save money by not advertising to those people it would be worth it. Overall though the return on those adds it large.
- anothercomment 10y agoIn their test they had 12000 clicks, and decided they only wanted 5000 of them. So they miss 7000 clicks, or more than 50%. How is that the same result? I could understand if they found that click from certain sites did not lead to new business for them. But that is not what the article says. It says they didn't want those 7000 clicks because they were from sites they didn't like. It seems to me they should already have figured out which sites bring them useful clicks long ago, in an automated way. Isn't that standard procedure for advertising? Then there would be no need for moral judgements. Of course they are in their rights to shut out sites they don't like. But not everybody who browses such a site has to be a believer, among other things. I think drawing attention to such automated matches of ads can only produce losers. The sites lose out on ads, but the companies force themselves to become political, needlessly driving away users from the other political spectrum. (Again, I assume it is in every companies rights to do so, it just seems bad for business).
- konceptz 10y agoI would wonder if the whitelisting is in-house or part of their contract? If it's in-house then the added cost to maintain the whitelist (in-house expertise), while not much comparatively, isn't nothing.
- ransom1538 10y agoThe fix to online ad fraud is obvious: CPA (Cost per action). If a signup occurs, then you pay for the ads. If a user pays for the service, then you pay for the ads. It would align the incentives of the advertisers (people paying for ads) and the ad networks (google). Currently it is the ad networks incentive to use CPC and to hide fraud by not releasing traceable ids, allowing clicks from bots/proxies/adsense holders and allowing ads on unrelated content which cause accidental clicks. CPA would incentivize the advertisers (people paying for ads) to commit the fraud by not reporting the action. This would be easier to maintain since the people paying for ads is a much smaller set. BUT - from my experience there would be almost no money in this system for Google since most of their income is from fraud. Disclosure: worked in ad tech.
- nommm-nommm 10y agoChase already does this, its a big reason all the credit card blogs pimp Chase cards so much.
- asafira 10y agoYeah, I think the blogs even mention they get a kickback.
- AndrewKemendo 10y agoAll of advertising is selling possibilities, not actions at (relatively) super low rates. So that means there is more competition and a broader playing field. My guess is that prices would go up dramatically if you started selling on CPA - and the ad tech business model would change significantly. Seems like the best way to do this would be to hand curate targeted advertising and then charge a huge premium.
- NicoJuicy 10y agoSo, limiting websites gives the same result? What happens if they change their bidding and did the total amount of impressions change?
- taksintikk 10y agoThe Pareto principle (80/20) most definitely applies to advertising. If you let google or FB choose where to show your ads, you are going to have a bad time.
- pajop 10y agoArchived version: http://archive.is/2EhFW http://archive.is/2EhFW
- ptenk 10y agoLikely due to ppc arbitrage. It doesn't change anything in terms of spend and the return is the same, it's just that users click through different sources to get to the same destination.
- douche 10y agoNo shit, nobody clicks on ads. Many people don't even see them. It's the biggest class of Graeber-esque bullshit jobs[1] I can think of . [1] http://strikemag.org/bullshit-jobs/ http://strikemag.org/bullshit-jobs/
- mikehollinger 10y agoCan we talk about the fact that "an intern" had to filter through 12,000 websites and make a judgement call for a second here? Also - I presume the spending was the same in both cases - just focused. If so, the risk here is that you may miss out on a new up and coming blog "exploding" onto the scene. However, all it would take to "reset" is next quarter, "tasting" ads on 400k sites again, paying an intern (again) to filter the ones that led to revenue, and creating yet another list.
- tlrobinson 10y agoAnd presumably you could use the previous list as the starting point of subsequent lists, then you'd only need to check the new sites.
- deleted 10y ago[deleted]
- bjd2385 10y agoI feel bad for the intern who JPM paid to click through 12k sites to find the 7k that we're unacceptable.
- Neliquat 10y agoMore terrible tech reporting from NYT, why are they being spammed here so much now? Can it stop? Tired of the clickbait and paywall. I thought HN was against both.
- JBReefer 10y agoIf there's a book on the downfall of the NYT, I would love to know about what happened. The quality drop in the last 8 years has been truly shocking to me. Before the stopped their local coverage, their articles about the outer boros were just as bad as their tech coverage. Go back and read old articles though and holy heck they were good. I feel like an old friend is gone.
- dfgonzalez 10y agoSo, they run their campaigns with an open targeting and then they trimed the websites to the ones users clicked, and then, selected which ones had better brand value for them. That's simple optimization and they should have always been doing that. The question arrises when you have to start from scratch. They would also have to start with an open targeting to learn what performs for them.
- tmaly 10y agoThis is just the 80/20 rule essentially
- pcurve 10y agoI guess Youtube content creators will ramp up their self-censoring. At least those who were deriving meaningful amount of revenue from their videos.
- 1337biz 10y agoThe NYT arguing that one should only advertise on 'high quality websites' is the equivalent to a retailer arguing that you should only buy in store because all the online stores are full of fakes. Fits perfectly in line with their 'we report the truth and anything else is fake' narrative.
- arbuge 10y agoThe irony is that it is so easy to track online conversions with a simple pixel or server postback. It's called performance marketing, or affiliate marketing, in the sense that the advertising websites then become what is commonly called an affiliate in online advertising lingo. There really is no reason to pay for impressions these days, unless you believe in a mystical (and suspicious IMHO) quantity known as "branding value".
- madebysquares 10y agoThis sounds like pure PR spin to make chase sound like some altruistic advertising adverse bank.
- justforFranz 10y agoThere's probably more effective ways for government & corporations to track an individual's internet usage nowadays than web advertising. :/