9 ms·
It's time to reveal all recommendation algorithms – by law if necessary
- bediger4000 4y agoAt first, I thought this was laughable, because SEO bottom feeders would immediately game everything. But after contemplation, I think that would work out. The SEO stuff would be immediately obvious, because it would be all tricks, it wouldn't have a thin veneer of BS "content" like it does today. Human could detect SEO spam instantly.
- esafak 4y agoSo the solution is to get humans involved? Yay, I've got nothing better than to eat spam.
- ehnto 4y agoI think AI spam will be the nail in the coffin for standard search engines. What will be interesting is how SEO might start targeting AI source collection. I imagine being a source for a question like "What are the best speakers to buy for $100?" would be quite valuable.
- tedunangst 4y agoSo how many times will I have click next page to get past the spam in search results?
- whitemary 4y agoOpen source them, along with ML algorithms and model weights. Anything less is effectively meaningless, and if you insist that doing so is a privacy risk then your product is unfit for society.
- 23throw23 4y ago[flagged]
- johnklos 4y agoAdd to that algorithms used to ascertain whether email will be treated as spam. I'm tired of explaining to people that Google and Outlook email are NOT deterministic, and that they could be missing email that might never even make it in to their spam folder, and they'd never know, nor would they ever know why. People say that spammers would just do the minimum they need to get spam delivered, but every person can have their own personal threshold for their own spam filters.
- amadeuspagel 4y ago> People say that spammers would just do the minimum they need to get spam delivered, but every person can have their own personal threshold for their own spam filters. OK, so then rather then doing the minimum to get spam delivered, spammers would be more motivated to improve their spam to get above higher tresholds, so that people would have to set their tresholds higher and higher until all the legitimate mail they get is classified as spam.
- deleted 4y ago[deleted]
- johnklos 4y agoThat's not how it works, else that's what we'd already be seeing.
- amadeuspagel 4y agoWe're not already seeing that because those algorithms are secret.
- johnklos 4y agoThat's a leap. You think that spammers are not knowing which spam is silently dropped is the one thing that's keeping them from leveling up? I strongly disagree. Even if that were the case, in my experience, silent failure negatively affects actual delivery much more than any positive effect it might have.
- jmclnx 4y agoYes plus when you call a support desk, if the "person" on the phone is not a real person, the first words said is "You are talking with an AI, not a person." I believe the only reason for Commercial Orgs are looking at ChatGPT is to eventually replace all support people with some kind of AI.
- bediger4000 4y agoIn a world where support people are often 10.5 or 11.5 timezones away, how will we tell? Seriously. A couple of years ago I hit a truck tire tread and roached my radiator 30 miles east of Denver on I25. I have State Farm auto insurance, I probably pay more than I should. Their after hours support was terrible, as if they'd never heard of someone needing a tow on an interstate highway outside of city limits and street/number/zip code addressing. "Westbound I25, east of Denver at mile marker 316" is a good location, but I had to talk myself hoarse because the idea of "Interstate Highway 25" was incomprehensible. Several reps wanted a street address, which just wasn't possible. The towing company also basically held my car for ransom, I guess that's an experience an AI can't provide. Yet
- ted_dunning 4y agoWell, the problem with an AI-based system here might well have been that I-25 goes north and south through the heart of Denver rather than east and west. The location "30 miles east of Denver on I-25" literally does not exist. Perhaps you meant I-70? And perhaps neither support humans far from Colorado nor an AI with a map would know to make that correct.
- bko 4y agoIf talking to an ai is the cost of not being put on hold for 20 min for the simplest request so be it. Honestly I welcome ai customer service. Most of the time it's just something super simple i want to do.
- toss1 4y ago"If" is doing a LOT of work in that comment I have never seen nor heard of any "ai" system for customer service that remotely approaches a barely competent human, and those are frustrating and annoying enough. ChatGPT4-level systems may be able to get much closer if they are provided the training set, and if they can, then great. BUT, the absolutely need to be able to figure out when they are at the limit of their knowledge/ability, and then hand-off to a human. ChatGPT4 has been spectacularly unable to do anything even close to this; and it actually just starts fabricating bullcrap in a highly confident voice. Corporate managers are already no good, horrible, awful, terrible at actually providing service, as it seems their only goal is to provide a cursory appearance of service and reduce their human costs. (Incidentally, this also massively misses the opportunity to gather excellent data on where their company could improve it's product/service and gain market share.) "AI" will only exacerbate the trend until several generations in the future when it is actually good enough, and it may become a competitive advantage to provide better service.
- rektide 4y agoAs we've already seen from twitter releasing the algorithm: it's useless & irrelevant without the weights.
- klyrs 4y agoRelease the weights too?
- AzzieElbab 4y agoin real-time :)
- crooked-v 4y agoThen the weights should be considered a functional part of the algorithm.
- sidfthec 4y agoThe weights aren't going to help understand "why we see what we see", which is what non-tech people (and this article) think they'll get from companies releasing "the algorithm"
- esafak 4y agoWorse, people game the algorithm, making it useless.
- BaseballPhysics 4y agoI totally disagree. For example, Twitter releasing the algorithm showed us that certain specific people were getting artificially boosted. We also saw that the topic of the war in Ukraine was getting special treatment. Yes, we all guessed that was happening, but without the code it was just supposition that Twitter could deny.
- JohnFen 4y ago> Twitter releasing the algorithm showed us that certain specific people were getting artificially boosted. It did? Did I miss something here? I don't remember seeing that. There was certainly code that tallied certain specific people and topics, but I don't see an indication of what was done with that tally.
- amadeuspagel 4y agoA terrible idea that would make it trivial to game these algorithms.
- klik99 4y agoThey are already being gamed, and with bad actors who have access to inside information. Not saying it's a good idea, but this isn't a valid reason
- amadeuspagel 4y agoIf some bad actors have access to inside information, that's a limited and solvable problem and doesn't mean that we should give up and give that information to everyone.
- klik99 4y agoStrong disagree with it being "solvable" - bad actors will always exist (don't feel like I need to explain this one, I'm sure we all agree), arms race will always fail because for them it is the PRIMARY focus for income, for tech companies it's always a secondary concern because it's a weaker, more indirect and longer term impact on bottom line. Making information public could (I'm not sold on this by the way, just saying it's more plausible that what is currently being done) weaken the bonus these bad actors have. By making it public you're maybe allowing some weaker bad actors in, but you're also limiting the power these primary bad actors have.
- brookst 4y agoI've never understood the "an imperfect solution is no better than no solution and should be thrown out on principle" view. Door locks aren't perfect; our justice system isn't perfect; software isn't perfect. But they're all pretty useful and I just can't get behind a movement to abolish any of them because they fail to solve every individual case.
- lisasays 4y agoOTOH - having them be open may ultimately lead to stable algorithms that can't be easily gamed.
- MrYellowP 4y agoWhy stop there? What's next?
- rcoveson 4y agoYeah, this seems like a slippery slope towards requiring companies to release all source code under all circumstances. I'll get my downhill skis!
- gspencley 4y agoWhile I'm not in favour of legislating something like that, because I think it would be extreme government overreach, if that were to just happen magically I would be hard pressed to find the problem.
- mindslight 4y agoBetter yet, use straightforward antitrust to go after the bundling of content hosting with software to display the content. Using "third party" independent clients to display user content from Youtube, Twitter, etc should be a widespread practice, at which point those independent clients can present the service's recommendations (while controlling exactly what data points are input to them), and/or create/display their own recommendations entirely.
- efficax 4y agothe algorithms that use ML are useless without the weights. What's the point?
- say_it_as_it_is 4y agoMost importantly, it should be required by law how Spotify recommends new songs. They cannot operate in darkness forever. /s
- akira2501 4y agoI've always assumed the "Don't show me this channel" are processed in batch. They seem to work for me, but they also seem to take up to 24 hours to actually take effect. Likewise.. there are other users and creators on the platform. Creators often pick "deep dives" or "strange subreddits" as a topic. They show it to their audience, who then goes to search for some of this content on their own. Youtube sees the influx of interest in the topic and starts broadly recommending it. To many "privacy focused" types immediately start with a conspiratorial bent. Presuming that there's a nefarious purpose to these one off events, and then trying to tie them to Twitters recent release without any deeper investigation is some rather shoddy journalism.
- eimrine 4y agoFor me they use to work no more than 24 hours than Youtube forgots the setting. The most reliable way to really get rid of some kinds of content is to not watch it. Another way is to watch a lot of useful videos fully but maybe without sound, just to make Youtube think about me that I am fond of rocket science (otherwise it inevitable get to think that I'm fond of lowball things).
- jiwidi 4y ago99% algorithms are public already, its the usage and special tweaks made to those that make them unique at some companies. Lets say the white smoke release for twitter algo, its useless because everyone knows how to build a 4 stage recommender (see nvidia merlin open source repo) but the real juice is their weights to know what user embeddings does it learn. They cant release that since is personal user data.
- BaseballPhysics 4y ago> 99% algorithms are public already, What? You need to back up that statement, because I do not understand how it's at all true. Or do you somehow have access to Facebook's news feed algorithm, or the Youtube recommendation algorithm?
- hawksprite 4y agoMaybe they mean 99% of known algorithms. Instead of 99% commercial visibility of a select few??
- deleted 4y ago[deleted]
- nomel 4y agoThe fundamental math is almost always SVD (or related), some type of clustering, or some "fancier" minimization. These companies aren't inventing new math, they're just interpreting/biasing the results differently. For example, an ML algorithm wouldn't be the secret sauce. Most will result in the same answer. The training data, and its weights, are the secret sauce. Would this consider the training data as part of the algorithm? I would assume not.
- BaseballPhysics 4y agoLOL, this is ridiculous. All computing is "fundamental math". That there are some known set of algorithms in the mathematical toolbox that are used is irrelevant. The question is, how are those tools put together, what are their inputs, and how are those inputs weighted.
- honksillet 4y agoShadow banning should be illegal and all banning or throttling decisions should be explained publicly in real-time.
- ashes-of-sol 4y agoSure, if you want to make it dead simple for bad actors to be able to get around safety measures. This is a complete non-starter from a user safety standpoint.
- baby_wipe 4y agoThen all news outlets should be forced to publicize their internal editorial decisions.
- BeepBipBoop 4y agoIsn’t that just the news? As in what they publicize is their internal editorial decision? Aside sticking a camera in the newsroom and livestreaming all day, what would this entail?
- deleted 4y ago[deleted]
- Zak 4y agoHere's one possible approach: you can have a secret algorithm OR platform immunity, but not both. News outlets don't have to publicize their internal editorial decisions, but they are responsible as publishers for the content they publish and can be sued if, for example they publish something false and defamatory.
- leroy-is-here 4y agoIt isn’t the recommendation algorithms themselves which are insidious, it is that they are coupled directly with a single human. They are like mental parasites which watch every single interaction one makes and adjusts, ever so slightly, to the negative just to keep you watching.
- phailhaus 4y agoGetting tired of this, because the algorithms themselves are worthless. Instead, demand websites that aren't just a recommendation feed. Demand the ability to categorize and rank content explicitly. The problem is that these websites are creating a feed, and then training themselves based on how you engage with...the feed. It's a toxic feedback loop, with almost no levers for you to interact with. If you get stuck in a rabbit hole, it is difficult to teach it how to get you out. That's independent of the "algorithm" being used, it's a problem with all of them.
- cush 4y ago> ability to categorize and rank content Who has time for this? What about discovering interesting and new content amidst millions of options?
- ZainRiz 4y agoNo need to make every person categorize/rank their own content. But let them choose which of the 3rd party ranking algorithms they'd like to have serving them their feed today.
- phailhaus 4y agoWhy would that help? All the content is uncategorized. So what info can these "3rd party ranking algorithms" use to get you the content you want? You're going to get different flavors of Facebook. Look at what Reddit does: all posts must be submitted to a subreddit, which categorizes it. Each sub upvotes and downvoted that content, which means that the "ranking algorithm" can be dumb as a bag of rocks. At any point, I can choose what content I want to browse without having to "switch algorithms". The media is preoccupied with "the algorithms", but the problem is with websites that are nothing but a recommendation feed choosing from a formless content soup. It's constantly guessing, the best it can do is "you seem to like this account, I will keep giving you stuff from this person and related people". No concept of interests!
- phailhaus 4y agoNot you personally, but users in general. See: Reddit. I never "accidentally" get into a conspiracy theory rabbit hole, that's something I can consciously join or unfollow. And because I have an explicit list of subreddits I'm a member of, the platform can much more accurately recommend me content when I'm in the mood to explore.
- clircle 4y agoSeems like over-reach when the solution is to just subscribe to youtube channels in RSS so you can sort the content in any way you please.
- paxys 4y agoWhy stop at recommendation algorithms? All code and internal documentation for every product should be posted publicly. Every single email and discussion board at every company should be open. Will people be happy then?
- blueprint 4y agoyes
- wahnfrieden 4y agoWell yeah. Good riddance to IP
- BeepBipBoop 4y ago[dead]
- bazmattaz 4y agoOh wow what a wild ride of an article! As someone who has led the building of recommender systems (PM) for the last 5 years this rubs me the wrong way. > I defend myself from arbitrary data collection that fuels the algorithms using PiHole, the tracker-blocking Disconnect plugin, and Firefox, plus a few other tricks. The author clearly has no idea what he/she is talking about. Sure, Everything they mention blocks collecting tracking information but recommender systems mainly track your behaviour in the experience itself (clicks, page views, time on page). > That leaves me and other privacy conscious folk with just one lever to pull offer - disliking a video Again this author has it all wrong. If you’re serious about privacy the last thing you want to be doing is providing more input into the models we create! And finally the comment that made me realise this author has no idea what he’s talking about; > The solution to both issues is obvious, technically easy, and yet commercially a nearly impossible proposition: open up all recommendation algorithms. Make them completely transparent, and, for the individual being targeted by the recommendation engine, completely programmable. Are you joking? So he/she thinks the east answer if for every user to ”program” their own algorithm. That’s like saying every Tesla owner should be able to program their own car! Let’s open the source code of Tesla to every owner! Idiotic article.
- walleeee 4y ago> That’s like saying every Tesla owner should be able to program their own car! Let’s open the source code of Tesla to every owner! Other critiques aside, these things are not very similar. You can't run someone over with a buggy recommender system. You bork your own newsfeed, who cares?
- bazmattaz 4y agoOk fair enough, I formed that analogy in haste. My point was that it’s not easy at all to “open up” an machine learning model for a user to “program”. It’s complex enough for an ML engineer to develop! In theory, maybe it is possible but it would be incredibly expensive to produce such a system, let alone maintain. But even then, the ability to control an Ml system is such a niche ask that it would never happen
- 4y ago
- djha-skin 4y agoHard though, because the company often doesn't know itself what its "algorithm" is. It is often spread over lots of different teams and departments, and may comprise hundreds of thousands of little design decisions made by people all over the company who are not talking to each other.
- fifticon 4y agoI would rather target consumer-hostile practices like youtube not letting users see downvotes, and the generally useless ratings and broken search in places like app stores. When something ends up with a 95% approval rating, it is almost guaranteed astroturfing.
- Tozen 4y ago> ...a switch that turns the recommendation engine off. I do like that idea. If the company is not going to show what the recommendation algorithm is, then being legally forced to provide an option to turn it off seems fair. Too many companies pretend the "algorithm" is to blame for their shady practices, versus what its management and owners are directing it to accomplish.
- akamaozu 4y agothe publication recommends articles to read, but i don't see their algo for how the recommended articles were determined