9 ms·
The rise of 'pseudo-AI': how tech firms quietly use humans to do bots' work
- hyperrail 8y agoMy favorite example of this sort of thing, mentioned in the Guardian story, is the kerfuffle late last year when Expensify's receipt-reading SmartScan feature was found out to be partly backed by human receipt readers: https://qz.com/1141695/startup-expensifys-smart-scanning-technology-used-humans-hired-on-amazon-mechanical-turk/ https://qz.com/1141695/startup-expensifys-smart-scanning-tec... (I don't file expenses often, but personally when I do so through Expensify, I find SmartScan so slow that I now assume all my "SmartScanned" receipts are going to a human.)
- baybal2 8y agoQuote from the article >How to start an AI startup >1. Hire a bunch of minimum wage humans to pretend to be AI pretending to be human >2. Wait for AI to be invented
- deleted 8y ago[deleted]
- chris123 8y agoTranslation: Lean Startup Concierge/Wizard of Oz MVP. For anyone wanting to learn or refresh about that, here's a descent article I just Googled up (I reviewed a few and picked this one): https://grasshopperherder.com/concierge-vs-wizard-of-oz-test/ https://grasshopperherder.com/concierge-vs-wizard-of-oz-test...
- vultour 8y agoHow do they handle bogus results from MTurk? I know people that tried to use it and had to stop because 95% of the "workers" just put meaningless data in hoping you don't notice and they get paid.
- JimmyAustin 8y agoIt depends on the task, but if you can get them to do multiple tasks in one, you can ask them to do a task you already know the answer to. If they get the known answer wrong, instant reject.
- PretzelFisch 8y agoCouldn't you just solve that by sending the job to multiple workers and comparing the results?
- shanghaiaway 8y agoThink about it.
- deleted 8y ago[deleted]
- vultour 8y agoThat's an obvious solution, but you might start approaching a point where it's actually cheaper to hire a dedicated person for it.
- srtjstjsj 8y agoThat doesn't solve the problem of a person being wrong.
- jpking 8y agoI consulted with a great company in this field and they also use a mix of OCR and humans. Difference is they have trained in-house staff, rather than farming it out to just anyone for the cheapest they can get.
- hyperrail 8y agoNot quite on topic, but I can't help noticing the overused word "quietly" in the title of the story: https://www.geekwire.com/2017/tech-news-sites-quietly-rely-word-create-drama-headlines-analysis-reveals/ https://www.geekwire.com/2017/tech-news-sites-quietly-rely-w... (This is a rare case where the word might be appropriate, though!)
- duggan 8y agoGlad to see other people also find it annoying. I went searching to see if someone had written about the phenomenon last year, but eventually concluded I was probably mad. Thanks!
- srtjstjsj 8y ago> Apparently whenever a tech company does anything without publishing a press release and running ads during Monday Night Football, tech news sites have decided that the best word to describe it is “quietly.” Yes, quietly means "without making noise". I don't know why geekwire is so breathless about using English language properly.
- justonepost 8y agoNot sure guardian understands how training AI works.
- maym86 8y agoThere is a difference between labeling training data and just using humans to do the work. Some things cannot be achieved yet even with lots of labeled training data but companies are pretending they have solved hard ML problems at a high level of performance when the technology and research aren't there yet.
- pacavaca 8y agoBut why should it matter for customers who does the job? I mean, if you don't tell anybody, and pretend it's 100% AI then it's bad, but if it "will eventually become AI", and your investors and everybody interested in the technical details know how it's actually done, then what's wrong? A true "AI" should be able to pass a Turing test, so for the customer, it should be indistinguishable, and shouldn't matter. Of course, the privacy concerns are there, but then again, if it's a real "AI", then it may be worse for the computer to read your data than for a random low paid worker ;)
- maym86 8y agoBecause the business costs don't scale well unless they can invent technology to remove the humans and for harder ML problems that currently isn't possible. The business is only based on being able to sell they hype of "AI" to investors.
- TeMPOraL 8y agoAsk yourself the reverse question - if they already have a working, useful service that's human-powered, why are they lying by saying it's done by AI? Answer: because they're trying to get things they're not entitled to - like better funding, better sales, more attention. In other words, they're trying to cheat other people out of their money or time.
- deleted 8y ago
- macinjosh 8y agoOne issue with Artificial Intelligence is that it is typically referred to and understood in a way that concludes it is similarly functional in its domain as actual (i.e. human) intelligence would be. In reality AI is more akin to artificial cheese. Artificial cheese is not cheese just made with different ingredients. It is something vaguely cheese like made in a way completely dissimilar to real cheese.
- sho 8y agoFake it 'til you make it!
- xamuel 8y agoAbsolutely unsurprising given the current state of hype. How to get rich: (A) Start a page that applies photoshop effects to user-uploaded pictures. (B) Secretly accomplish A using low-paid grunts. (C) Claim it's done with AI, obtain a billion dollars of VC money
- vtange 8y agoAt this rate every company should just start claiming their workers are human-lookalike cyborgs since being a plain-old honest company who doesn't lie about using human workers doesn't get the same boost as one using human workers but claiming the "AI" treatment.
- mehrdadn 8y agoWhat are some examples of companies claiming to use AI but instead actually using human workers?
- yorwba 8y agoMentioned in the article: Edison Software, Spinvox, X.ai, Clara, Expensify, Facebook.
- mehrdadn 8y agoNo... maybe I wasn't clear on this, but the article doesn't claim those companies do what I asking: - Edison Software: Their complaint is that engineers went some users' personal emails to "improve" a feature, and that this was a privacy violation. This is not addressing what I was asking. To me this means their AI really is doing the work by default, but that in cases where the AI doesn't behave well, they have humans intervene. Moreover, it's not clear to me that they ever claimed the work was fully AI-driven in the first place. - Spinvox: Again, same thing: "The ratio of humans to messages and humans to number of users is very, very low." - X.ai: I can't view the link behind a paywall so I don't know what their case was. - Clara: same as X.ai - Expensify: Again, same as Spinvox and Edison Software: "Expensify admitted that it had been using humans to transcribe at least some of the receipts it claimed to process using its “smartscan technology”." - Facebook: Did Facebook actually claim M was entirely AI-powered? The fact that humans were used isn't enough to answer my question of whether they were "claiming to use AI but instead actually using human workers". Note that I'm NOT defending these practices by any means, or suggesting that they're not privacy violations. All I'm saying is they don't answer my question, which was entirely about the use of AI, not about privacy violations. To hopefully clarify what I was looking for: I was looking for examples of companies that are explicitly advertising that their services are AI-powered, but actually using humans to do the heavy-lifting. Meaning I'm looking for a company that does much more than have humans go through user data to improve its existing AI or handle edge-cases. That humans sometimes occasionally become involved at some points to improve service is not enough -- the company needs to be more or less pretty-much-actively-lying about their use of AI when the work is being delegated to human workers. (I asked for examples of this because this seemed to be the criterion the parent comment had.)
- ErikAugust 8y agoJust the latest incarnation of the good old Mechanical Turk: https://en.wikipedia.org/wiki/The_Turk https://en.wikipedia.org/wiki/The_Turk
- zitterbewegung 8y agoOne of the services that you can use to implement pseudo-AI is also called that. See https://aws.amazon.com/documentation/mturk/ https://aws.amazon.com/documentation/mturk/
- nerdponx 8y agoInterestingly this service is also used to build the large data sets required to train certain ML models.
- deleted 8y ago[deleted]
- User23 8y agoAI is nonsense. Dijkstra was right. I'm not saying that silicon/mechanical intelligence isn't possible. I'm unaware of any physical law that precludes it. But what we currently call "AI" is just the pathetic fallacy run wild. All that said, multidimensional data-driven linear recognizers are pretty impressive.
- davnn 8y ago> AI is nonsense. Dijkstra was right. Define AI first. One of the first few lines on Wikipedia about AI: The scope of AI is disputed: as machines become increasingly capable, tasks considered as requiring "intelligence" are often removed from the definition, a phenomenon known as the AI effect, leading to the quip, "AI is whatever hasn't been done yet."
- deleted 8y ago[deleted]
- User23 8y agoI believe that intelligence is more than quantifiable. Von Neumann machines, no matter how complex, will never achieve intelligence. Again, to be completely clear, I’m not claiming machine intelligence is impossible, just that what we see presently isn’t it in any honest sense.
- yorwba 8y agoWhat do you even mean by "Von Neumann machines, no matter how complex, will never achieve intelligence."? If you mean machines that self-replicate, then there're plenty counterexamples around already (https://www.xkcd.com/387/ https://www.xkcd.com/387/). If you mean computers using the von Neumann architecture, then that's weirdly specific, since modern computers are at best vaguely inspired by that model, and GPUs in particular work very differently.
- deleted 8y ago[deleted]
- bencollier49 8y agoGreat to see the Guardian referencing back to Spinvox here, whose speech-to-text service turned out to be largely run be sweatshop workers in the Phillipines; and a warning from history: This shtick works as long as you can transition to AI. If not, then the service will become increasingly flaky until the business collapses.
- thaumasiotes 8y ago> a warning from history: This shtick works as long as you can transition to AI. If not, then the service will become increasingly flaky until the business collapses. The business model "use low-paid labor to service wealthy clients" seems a little more inherently stable than that. In most cases, nobody expects a collapse. Why in speech-to-text?
- edanm 8y agoSay you're not profitable, and raise money on the expectation that you can eventually lower costs and only then become profitable. If you then find out you can't lower costs (i.e. you can't automate something you could, and keep having to rely on more costly labor), then you eventually collapse.
- randomsearch 8y agoUber
- specialist 8y agoUber, Airbnb, others get their "partners" to provide the working capital. This is a new take on the "value added reseller" business model. (I don't know what else to call it. Multi-level marketing?) For instance, Autodesk's dealer channel covered the costs of marketing, sales, technical support, training, etc. While they kept the sweet nectar of profits for themselves.
- 8y ago
- gaius 8y agoI like the term “artificial artificial intelligence” to describe this model
- joejerryronnie 8y ago"The rise of 'pseudo-AI': how tech firms quietly use humans to do bots' work" Does this include Uber's human drivers?
- nradov 8y agoThis is a good way to quickly build an MVP to gauge customer demand before incurring the time and expense of building a real scalable product.
- tzahola 8y agoSo, deceiving your customers about how their data is being handled is a “good MVP”. With this much cynicism you must be an “enterpreneur”.
- nradov 8y agoWhere is the deception? Why should the customers care how the service is implemented on the back end? Unless the service lies and claims the data will never be seen by humans then they're not doing anything unethical. All that matters is whether customers are getting value from it.
- lordnacho 8y agoSure, if you present it that way, it's fine. As in "I'll do xyz for you, somehow". If you say you're taking people from A to B in a motor-powered cab but you actually come to pick them up in a rickshaw, that's wrong. People will naturally form expectations about the ride based on what you say.
- tzahola 8y agoBecause if a service offers to automatically tag my photos, I don’t expect random people looking at them. In fact, I don’t want anyone looking at my family photos other than those whom I explicitly gave permission to do so. Same applies to my voice recordings. Same applies to my receipts. Same applies to my health data.
- nradov 8y agoUnless your data is encrypted using keys that only you control then you have to assume that random people are looking at it. That is inherent in the nature of SaaS.
- Wingman4l7 8y agoSo, the worst of both worlds -- inflexible responses that aren't even scalable to demand.
- dusieaw 8y agoWhile deceiving your customers is maybe just wire fraud, deceiving your investors about this is securities fraud.
- sorokod 8y agoEchoes of theranos here. Putting AI aside, aren't these companies swindling their investors?
- shawn 8y agoSee also: the front page of HN. You didn’t think that was an algorithm choosing which stories you see, did you? :) It works well. And considering how much effect HN has on our daily lives, it’s neat that the algorithm reduces to “this human has good taste.” I see no reason why HN won’t be around for decades. And that’s exciting. It’s the only newspaper that feels like a community. This used to feel strange — if you think about the position of influence and power HN commands, it’s hard to feel ok about ceding control to a handful of people, no matter how benevolent. And on certain topics this has indeed been an issue —- if a certain behavior or conversation isn’t tolerated on HN, it’s easy to feel like you’re a misfit who doesn’t belong in tech, or even that you don’t identify with the tech community. One way to become comfortable with this situation is to trust incentives, not people. The only way HN wins is if HN stays fascinating. It’s why most of us keep coming back: to monitor the pulse of the tech scene, or to learn physics factoids[1], or to spot a new tool that saves you hours. And that’s why HN can’t be fully automated. Which stories fascinate you? If you could write an algorithm to generate an endless stream of interesting content, you’d have invented an AI with good taste. And for the moment, that’s beyond our capabilities.[2] [1] As the earth orbits the sun, the area swept out by the triangle formed by the sun->earth->earth3WeeksLater is equal to the area of the triangle during the next three weeks, and the next three weeks after that, and so on. Equal time periods = equal areas. That’s why the earth moves faster when it’s closer to the sun: it has to cover a greater distance in order to sweep out the same area as during the previous 3 weeks. This gives you an intuition about how gravity behaves. And with a slight tweak it also holds true for e.g. an ice skater twirling around. If you stick your leg out while spinning, your leg sweeps out more area than when it’s near your body. That’s why you spin more slowly: if you’re sweeping out more area per time period, your rotation must slow down proportionally. (This is conservation of angular momentum, dressed up in intuitive clothing.) [2] This is in contrast with sites like YouTube, which give an endless stream of interesting videos. Part of HN’s strength is it’s unified front page. We all see the same thing. And that’s why writing an algorithm to make the front page interesting is much harder than creating a personalized neural network trained to show you all the interesting things you haven’t seen yet.
- pm24601 8y agoYoutube's algorithm is designed to give the viewer stuff similar to what they have already seen. Be it Goto Conference videos, Nazi rants, or wacky people doing fingernail designs. Youtube's AI is not designed take chances and offer up something 'surprising'. 'Surprising' might be offensive not enlightening.
- amelius 8y agoThis seems completely logical to me. A new business needs humans to train their AI. So why not use them to bootstrap your business while you're at it? When we have transfer learning or one-shot learning, it will be a different story.
- dalbasal 8y agoI think this article may be overstating a little. First, the prototyping/bootstrapping with humans is not a terrible idea. It takes a hurdle, and moves it down the line a bit. You still need to get over that hurdle. It's still a potential failure point, but it's not an irrational approach. There are a ton of businesses started on the basis of. 1. make free service 2. get 1bn customers 3. ??? 4. profit Twitter, Google, Facebook... They deferred that little "make money" hurdle until they were ready for IPOs. Obviously, this opens a door for stupid plans, where the AI task will not be achievable. But, the "monetisation step" has comparable problems too. The deception is a problem though, building companies based on deception is a problem and will probably lead to a nasty crash. Second, if the goal is a result rather than to use AI... Say you're trying to solve some specific transcription use case, like Spinvox or Expensify. First, the problem seems solvable or soon to be solvable. Second, it's helpful to have a stream transcription attempts coming to you with real life accuracy requirements. Third, it's not a bad way of approaching Human-AI hybrid systems. Start with 100% human labour and gradually hybridise. Maybe you never solve the hard problems that will get you to 100% AI, but you find ways of leveraging human labour to solve it efficiently. If what they reach is a tech/process that allows a person to transcribe 10k words per hour... that's pretty good too.
- gaius 8y agoFirst, the prototyping/bootstrapping with humans is not a terrible idea Well, it might be. Are human drivers really prototyping/bootstrapping self-driving cars? We are deeply into the territory of Moravec’s Paradox here.
- dalbasal 8y agoInteresting, care to elaborate? For a lot of NN/ML applications, they magic ingredient is "humans" and a record of humans doing something enough times to describe statistically. AI sign recognition, sentence completion or checker playing is very often based on estimates of "what would a human do." "Would a human say this photo contains cats", is really how a lot of ML interprets the question "where is my cat"?
- erikb 8y agoI can already see how AI assistants call AI assistants to book an AI driven service for their AI bosses, to find out 0.3 seconds later that their AI boss being an AI doesn't need that service, calling again to remove the booking. Nobody notices that this happens, because no human is involved in the actual conversation. But of course both of these conversations lead to events where data needs to be transfered from the calendars to finance, billing etc. These transfers are done by humans of course because AI would be too expensive for that. I see people going to work 16 hours a day handling transferring these transactions related to haircuts for AI bosses that don't physically exist (and therefore don't need haircuts), from one database to the other. The AI boss doesn't see the need for 8h workdays, because he's not human. And the money for the work doesn't need to be enough to afford living, right? The AI government will pay a base income to anybody anyways.
- adamdrake 8y agoI gave a lecture a couple of months ago called Developing your AI BS Detector addressing this very topic. https://adamdrake.com/developing-your-ai-bs-detector.html https://adamdrake.com/developing-your-ai-bs-detector.html The main thesis is that there seem to be more and more companies out there solving interesting problems, which by itself is great, but they're bolting a lot of wording on top talking about AI. Most of this seems to be an attempt to differentiate themselves in the market and access funding and I find it incredibly dishonest. The whole discussion around AI these days has become so tainted by scheisters trying to attract funding and attention that I actively try to distance myself from association. We need to focus a lot more on Intelligence Amplification (IA) (https://en.wikipedia.org/wiki/Intelligence_amplification https://en.wikipedia.org/wiki/Intelligence_amplification), i.e., building tools for humans to become more productive, and less on AI. Douglas Engelbart and others had this figured out 50 years ago (see: the Mother of All Demos). The AI hype is dangerous, since it will no doubt lead to the trough of disillusionment.
- dfee 8y agoWell the idea is that all emerging ideas with broad appeal go through the Hype Cycle. I don’t know that AI is different or dangerous in that regard.
- adamdrake 8y agoI'm not of the opinion that it is dangerous as an idea, but rather that the intentional deception I see on the AI topic is dangerous (not to mention unethical). I can't think of a single example of an "AI" company I talked with who did not know that they were explicitly exaggerating their claims and capabilities for the express purpose of attracting funding and fueling the hype fire. The solid tech startups I've seen are focused on the problem they are solving for customers rather than the tooling (AI).
- mrhappyunhappy 8y agoNot to mention that AI as we define it does not actually exist yet. Anyone who uses that term is doing so dishonestly. Show me any intelligent code and I'll shut up. Until then I call BS on anything that's claims to be powered by AI.
- deepGem 8y agoAm glad this is highlighted now. Back in 2015, when we wanted to build an meeting scheduling bot, we naively thought we could use only machines to get the job done. 3 months later we realized that was no way feasible, not then not in the next 10 years. So the common feedback we got was to just use low cost labor in India/Phillipines to get the job done. To us, that was a no-go because we kept privacy as the top criterion for doing anything with people's inboxes. Even after obfuscation, we didn't want any human to read or parse soeone's private messages. So we dropped the idea and shut shop. Sure we failed, but at least we were true to our conscience. Another way to have tackled this problem was to just go down the research route and build a product once the ML was fully baked, but VCs won't fund such adventures. To get VC funding, we had to lie through our teeth, which was a total no-go. I am not bringing the righteous argument, but for once I feel really good that our viewpoints held then are corroborated now, some kind of confirmation bias kicking in.
- evrydayhustling 8y agoIt's great that you stuck to your guns, but there's another ethical path forward: transparency. Many companies already pay third party employees to look at their schedule, so it's not a non-starter. And there are a few VCs out there that understand training costs for AI and are willing to engage with a journey that includes them - as long as the cards are on the table. What we need is a set of accounting metrics about the cost of training and the rate of improvement, so that VCs can get comfy with how to make projections rather than choosing between buying snake oil and nit participating in the AI Dev cycle. PS - emphatically not taking aim here at your specific decision, OP. Startups have different opportunities and interests, and these decisions are tough. I'm sure you know better than I do whether the ethical wizard-of-oz model above is relevant to you in particular.
- deepGem 8y agoThank you. The latter point about accounting metrics that you mention is very valid. I will think on these lines. I am very much interested in reaching out to VCs who are supportive and understand training costs for AI. If you know of any please do point out.
- rdlecler1 8y agoX.ai barely works and it was pretty obvious that humans are behind it. It would make so many one-time non-systematic errors when there was almost no variance in the text.
- malmsteen 8y agoSounds a bit like the stripe (or is it square) story where every bank trnsaction was humanly done before they got the rights to automate it. I'm not surprised and i find it considerably smart considering all the money pouring into everything with a a machine learning buzzword attached to it.
- nostrademons 8y agoA lot of this comes from the availability of cheap hype-driven capital. The way it's supposed to work is that AI lets you replace expensive human labor with cheap computers so that a job that might've cost $10 in wages instead costs $0.0001 in server time. The way it actually works is that you tell a bunch of investors that you've got an AI that reduces the cost of X by a factor of 10,000, they give you $100M in capital, and now you have 10,000x the amount of money available, so you can pay the original $10 in wages and worry about how to actually reduce the cost of X by 10,000 later, usually once it's clear that no more funding is forthcoming. This is not really a healthy state for the economy, but seems to be how every technology wave happens. The real innovation will come when the cheap money dries up.
- wolf550e 8y agoWhat they do could be a viable thing to do, if getting your customers to spend their own money to switch from a manual system with spreadsheet files sent over whatsapp to using your API will enable you to be the only player who has a huge dataset with real customer data, which you can use to understand which subset can actually be automated using existing technology, and automate only that using deep learning or whatever (for which you want the biggest dataset you can get), and keep doing the other stuff manually. You win by making people switch to your API, getting network effects, etc. If you don't cut corners in the way you do the manual tasks and you charge enough to cover your costs, and enough tasks can be automated so that using your service is not more expensive than not using your service, you're ok. But you probably don't have the margins the VCs want.
- pm24601 8y agoIt's working for Uber...still waiting for those autonomous taxis that don't run people over....
- wmij 8y agoSome colleagues of mine talk about the prevalence of companies doing this man behind the curtain thing all the time while claiming that there solution is AI/cognitive. When we come across examples of this happening we just refer to that Seinfeld Moviefone episode and say 'Why don't you just tell me [foo]' - or whatever the "AI" is trying to solve. https://www.youtube.com/watch?v=gSQ6q_rGpI8 https://www.youtube.com/watch?v=gSQ6q_rGpI8 It never fails to get a good laugh. Anyway, I think that human interaction for the training aspects of AI to prepare data, label examples, test models, etc. is really hard to automate entirely and should be considered part of the development process. The execution side of an application component that is marketed as AI/cognitive however is not true AI unless it is totally free of human interaction.
- kashyapc 8y agoEven if the program was totally "free of human interaction", it shouldn't be marketed as "cognitive"—an exceptional word that requires exceptional evidence, when used in context of software. Otherwise, it's all bovine manure.
- pm24601 8y agoIt was my understanding that all AI technology/approaches need some sort of training. And that this training required some sort of human intervention to grade "correctness" In companies that I have worked for that want to use AI; they always have a clause in the privacy agreement allowing employees to look at users' content in order to determine how well the algorithm was doing. There are some differences: 1. PII was redacted (to the extent possible); 2. Customer could opt-out.; 3. the AI wasn't core to the service. That said - sci-fi AI does seem to require humans behind the curtain. Personally, I am more comfortable with a human being my virtual "AI" assistant than I am with real AI. I feel a human is less likely to make a mistake that will cause me personal damage, there is more responsibility/liability to doing a good job.