4 ms·
> In a snake-eating-its-own-tail irony, a 2023 analysis found that between 33% and 46% of workers on the platform were using large language models to complete t
by CodesInChaos 3mo ago
> In a snake-eating-its-own-tail irony, a 2023 analysis found that between 33% and 46% of workers on the platform were using large language models to complete their tasks,
I assume AI use by workers has risen to the point where it renders Mechanical Turk pointless.
- moralestapia 3mo agoYeah, I was doing this kind of Artificial Artificial Artificial Intelligence back in 2012 to make some extra $$$. Glad they finally "patched" that hole ^^.
- pc86 3mo agoYou were using LLMs in 2012?
- pixel_popping 3mo agoFiverr-5.5 was the leading model back then.
- simlevesque 3mo agoThey were faking artificial intelligence by using real individuals.
- HPsquared 3mo agoThat's just Artificial Artificial Intelligence, the triple negative implies they built an automated system to impersonate humans who impersonate an automated system (which ultimately imitates a human).
- moralestapia 3mo agoNot LLMs. (Useful) LLMs came to the market around 2022.
- subarctic 3mo agoArtificial AI = stuff like mechanical turk where they get humans to do stuff computers can't do and make it look like it's "AI" Artificial Artificial Intelligence = using computers to do mechanical turk jobs
- moralestapia 3mo agoYou wrote the same thing twice, hehe. But the point gets across.
- icepush 3mo agoArtificial Artificial Artificial intelligence is when the chat bot is out of capacity, so a person in India is writing the response that gets returned by the LLM which gets pasted into Mechanical Turk.
- deleted 3mo ago[deleted]
- moralestapia 3mo ago"Artificial AI" and "Artificial Artificial intelligence" are the same thing. Come on. This site can do better.
- vitally3643 3mo agoyes, this site can do a lot better than nitpicking acronyms
- imtringued 3mo agoYou're the one wasting time with another incorrect comment. This point is that AAAI and AAI are not the same thing.
- DonHopkins 3mo agoYou can take that to the Automatic ATM Machine.
- HPsquared 3mo agoLiving, Low-income Minions?
- moralestapia 3mo agoThis is my main argument as to why (people with) AI will not take over the world. Cheap, disposable, on-demand intelligence has existed for millennia. If anything, AI is more of an equalizer.
- skt5 3mo agoThis likely means those consuming the outputs of Mechanical Turk don't have a good way to measure the value (aka quality) of the outputs. If they did - then they shouldn't care whether it's a human or a LLM. And if it's a LLM - then the cost will roughly correlate to the MIN(cost of the LLM, cost of a human) to do the task.
- AndrewOMartin 3mo agoI think the "state of the art" of measuring the quality of outputs was to send the same task to multiple "agents" and only accept answers if over a certain amount agree. With some human review and reputation scoring sprinkled on top. It was a while since I was in this field though
- skt5 3mo agoThis approach does work when there's a clear answer but what about tasks where the correct answer is multi-modal? Incentivizing agreement works only for tasks where there's clear answers.
- renegade-otter 3mo agoThe problem is bigger. Outside of coding, there is no real way to reinforce a model with pass/fail cycles until it stops hallucinating. This is why customer service uses will always have a problem. This compounds as you chain agents together. It's like the speed of light - to get to that point, you need exponentially more energy, and you will never ever get there.
- throw310822 3mo ago> then they shouldn't care whether it's a human or a LLM. I imagine that the whole point of posting a task to Mechanical Turk nowadays is that you want it to be completed by humans. Either because you are after the small discrepancy between AI and human performance, or because humans are the object of your investigation.
- 6510 3mo agoI don't see why I would care how they do the job. Just do the job, I have other things to do.
- tsimionescu 3mo agoIf you get someone to mow your lawn, do you not care if (a) they use an automated machine that you could rent by the hour for far less, and/or (b) at the end your lawn is actually in a good shape?
- 6510 3mo agoI have very low expectations for $2 per hour. If I would feel the need to use such service I would expect them to cut all corners. If you have a subscription for a decent LLM, know how to get my data into it and know how to write a prompt that does the job you might have 3 skills I don't or I might not have time to do it. If the lawn looks great you get to do it again. I could ask the guy you send how much you are paying him and I could ask you how much the mower costs but it wouldn't necessarily be a good use of my time.
- tsimionescu 3mo agoSay you notice they come in the morning, put a small machine on the grass, hit a button, and leave and come back 4h later to pick up the machine and charge you - wouldn't you be at least curious to see how much this machine costs? Or if there was another company that would lease such machines for much less than what you paid per hour, wouldn't you possibly prefer to contract them, even if you may have to pick up and drop off the auto lawn mower yourself? And conversely, say that the person or machine that you paid to mow the lawn instead drenches your yard in herbicide and then salts the earth. Or vice versa, it starts planting weed seeds, or brings a bunch of ticks in the grass etc. You would probably not be happy to let this process finish and then say "oh well, guess I won't be hiring them again!" and just move on.
- 6510 3mo ago
- unparagoned 3mo agoI guess that’s the dead internet theory. People are trying to train llms using mt, but just training on itself.