23 ms·

When will we see a form of "arbitrage" where someone uses ChatGPT to do the work of an MTurk and pockets the difference? Will that lead to MTurk prices convergi

When will we see a form of "arbitrage" where someone uses ChatGPT to do the work of an MTurk and pockets the difference? Will that lead to MTurk prices converging to ChatGPT prices?

ftxbro 4y ago
Even before LLMs, MTurk has been in a war with the botters, and my understanding is that the MTurkers have to periodically do captchas but many still use bots or various automated tools or utilities. The LLMs and especially the multimodal ones will only make the bots even better and break the captchas even harder. MTurk's business model specifically wants human workers categorized into fine grained categories so they will try to keep fighting the bots however they can.
- bogwog 4y ago
  Captchas are futile. I remember many years ago when I was in highschool, I came across a shady job posting on an eBay listing. The work involved solving captchas. There was a web page they set up that just displayed one captcha after another, and it was your job to sit there solving them. I didn’t do it because I can’t imagine a worse hell than having to solve so many captchas, but it opened my eyes to how creative botters can be. I can imagine someone doing a similar setup for mturk, where all you need to do is remotely solve a captcha on your phone every few hours/minutes while ChatGPT does its thing. I also wouldn’t be surprised if that already exists.
- elif 4y ago
  Is there such a thing as a captcha in the age of GPT4? Maybe openAI put safety barriers on their model... But surely the botters have a model without that by now?
  - arbol 4y ago
    If you have to select the matching images from 9 images and you are feeding each of those images to GPT4 and asking "is this a <TARGET>?", I don't think you're going to get a response back to complete the captcha in time (e.g. <30s). This will change as the models advance.

23 ms·

When will we see a form of "arbitrage" where someone uses ChatGPT to do the work of an MTurk and pockets the difference? Will that lead to MTurk prices convergi

by andruby 4y ago

When will we see a form of "arbitrage" where someone uses ChatGPT to do the work of an MTurk and pockets the difference? Will that lead to MTurk prices converging to ChatGPT prices?

ftxbro 4y ago
Even before LLMs, MTurk has been in a war with the botters, and my understanding is that the MTurkers have to periodically do captchas but many still use bots or various automated tools or utilities. The LLMs and especially the multimodal ones will only make the bots even better and break the captchas even harder. MTurk's business model specifically wants human workers categorized into fine grained categories so they will try to keep fighting the bots however they can.
- bogwog 4y ago
  Captchas are futile. I remember many years ago when I was in highschool, I came across a shady job posting on an eBay listing. The work involved solving captchas. There was a web page they set up that just displayed one captcha after another, and it was your job to sit there solving them. I didn’t do it because I can’t imagine a worse hell than having to solve so many captchas, but it opened my eyes to how creative botters can be. I can imagine someone doing a similar setup for mturk, where all you need to do is remotely solve a captcha on your phone every few hours/minutes while ChatGPT does its thing. I also wouldn’t be surprised if that already exists.
- elif 4y ago
  Is there such a thing as a captcha in the age of GPT4? Maybe openAI put safety barriers on their model... But surely the botters have a model without that by now?
  - arbol 4y ago
    If you have to select the matching images from 9 images and you are feeding each of those images to GPT4 and asking "is this a <TARGET>?", I don't think you're going to get a response back to complete the captcha in time (e.g. <30s). This will change as the models advance.