3 ms·

I believe that LLMs will automate most of our data entry/copy/transformation work. 80% of the world's data is unstructured and scattered across formats like HTM

I believe that LLMs will automate most of our data entry/copy/transformation work. 80% of the world's data is unstructured and scattered across formats like HTML, PDFs, or images that are hard to access and analyze. Multimodal models can now tap into that data without having to rely on complex OCR technologies or expensive tooling. If you go to platforms like Upwork, there are thousands of VAs in low-cost labor countries that do nothing else than manual data entry work. IMO that's a complete waste of human capital and I've made it my personal mission to automate such tedious and un-creative data work with https://kadoa.com https://kadoa.com.

ishan0102 3y ago
Yup, that's my long term goal. I want an "anything API" that brings structure to anything on the web.
kristopolous 3y ago
I was thinking what the payoff would be to pose as human for these terrible pay click jobs and then assign them to an LLM en masse. There's an arbitrage there ... it may be a good strategy. I heard recently "click-work" works out to about $4/hr* If you could do that x50, passively, it's a fine income. * - see https://journals.sagepub.com/doi/full/10.1177/14614448231183942 https://journals.sagepub.com/doi/full/10.1177/14614448231183... or listen to https://kpfa.org/episode/against-the-grain-october-30-2023/ https://kpfa.org/episode/against-the-grain-october-30-2023/ ... it's a fascinating study. Terrible pay (way below minimum wage) but surprisingly high worker satisfaction. The users seem to view it as entertainment essentially categorizing it as casual gaming. The "asshole innovator" in me wonders if one could simply make it more entertaining and forego paying the user entirely.
- hubraumhugo 3y ago
  Interesting. Instead of doing the click work manually, microworkers will just instruct and guide multiple GPTs.
  - kristopolous 3y ago
    maybe. A lot of modern clickwork is actually model training and there is a model-collapse phenomena (https://arxiv.org/abs/2305.17493 https://arxiv.org/abs/2305.17493) which means that it should be banned for such work. I bet a number of clever people on the platforms are already trying to instrument AI to do the work regardless - it's pretty close to "free money" if you can pull it off and not get caught and at a spigot size where there's no real serious consequences if you do.
- ishan0102 3y ago
  Yeah this seems easy to build but would rather work on making tools that improve accessibility 10x

ishan0102 3y ago

Yup, that's my long term goal. I want an "anything API" that brings structure to anything on the web.

kristopolous 3y ago

I was thinking what the payoff would be to pose as human for these terrible pay click jobs and then assign them to an LLM en masse. There's an arbitrage there ... it may be a good strategy. I heard recently "click-work" works out to about $4/hr* If you could do that x50, passively, it's a fine income. * - see https://journals.sagepub.com/doi/full/10.1177/14614448231183942 https://journals.sagepub.com/doi/full/10.1177/14614448231183... or listen to https://kpfa.org/episode/against-the-grain-october-30-2023/ https://kpfa.org/episode/against-the-grain-october-30-2023/ ... it's a fascinating study. Terrible pay (way below minimum wage) but surprisingly high worker satisfaction. The users seem to view it as entertainment essentially categorizing it as casual gaming. The "asshole innovator" in me wonders if one could simply make it more entertaining and forego paying the user entirely.

hubraumhugo 3y ago
Interesting. Instead of doing the click work manually, microworkers will just instruct and guide multiple GPTs.
- kristopolous 3y ago
  maybe. A lot of modern clickwork is actually model training and there is a model-collapse phenomena (https://arxiv.org/abs/2305.17493 https://arxiv.org/abs/2305.17493) which means that it should be banned for such work. I bet a number of clever people on the platforms are already trying to instrument AI to do the work regardless - it's pretty close to "free money" if you can pull it off and not get caught and at a spigot size where there's no real serious consequences if you do.
ishan0102 3y ago
Yeah this seems easy to build but would rather work on making tools that improve accessibility 10x