3 ms·

This is actually no different than for humans once you get past the familiar. It's like the famous project management tree story: https://pmac-agpc.ca/project-

This is actually no different than for humans once you get past the familiar. It's like the famous project management tree story: https://pmac-agpc.ca/project-management-tree-swing-story https://pmac-agpc.ca/project-management-tree-swing-story If anything, LLMs have surprised at much better they are than humans in understanding instructions for text based activities. But they are MUCH worse than humans when it comes to creating images/videos.

deleted 2y ago
[deleted]
barotalomey 2y ago
> If anything, LLMs have surprised at much better they are than humans in understanding instructions for text based activities. That's demonstrateably false, as proven by both OpenAI's own research [1] and endless independent studies by now. What is fascinating is how some people cling on false ideas about what LLM is and isnt. Its a recurring fallacy that's bound to get it's own name any time soon. 1: https://news.ycombinator.com/item?id=43155825 https://news.ycombinator.com/item?id=43155825
- otabdeveloper4 2y ago
  People think coding is the difficult part of programming. Which it isn't, just like pressing keys isn't the difficult part of being a pianist. If they invented a machine to press piano keys with superhuman speed and precision that wouldn't make you a musician.
- kenjackson 2y ago
  You’re comparing an LLM to expert programmers. Compare an LLM on the same task versus the average college student. And try it for a math problem. A poetry problem. Ask it a more complex question about history or to do an analysis of an essay you wrote. Put it this way — I’m going to give you a text based question to solve and you have a choice to get another human to solve it (randomly selected from adults in the US) or ChatGPT, and both will be given 30 minutes to read and solve the problem — which would you choose?
  - aleph_minus_one 2y ago
    > Put it this way — I’m going to give you a text based question to solve and you have a choice to get another human to solve it (randomly selected from adults in the US) or ChatGPT, and both will be given 30 minutes to read and solve the problem — which would you choose? You wouldn't randomly selected an arbitrary adult from the USA to do a brain surgery on you, so this argument is rabulistic.
    - kenjackson 2y ago
      Brain surgery requires a license. But I do expect an arbitrary adult to be able to follow instructions. Ok. How about you give me a text based task where you would pick the random adult over the LLM?
      - aleph_minus_one 2y ago
        > Brain surgery requires a license. This is rather a red-tape problem. :-)
      - nyclounge 2y ago
        I think you and the parent may be talking about 2 different things. Do I want to use an LLM to do it from business owner perspective? Yeah probably it is cheaper and more convenient. Which one I want to use, depending the problem we are solving here right? I'm more concern about the integrity of the current digital infrastructure. In that sense I would NOT trust ANY thing really important to anything digital, much less to LLM. Can I use it for exploration then require an actually human expert approval/edit. Absolutely! As long as the digital doesn't result in significant physical or financial damage. Edit: and for HN ppl, of course the LLM will have have to be open weight and all and run locally in a air gaped GPU, preferably in a Faraday cage.
    - daveguy 2y ago
      I would chose a random person from my company that was hired to work in that domain to solve problems in that domain. Yes, regardless of the position. Accountant in the domain, yes. Office organizer in the domain, yes. Essentially anyone in the domain, yes. No offense, but by restricting the selection to the general human population you're setting a low bar for LLMs here.

deleted 2y ago

[deleted]

barotalomey 2y ago

> If anything, LLMs have surprised at much better they are than humans in understanding instructions for text based activities. That's demonstrateably false, as proven by both OpenAI's own research [1] and endless independent studies by now. What is fascinating is how some people cling on false ideas about what LLM is and isnt. Its a recurring fallacy that's bound to get it's own name any time soon. 1: https://news.ycombinator.com/item?id=43155825 https://news.ycombinator.com/item?id=43155825

otabdeveloper4 2y ago
People think coding is the difficult part of programming. Which it isn't, just like pressing keys isn't the difficult part of being a pianist. If they invented a machine to press piano keys with superhuman speed and precision that wouldn't make you a musician.
kenjackson 2y ago
You’re comparing an LLM to expert programmers. Compare an LLM on the same task versus the average college student. And try it for a math problem. A poetry problem. Ask it a more complex question about history or to do an analysis of an essay you wrote. Put it this way — I’m going to give you a text based question to solve and you have a choice to get another human to solve it (randomly selected from adults in the US) or ChatGPT, and both will be given 30 minutes to read and solve the problem — which would you choose?
- aleph_minus_one 2y ago
  > Put it this way — I’m going to give you a text based question to solve and you have a choice to get another human to solve it (randomly selected from adults in the US) or ChatGPT, and both will be given 30 minutes to read and solve the problem — which would you choose? You wouldn't randomly selected an arbitrary adult from the USA to do a brain surgery on you, so this argument is rabulistic.
  - kenjackson 2y ago
    Brain surgery requires a license. But I do expect an arbitrary adult to be able to follow instructions. Ok. How about you give me a text based task where you would pick the random adult over the LLM?
    - aleph_minus_one 2y ago
      > Brain surgery requires a license. This is rather a red-tape problem. :-)
    - nyclounge 2y ago
      I think you and the parent may be talking about 2 different things. Do I want to use an LLM to do it from business owner perspective? Yeah probably it is cheaper and more convenient. Which one I want to use, depending the problem we are solving here right? I'm more concern about the integrity of the current digital infrastructure. In that sense I would NOT trust ANY thing really important to anything digital, much less to LLM. Can I use it for exploration then require an actually human expert approval/edit. Absolutely! As long as the digital doesn't result in significant physical or financial damage. Edit: and for HN ppl, of course the LLM will have have to be open weight and all and run locally in a air gaped GPU, preferably in a Faraday cage.
  - daveguy 2y ago
    I would chose a random person from my company that was hired to work in that domain to solve problems in that domain. Yes, regardless of the position. Accountant in the domain, yes. Office organizer in the domain, yes. Essentially anyone in the domain, yes. No offense, but by restricting the selection to the general human population you're setting a low bar for LLMs here.