4 ms·

If a broken tool is useful, do you not use it because it is broken ? Overpowered LLMs like GPT-4 are both broken (according to how you are defining it) and use

If a broken tool is useful, do you not use it because it is broken ? Overpowered LLMs like GPT-4 are both broken (according to how you are defining it) and useful -- they're just not the idealized version of the tool.

freejazz 3y ago
Maybe not if its the case that your use of the broken tool would result in the eventual undoing of your work. Like, lets say your staple gun is defective and doesn't shoot the staples deep enough, but it still shoots. You can keep using the gun, but it's not going to actually do its job. It seems useful and functional, but it isn't and its liable to create a much bigger mess.
- rkeene2 3y ago
  So to continue the analogy, if the staple gun is broken and it requires you to do more than a working (but non-existent) staple gun BUT less work than doing the affixment without the broken staple gun, you would or would not use it ?
  - windowshopping 3y ago
    But nobody said they wouldn't use it. You said that. You came up with this idea and then demanded other people defend it. I don't know why "critiquing the tool" is being equated to "refusing to use the tool." I don't like calling something a strawman, because I think it's an overused argument, but...I mean...
    - rkeene2 3y ago
      I didn't come up with it nor ask anyone to defend it. I asked a different question about usefulness, and about what it means to him for something to be "broken". My point is that the attempt to critique it was a failure. It provided no critique. It was incomplete at the very least -- it assigned it the label of broken, but didn't explain the implications of that. It didn't define at what level of failure it would need to be to valuable. Additionally, I didn't indicate whether or not he would refuse to use it -- specifically because I didn't know, because he didn't say. We all use broken tools built on a fragile foundation of imperfect precision.
  - freejazz 3y ago
    I think you are missing the point. If I do use it, then my result will be a broken and defective product. How exactly is that not clear? That's the point. It might not be observable to be, but whatever I'm affixing with the staple gun will come loose because its not working right and not sinking the staples in deep enough... If I don't use it, then the tool is not used and provided no benefit...
    - rkeene2 3y ago
      It's not clear because it is false and I believe I can produce a proof if you are willing to validate that you accept my premise. Your CPU, right now, has known defects. It will produce the wrong outputs for some inputs. It seems to meet your definition of broken. Do you agree with that premise ?
      - freejazz 3y ago
        One has nothing to do with the other. There's no rule about all broken tools because they can be broken in different ways. What's so difficult about my hypothetical? I laid it all out for you.
        rkeene2 3y ago
        I assumed you understood we reached the end of the usefulness of your hypothetical to the original analogy since, as you said, the tools can be broken in different ways. I tried to introduce a scenario that was more applicable and less theoretical so that we could discuss those particular points. If we do somehow try to apply your analogy, it would indicate that the LLM output is flawed in a way we cannot scrutinize -- the hidden failures that we aren't detecting (why? It's not specified, I am assuming because we didn't check to see if the tool was "broken" and not meeting some unspecified quality-level; that is, it's an unknown unknown failure mode). This doesn't really comport with the LLM scenario, where the output is fully viewed, and the outputs are widely understood (that is it is a known failure mode). This is more closely related to a computing service -- of which you are an active user of. You are using a "broken" computer right now, according to your definition of broken correct ?

freejazz 3y ago

Maybe not if its the case that your use of the broken tool would result in the eventual undoing of your work. Like, lets say your staple gun is defective and doesn't shoot the staples deep enough, but it still shoots. You can keep using the gun, but it's not going to actually do its job. It seems useful and functional, but it isn't and its liable to create a much bigger mess.

rkeene2 3y ago
So to continue the analogy, if the staple gun is broken and it requires you to do more than a working (but non-existent) staple gun BUT less work than doing the affixment without the broken staple gun, you would or would not use it ?
- windowshopping 3y ago
  But nobody said they wouldn't use it. You said that. You came up with this idea and then demanded other people defend it. I don't know why "critiquing the tool" is being equated to "refusing to use the tool." I don't like calling something a strawman, because I think it's an overused argument, but...I mean...
  - rkeene2 3y ago
    I didn't come up with it nor ask anyone to defend it. I asked a different question about usefulness, and about what it means to him for something to be "broken". My point is that the attempt to critique it was a failure. It provided no critique. It was incomplete at the very least -- it assigned it the label of broken, but didn't explain the implications of that. It didn't define at what level of failure it would need to be to valuable. Additionally, I didn't indicate whether or not he would refuse to use it -- specifically because I didn't know, because he didn't say. We all use broken tools built on a fragile foundation of imperfect precision.
- freejazz 3y ago
  I think you are missing the point. If I do use it, then my result will be a broken and defective product. How exactly is that not clear? That's the point. It might not be observable to be, but whatever I'm affixing with the staple gun will come loose because its not working right and not sinking the staples in deep enough... If I don't use it, then the tool is not used and provided no benefit...
  - rkeene2 3y ago
    It's not clear because it is false and I believe I can produce a proof if you are willing to validate that you accept my premise. Your CPU, right now, has known defects. It will produce the wrong outputs for some inputs. It seems to meet your definition of broken. Do you agree with that premise ?
    - freejazz 3y ago
      One has nothing to do with the other. There's no rule about all broken tools because they can be broken in different ways. What's so difficult about my hypothetical? I laid it all out for you.
      - rkeene2 3y ago
        I assumed you understood we reached the end of the usefulness of your hypothetical to the original analogy since, as you said, the tools can be broken in different ways. I tried to introduce a scenario that was more applicable and less theoretical so that we could discuss those particular points. If we do somehow try to apply your analogy, it would indicate that the LLM output is flawed in a way we cannot scrutinize -- the hidden failures that we aren't detecting (why? It's not specified, I am assuming because we didn't check to see if the tool was "broken" and not meeting some unspecified quality-level; that is, it's an unknown unknown failure mode). This doesn't really comport with the LLM scenario, where the output is fully viewed, and the outputs are widely understood (that is it is a known failure mode). This is more closely related to a computing service -- of which you are an active user of. You are using a "broken" computer right now, according to your definition of broken correct ?