3 ms·
Vulnerability researches with a vested interest in making LLMs valuable. The difference isn't meaningful
by malfist 9mo ago
Vulnerability researches with a vested interest in making LLMs valuable. The difference isn't meaningful
- tptacek 9mo agoI don't even understand how that claim makes sense.
- judemelancon 9mo agoThe first three authors, who are asterisked for "equal contribution", appear to work for Anthropic. That would imply an interest in making Anthropic's LLM products valuable. What is the confusion here?
- tptacek 9mo agoThe notion that a vulnerability researcher employed by one of the highly-valued companies in the hemisphere, publishing in the open literature with their name signed to it, is on a par with a teenager in a developing nation running script-kid tools hoping for bounty payoffs.
- delusional 9mo ago[flagged]
- judemelancon 9mo agoTo preemptively clarify, I'm not saying anything about these particular researchers. Having established that, are you saying that you can't even conceptualize a conflict of interest potentially clouding someone's judgement any more if the amount of money and the person's perceived status and skill level all get increased? Disagreeing about the significance of the conflict of interest is one thing, but claiming not to understand how it could make sense is a drastically stronger claim.
- tptacek 9mo agoI'm responding to "the difference isn't meaningful". Obviously, the difference is extremely meaningful.
- mpyne 9mo ago> Having established that, are you saying that you can't even conceptualize a conflict of interest potentially clouding someone's judgement any more if the amount of money and the person's perceived status and skill level all get increased. If I used AI to make a Super Nintendo soundtrack, no one would treat it as equivalent to Nobuo Uematsu or Koji Kondo or Dave Wise using AI to do the same and making the claim that the AI was managing to make creatively impressive work. Even if those famous composers worked for Anthropic. Yes there would be relevant biases but there could not be a comparison of my using AI to make music slop vs. their expert supervision of AI to make something much more impressive. Just because AI is involved in two different things doesn't make them similar things.
- drekipus 9mo ago[flagged]
- blks 9mo agoNo one is saying he is misleading people on purpose, just that he may lack critical evaluation of his product, or be overly optimistic about it.