4 ms·
Again with the sloppy language. Claude 3 responses are different depending on context of questioning and can be seen to reflect a distinction between use for pu
by ggm 3y ago
Again with the sloppy language. Claude 3 responses are different depending on context of questioning and can be seen to reflect a distinction between use for purpose and test use? Well thats a damn fine LL. Well done. Is it inferring or suspecting? No.
It's not "suspecting" anything except in the ridiculous, sloppy use of language, analogy ridden way AI proponents like to state things.
"suspect" had a very good english language meaning tied to intelligence and thinking. Polluting the meaning by applying it to a complex software system strongly implies belief the software IS thinking. It's not scientifically observationally neutral language.
If I was in peer review in this field, I'd fail any paper which wrote this kind of thing.
Claude 3 Opus can be used by people to distinguish use between test/benchmarking, and intentional use. Naieve use of Claude 3 for benchmarking may be led astray because the LLM appears to behave differently in each case. This is interesting. It's not a sign of emergent intelligence, its refinement of meaning in the NLP of the questions and their context.
- falcor84 3y agoI must say I don't understand your stance against extending the use of language to machines. Are you also arguing that "flying" should be reserved for birds and cannot be meaningfully applied to airplanes?
- ggm 3y agoNo, i am not. Flying doesn't impart meaning of intentional behaviour. It's distance carried against height lost or gained pure and simple. Claim, believes, states, hallucinated, states, says argues all go to intelligence not just the input output situation. Maybe most unintentional flight is gliding, or controlled descent to ground. That said, can a dumb system keep a Kite aloft? I believe yes. No Ai needed. To me there is a clear difference. Ai language is not as direct as flying.
- falcor84 3y agoI'm sorry but I can't help but feel that this is just semantics. Growing up in the 90s, I remember that it felt perfectly apt to me that a chess engine is "Thinking..." as it does whatever it does to come up with its next move. And I don't recall ever feeling there's an oxymoron in "artificial intelligence".
- awb 3y agoI think the difference is no one was suggesting that the chess engine was actually thinking. Here, when tokens are predicted in sequence developers are suggesting a motive behind the predicted sequence.
- nottorp 3y agoInteresting enough, all flying machines fly - that means both airplanes and lighter than air stuff. But ships and submarines don't swim. Although submarines do dive. Coming back from the finer points of the english language, the LLM in question is likely to be trained on text discussing LLM evaluation. So it ended up generating something about it. You LLM "activists" are doing yourselves a disservice speaking about them in religious tones. You lose some credibility.
- bondarchuk 3y ago>You LLM "activists" are doing yourselves a disservice speaking about them in religious tones. You lose some credibility. The word "suspecting" is not a word with religious connotations.
- fancyfredbot 3y agoThe response returned from the Chinese Room showed signs of what would have been interpreted as "suspicion" had the response come from a Human. Did the Chinese Room suspect anything?
- EForEndeavour 3y agoGenuine question: do you have the same objection against the terms machine learning, goal-seeking, or AI agents?
- ggm 3y agoI am unhappy with ML as words but ML as an acronym imparts less concern. Goal seeking has been in the vocab for a long time, and usually does impart a sense of intentionality but it's coded in, algorithmically. the mechanistic approaches to goal seeking are givens, the code is an implementation of them. In LLM we're being taken to "the intentionality emerges, it wasn't coded in" Which sould be disputed, but it's how I see people inferring "behaviour" in this space. Agents yes, I do have problems with, having just written of them in a different but related thread (different HN story) I begin to suspect the seeds of this linguistic problem lie deep. They were there in "clippy" and the personification of the system.