5 ms·

They understand tone of voice? C'mon bruh.

tsumnia 2y ago
I believe what orangecat means is that AIs don't understand tone ~yet~. However as we continue working on adding context and refining models, it could be a possibility in, say, 10 years. Think where we were 10 years ago - IoT was the big deal and IBM Watson was beating Jeopardy champions while still not understanding London isn't a US city. AI's "humanity" will be a consistent debate among people - there will always be people that choose to think of AI as nothing more than a tin can with an opinion built from a math equation, myself included. But these are the types of questions that we'll need to discuss as AI continues to progress while people continue to point out how AI can't do X (which makes them inferior to humans).
- MrMcCall 2y ago
  > I believe what orangecat means is that AIs don't understand tone ~yet~. I don't see how you get that from what he quoted of mine then what he said. Besides, their understanding 'tone' is not a sensible prediction, for the simple fact LLMs don't ever understand anything, whatsoever, any more than ELIZA was a psychologist. They digest and then regurgitate word sequences in complex ways ~ it's the intrinsic and sole nature of their design. We can hide that fact with layers of obfuscation or tricky ways of packaging their output, but they are what they are, and nothing more. Like, human beings are never going to walk on the sun in our physical bodies; we are limited by our physiology, and there is no transcending it in dimensions beyond our capabilities.
  - tsumnia 2y ago
    I am in agreement with you that LLMs are lifeless regurgitation machines; what I'm implying isn't too far from how children learn/interact. One of the first concepts we teach children is word association to objects and once they've learned the term, they use it to describe whatever electrical signals are firing in their brain that made them decide "apple". If the difference is that LLMs use numerical representations to determine those "firings" in its decision making process, then would the numerical representations of an fMRI scanner hooked to a human be equivalent? Of course not, because humans > robots. BUT, that does not discount the fact that humans learn through methods like memorization, which have their own reinforcement learning patterns. Many of the cognitive science* concepts have similar LLM infrastructure equivalents as well - "Mind Palace" is similar to RAG, the different relationships we have with others is akin to LLM role-playing, one/few-shot prompting is like templates. I've recently been thinking about what types of discussions we'll have around AI in about 20 years - a new generation of young adults will leaving school, where we are currently introducing them to AI tutor avatars. Combined with things like Neuro-sama, the AI driven Twitch streamer, I'm curious about how the NEXT generation will perceive AI since they've grown up with it. This isn't a Futurama Marilyn Monroe Bot fantasy, its sort of a reality (whether I agree with it or not).
  - orangecat 2y ago
    Oh no, I mean that there are current AI models that have some understanding of tone of voice. (With a definition of "understand" that is different from yours so as not to be a vacuous statement). I just now went to https://www.sesame.com/research/crossing_the_uncanny_valley_of_voice https://www.sesame.com/research/crossing_the_uncanny_valley_... and asked it to interpret my mood as I said the same words in different tones, and it did a reasonable job.

I believe what orangecat means is that AIs don't understand tone ~yet~. However as we continue working on adding context and refining models, it could be a possibility in, say, 10 years. Think where we were 10 years ago - IoT was the big deal and IBM Watson was beating Jeopardy champions while still not understanding London isn't a US city. AI's "humanity" will be a consistent debate among people - there will always be people that choose to think of AI as nothing more than a tin can with an opinion built from a math equation, myself included. But these are the types of questions that we'll need to discuss as AI continues to progress while people continue to point out how AI can't do X (which makes them inferior to humans).

MrMcCall 2y ago
> I believe what orangecat means is that AIs don't understand tone ~yet~. I don't see how you get that from what he quoted of mine then what he said. Besides, their understanding 'tone' is not a sensible prediction, for the simple fact LLMs don't ever understand anything, whatsoever, any more than ELIZA was a psychologist. They digest and then regurgitate word sequences in complex ways ~ it's the intrinsic and sole nature of their design. We can hide that fact with layers of obfuscation or tricky ways of packaging their output, but they are what they are, and nothing more. Like, human beings are never going to walk on the sun in our physical bodies; we are limited by our physiology, and there is no transcending it in dimensions beyond our capabilities.
- tsumnia 2y ago
  I am in agreement with you that LLMs are lifeless regurgitation machines; what I'm implying isn't too far from how children learn/interact. One of the first concepts we teach children is word association to objects and once they've learned the term, they use it to describe whatever electrical signals are firing in their brain that made them decide "apple". If the difference is that LLMs use numerical representations to determine those "firings" in its decision making process, then would the numerical representations of an fMRI scanner hooked to a human be equivalent? Of course not, because humans > robots. BUT, that does not discount the fact that humans learn through methods like memorization, which have their own reinforcement learning patterns. Many of the cognitive science* concepts have similar LLM infrastructure equivalents as well - "Mind Palace" is similar to RAG, the different relationships we have with others is akin to LLM role-playing, one/few-shot prompting is like templates. I've recently been thinking about what types of discussions we'll have around AI in about 20 years - a new generation of young adults will leaving school, where we are currently introducing them to AI tutor avatars. Combined with things like Neuro-sama, the AI driven Twitch streamer, I'm curious about how the NEXT generation will perceive AI since they've grown up with it. This isn't a Futurama Marilyn Monroe Bot fantasy, its sort of a reality (whether I agree with it or not).
- orangecat 2y ago
  Oh no, I mean that there are current AI models that have some understanding of tone of voice. (With a definition of "understand" that is different from yours so as not to be a vacuous statement). I just now went to https://www.sesame.com/research/crossing_the_uncanny_valley_of_voice https://www.sesame.com/research/crossing_the_uncanny_valley_... and asked it to interpret my mood as I said the same words in different tones, and it did a reasonable job.