4 ms·

Something I immediately noticed with the different temperature settings is that very low values result in output reminiscent of autism, and high temperature set

Something I immediately noticed with the different temperature settings is that very low values result in output reminiscent of autism, and high temperature settings are reminiscent of the crazy rambling of the homeless people outside central station. I wonder, and I mean this in a genuine scientific way, if there is a deeper connection than just the superficial? Maybe that's all these illnesses are, just a tunable setting in our brains set to too-high or too-low values, perhaps by insufficient or excess neurotransmitters or the like.

richthegeek 3y ago
Sounds like a meta Turing test... after conversing with an AI, how would you describe their personality and mental state? Presumably we want to tune somewhere between "unimpeded ADHD monologue" and "crazy guy on the tube", leaning closer to "trusted family Doctor you've known for 20 years" over "sleazy politician". But I suspect it's more likely that you're pattern-seeking than we've uncovered some deep truth about the human condition. GPTs are, after all, simply automata good at sounding good. They are NOT actual simulacra of human brains.
- the_gipsy 3y ago
  Human brains are also (very) good at sounding good.
  - 082349872349872 3y ago
    I was glad to learn a phrase: https://en.wikipedia.org/wiki/Receptive_aphasia https://en.wikipedia.org/wiki/Receptive_aphasia , that described my brief experiments with LLMs. (or language translators: maybe 5 years ago I noticed that translation services, instead of becoming observably poor where they were unsure, as they had been 10 years ago, were providing very fluent "translations" that in some cases asserted the negation of the original text)
  - Zambyte 3y ago
    Or very bad at detecting what a bad brain sounds like
PartiallyTyped 3y ago
I mean ... technically creativity is just propensity for low probability actions given the context which the broader society evaluates with a high score because it identifies some kind of value in the outcome. If society deems the result as devoid of value, well, you reach "insanity", and if the variance is low, you reach fixed and standardized patterns. The novelty in "creative" efforts / endeavours is just enough to excite our branch predictors without being too chaotic. Too chaotic, and you reach insanity, or "garbage" until the broader society catches up. One can argue that, in part, this is why many of the greats only became so post-mortem.
rafabulsing 3y ago
I'm not nearly knowledgeable enough to have an opinion either way, but that connection/opposition between autism and schizophrenia has been pondered by more qualified people. See e.g. https://slatestarcodex.com/2018/12/11/diametrical-model-of-autism-and-schizophrenia/ https://slatestarcodex.com/2018/12/11/diametrical-model-of-a...
Der_Einzige 3y ago
Autism and Schizophrenia have traditionally been seen as opposites and I do support that interpretation. Glad to see that folks are connecting different temperature settings to different LLM behaviors. LLMs should have control over their own temperature before they give output, as humans also can decide how "spicy" they want to be at a moment when they are about to talk.

richthegeek 3y ago

Sounds like a meta Turing test... after conversing with an AI, how would you describe their personality and mental state? Presumably we want to tune somewhere between "unimpeded ADHD monologue" and "crazy guy on the tube", leaning closer to "trusted family Doctor you've known for 20 years" over "sleazy politician". But I suspect it's more likely that you're pattern-seeking than we've uncovered some deep truth about the human condition. GPTs are, after all, simply automata good at sounding good. They are NOT actual simulacra of human brains.

the_gipsy 3y ago
Human brains are also (very) good at sounding good.
- 082349872349872 3y ago
  I was glad to learn a phrase: https://en.wikipedia.org/wiki/Receptive_aphasia https://en.wikipedia.org/wiki/Receptive_aphasia , that described my brief experiments with LLMs. (or language translators: maybe 5 years ago I noticed that translation services, instead of becoming observably poor where they were unsure, as they had been 10 years ago, were providing very fluent "translations" that in some cases asserted the negation of the original text)
- Zambyte 3y ago
  Or very bad at detecting what a bad brain sounds like

PartiallyTyped 3y ago

I mean ... technically creativity is just propensity for low probability actions given the context which the broader society evaluates with a high score because it identifies some kind of value in the outcome. If society deems the result as devoid of value, well, you reach "insanity", and if the variance is low, you reach fixed and standardized patterns. The novelty in "creative" efforts / endeavours is just enough to excite our branch predictors without being too chaotic. Too chaotic, and you reach insanity, or "garbage" until the broader society catches up. One can argue that, in part, this is why many of the greats only became so post-mortem.

rafabulsing 3y ago

I'm not nearly knowledgeable enough to have an opinion either way, but that connection/opposition between autism and schizophrenia has been pondered by more qualified people. See e.g. https://slatestarcodex.com/2018/12/11/diametrical-model-of-autism-and-schizophrenia/ https://slatestarcodex.com/2018/12/11/diametrical-model-of-a...

Der_Einzige 3y ago

Autism and Schizophrenia have traditionally been seen as opposites and I do support that interpretation. Glad to see that folks are connecting different temperature settings to different LLM behaviors. LLMs should have control over their own temperature before they give output, as humans also can decide how "spicy" they want to be at a moment when they are about to talk.