3 ms·

That's just temperature, which evens out the random probability a little of the N most probable next words. It's still vastly favoring the N most common ones ba

That's just temperature, which evens out the random probability a little of the N most probable next words. It's still vastly favoring the N most common ones based on the training corpus, and will have a hard time producing uncommon ones. E.g. try asking an LLM to name a real, non-famous person. The internet and it's training corpus is full of regular people, but you won't have much luck - they're statistically too uncommon to remember.

brookst 3y ago
> That's just temperature, which evens out the random probability a little of the N most probable next words. Source? A MS exec said that creative and precise are GPT4 but balanced is a not (or not 100%): https://twitter.com/MParakhin/status/1693579775590224097 https://twitter.com/MParakhin/status/1693579775590224097
- QuadrupleA 3y ago
  I was assuming those Bing Chat settings are temperature-based, those types of "creative/precise" controls usually are - but perhaps there's more to it.
xp84 3y ago
I would be skeptical of the results of that experiment, just because I assume the minders of the big LLMs have attempted to make it deeply uncomfortable with discussing anything that might be "personal." For a fun time, ask ChatGPT who was executed (as in capital punishment) in the US in a certain long-past year. It responds with a bunch of rubbish about privacy and about how an LLM can't be completely sure about stuff so it wouldn't be ok to speculate for fear of tarnishing someone's reputation, as though the person executed 15 years ago is going to sue OpenAI for sharing their name and what crime they were publicly convicted of and killed for.
fulladder 3y ago
Early versions of GPT would tell me about myself, but July of this year it was saying that it could not comment on a private individual. I'm not at all famous, but there's plenty of writing by and about me in the common training datasets. So, I don't agree that there's insufficient data for it to remember a random person. This was obviously a conscious decision, probably in response to situations like this one last spring: https://www.businessinsider.com/chatgpt-ai-made-up-sexual-harassment-allegations-jonathen-turley-report-2023-4?op=1 https://www.businessinsider.com/chatgpt-ai-made-up-sexual-ha...

brookst 3y ago

> That's just temperature, which evens out the random probability a little of the N most probable next words. Source? A MS exec said that creative and precise are GPT4 but balanced is a not (or not 100%): https://twitter.com/MParakhin/status/1693579775590224097 https://twitter.com/MParakhin/status/1693579775590224097

QuadrupleA 3y ago
I was assuming those Bing Chat settings are temperature-based, those types of "creative/precise" controls usually are - but perhaps there's more to it.

xp84 3y ago

I would be skeptical of the results of that experiment, just because I assume the minders of the big LLMs have attempted to make it deeply uncomfortable with discussing anything that might be "personal." For a fun time, ask ChatGPT who was executed (as in capital punishment) in the US in a certain long-past year. It responds with a bunch of rubbish about privacy and about how an LLM can't be completely sure about stuff so it wouldn't be ok to speculate for fear of tarnishing someone's reputation, as though the person executed 15 years ago is going to sue OpenAI for sharing their name and what crime they were publicly convicted of and killed for.

fulladder 3y ago

Early versions of GPT would tell me about myself, but July of this year it was saying that it could not comment on a private individual. I'm not at all famous, but there's plenty of writing by and about me in the common training datasets. So, I don't agree that there's insufficient data for it to remember a random person. This was obviously a conscious decision, probably in response to situations like this one last spring: https://www.businessinsider.com/chatgpt-ai-made-up-sexual-harassment-allegations-jonathen-turley-report-2023-4?op=1 https://www.businessinsider.com/chatgpt-ai-made-up-sexual-ha...