3 ms·

No, I haven't. And I wasn't able to find it with a search. Link, please?

by rmunn 9mo ago

PaulDavisThe1st 8mo ago
Here's one: https://szopa.medium.com/teaching-chatgpt-to-speak-my-sons-invented-language-9d109c0a0f05 https://szopa.medium.com/teaching-chatgpt-to-speak-my-sons-i... Here's another https://maximumeffort.substack.com/p/i-taught-chatgpt-to-invent-a-language https://maximumeffort.substack.com/p/i-taught-chatgpt-to-inv... both found via google: https://www.google.com/search?q=using+chatgpt+to+invent+a+language&sca_esv=d7358c9ad4b11281&udm=14&sxsrf=ANbL-n4hv28E6C7zemNedV1GekSjm7Y1tQ%3A1771091229780&ei=HbWQafSjL5P10PEPjYSs6AY&biw=1571&bih=1116&ved=0ahUKEwi0pvb8xNmSAxWTOjQIHQ0CC20Q4dUDCBM&uact=5&oq=using+chatgpt+to+invent+a+language&gs_lp=Ehlnd3Mtd2l6LW1vZGVsZXNzLXdlYi1vbmx5IiJ1c2luZyBjaGF0Z3B0IHRvIGludmVudCBhIGxhbmd1YWdlMgUQIRigATIFECEYoAEyBRAhGKABMgUQIRigATIFECEYoAEyBRAhGKsCMgUQIRifBUiYDlDoBFjsC3ABeACQAQCYAXSgAekBqgEDMC4yuAEDyAEA-AEBmAIDoAKKAsICCBAAGIAEGKIEwgIFEAAY7wWYAwCIBgGSBwMxLjKgB8ASsgcDMC4yuAeKAsIHBTEuMy0yyAchgAgA&sclient=gws-wiz-modeless-web-only https://www.google.com/search?q=using+chatgpt+to+invent+a+la...
- rmunn 8mo ago
  The first one is not an example of the LLM inventing a language. The second link is, though. And it's superficially impressive, but here's the thing: the LLM didn't learn the language it was inventing. I just asked ChatGPT 'What does "Ipop gloop splog slopa" mean in the Glorp language?' (that's an example sentence taken directly from the transcript of ChatGPT "inventing" the Glorp language) and it told me '“Ipop gloop splog slopa” doesn’t have a known meaning in any real-world language — and there’s no documented language called “Glorp.”' This is actually a good illustration of my point that LLMs, as they currently exist, aren't capable of general intelligence. The LLM can give the illusion of learning, because it can go back within its context window and look at the information presented there. But start a new context window in a new browser tab, and the information from the other browser tab isn't there. It's gone. The ability to learn requires being able to retain the learned concepts for longer than a single conversation. LLMs, by their nature, aren't capable of that. If AGI is going to be achieved, it will need to happen via a different technology than large language models. EDIT: I should add that the LLM only invented the new language via careful prompting by the user; it didn't do any of the creative-thought work itself, only responding to the user prompting it "Now generate ten more words that match these syntax rules".

No, I haven't. And I wasn't able to find it with a search. Link, please?

by rmunn 9mo ago

No, I haven't. And I wasn't able to find it with a search. Link, please?

Here's one: https://szopa.medium.com/teaching-chatgpt-to-speak-my-sons-invented-language-9d109c0a0f05 https://szopa.medium.com/teaching-chatgpt-to-speak-my-sons-i... Here's another https://maximumeffort.substack.com/p/i-taught-chatgpt-to-invent-a-language https://maximumeffort.substack.com/p/i-taught-chatgpt-to-inv... both found via google: https://www.google.com/search?q=using+chatgpt+to+invent+a+language&sca_esv=d7358c9ad4b11281&udm=14&sxsrf=ANbL-n4hv28E6C7zemNedV1GekSjm7Y1tQ%3A1771091229780&ei=HbWQafSjL5P10PEPjYSs6AY&biw=1571&bih=1116&ved=0ahUKEwi0pvb8xNmSAxWTOjQIHQ0CC20Q4dUDCBM&uact=5&oq=using+chatgpt+to+invent+a+language&gs_lp=Ehlnd3Mtd2l6LW1vZGVsZXNzLXdlYi1vbmx5IiJ1c2luZyBjaGF0Z3B0IHRvIGludmVudCBhIGxhbmd1YWdlMgUQIRigATIFECEYoAEyBRAhGKABMgUQIRigATIFECEYoAEyBRAhGKsCMgUQIRifBUiYDlDoBFjsC3ABeACQAQCYAXSgAekBqgEDMC4yuAEDyAEA-AEBmAIDoAKKAsICCBAAGIAEGKIEwgIFEAAY7wWYAwCIBgGSBwMxLjKgB8ASsgcDMC4yuAeKAsIHBTEuMy0yyAchgAgA&sclient=gws-wiz-modeless-web-only https://www.google.com/search?q=using+chatgpt+to+invent+a+la...

rmunn 8mo ago
The first one is not an example of the LLM inventing a language. The second link is, though. And it's superficially impressive, but here's the thing: the LLM didn't learn the language it was inventing. I just asked ChatGPT 'What does "Ipop gloop splog slopa" mean in the Glorp language?' (that's an example sentence taken directly from the transcript of ChatGPT "inventing" the Glorp language) and it told me '“Ipop gloop splog slopa” doesn’t have a known meaning in any real-world language — and there’s no documented language called “Glorp.”' This is actually a good illustration of my point that LLMs, as they currently exist, aren't capable of general intelligence. The LLM can give the illusion of learning, because it can go back within its context window and look at the information presented there. But start a new context window in a new browser tab, and the information from the other browser tab isn't there. It's gone. The ability to learn requires being able to retain the learned concepts for longer than a single conversation. LLMs, by their nature, aren't capable of that. If AGI is going to be achieved, it will need to happen via a different technology than large language models. EDIT: I should add that the LLM only invented the new language via careful prompting by the user; it didn't do any of the creative-thought work itself, only responding to the user prompting it "Now generate ten more words that match these syntax rules".