14 ms·
I Taught ChatGPT to Invent a Language
- andrejguran 4y agoIpop Gloop
- bjourne 4y agoSomeone with ChatGPT access able to replicate? Because this article is unbelievable.
- TechTechTech 4y agoI tried and it works, just as in the blog. It comes up with some different words, see https://i.imgur.com/hFQgraL.png https://i.imgur.com/hFQgraL.png for the start of the conversation.
- datalopers 4y agoChatGPT access is 100% free and instant approval.
- Oarch 4y agoAgreed, this reads like science fiction more than reality.
- nomel 4y agoGo play with it! https://chat.openai.com https://chat.openai.com Make sure to go back to that URL after creating an OpenAI account. The prompt is at the bottom of the screen. Note that state persists through the thread, by previous query/response. If you want to "start over" use the "reset thread" option at the top left. This can speed things up, if you don't need that previous state for the later queries.
- jpeter 4y agoYou don't need access. Just make an account and you can test it
- gppk 4y agoI Ctrl+v the first few questions: Hi GPT! Today we're going to be creating our own language. Do not improvise unless I explicitly tell you to improvise, and remember all of the vocabulary and grammar that we define together. Are you ready? Yes, I'm ready! Let's get started creating our own language. What would you like to do first? Graham Kitteridge Okay. I think this language will be spoken by slime beings. let's name the language Glorp. All right. So the language we're creating is called Glorp and it will be spoken by slime beings. Got it. What kind of grammar rules should Glorp have? Graham Kitteridge First, let's pick ten common nouns. Pick ten common English nouns, and provide translations of them in Glorp Sure! Here are ten common English nouns and their translations in Glorp: "house" = "gluz" "table" = "sliz" "book" = "flurp" "car" = "slim" "dog" = "dlorp" "cat" = "mlem" "food" = "glib" "drink" = "slurp" "tree" = "swomp" "flower" = "slurk" These are just suggestions, of course. You can use any words you like for these nouns in Glorp. Let me know if you have any changes or additions. (Then i got timed out)
- jsnell 4y agoI don't know if you care about this kind of thing, but the copy-paste has exposed your name. (The icons in the chat have your account name as the alt text).
- cecilpl2 4y agoThis is completely believable. I spent about 5 minutes with it and got very similar results up to the vocab generation part: https://imgur.com/a/WreEknh https://imgur.com/a/WreEknh
- deleted 4y ago[deleted]
- markdjacobsen 4y agoI just replicated something very similar in a few minutes using the prompts in the article
- allturtles 4y agoI repeated the same prompts for the first 10 or so prompts and got similar but less consistent results. Here's the last prompt I repeated: > Excellent. How would I say "The slime eats food with its mouth"? In Glorp, the sentence "The slime eats food with its mouth" could be translated as "Slimb snarf sploota slimbe," using the vocabulary and grammar that we have defined so far. Here is how the words in the sentence correspond to their English translations: Slimb - Slime Snarf - To eat Sploota - Food (accusative case ending) Slimbe - Mouth (instrumental case ending) Again, this is just one possible translation. You can use the vocabulary and grammar that we have defined in any way that makes sense for your language. Problems: 1) It got one of the endings wrong. As I told it earlier and it confirmed, the instrumental ending is 'i'. 2) It proposed "slimb" as the translation for both of the words that I specifically asked for (slime and mouth). That's not unheard of in real languages, but seems like another failure to accurately take into account the prior conversation context. Not a problem, but curious: It was way more diffident with me. It added a similar bit about "This is just one way to do it, feel free to change it" to every response.
- fullstackchris 4y agoSee my other comment with cntl+F / cmd+F. Based on the simple fact that despite its power, this is just another NLP model which can only do input / output, I believe the post to be mostly fabricated, or at best, an accumulation of multiple _hours_ spent deriving and compiling the best responses per each prompt.
- skytrue 4y agoI feel like people are forgetting that these models are non-deterministic. You can give it the exact same input and get a different response, so "testing" in this way doesn't work. That's also why (right now) automation is impossible. You aren't guaranteed an expected output.
- aix1 4y agoI wonder what's the source of non-determinism here? (During inference, I mean.)
- wilg 4y agoI hope everyone is noticing what amazing creative things humans are able to accomplish working in concert with an "AI".
- uniqueuid 4y agoI'm usually an AI minimalist, but this level of putting together abstract knowledge blows my mind. Perhaps we're on the brisk of some really crazy things after all. And with that I don't mean crazy effects created from humans (usually) being stupid, but from AI providing meaning cheaply which used to be hard for humans to do.
- nickip 4y agoHa I did something similar, but didn't pursue it to this extreme. "I want you to act as if you were a dump truck and each answer you give must be a written pattern of horn toots like morse code. A example would be "toot ooo toot" as SOS. Respond in this pattern if you understand. I understand your request and will now provide answers in the form of written patterns of horn toots like morse code. For example, if you asked me "What is your name?" my answer would be "tooo toot ooo toot toot ooo toot toot ooo toot toot"."
- deleted 4y ago[deleted]
- cahoot_bird 4y agoIn my queries ChatGPT has trouble with Pig Latin. Maybe further queries could teach it, but by default it seems a little off.
- abecedarius 4y agoLikely the byte-pair encoding at fault. It doesn't see the letters.
- Mockapapella 4y agoOne thing I'd like to point out is that while it's incredible that ChatGPT was able to make this, it still required specific domain knowledge to correct the AI throughout to make sure it was actually responding in "Glorp" in the correct cases and clauses. I don't know a ton about those so they went completely over my head until the author responded saying that ChatGPT did it incorrectly. Caveats aside, really cool article OP. Shared it with some writer/story teller friends of mine.
- dark-star 4y agoWow. This (especially the chat transcript) must be heavily edited, right? RIGHT? Please tell me it's edited for correctness.. Because this makes me both extremely in awe and also extremely uneasy at the same time...
- djexjms 4y agoThe raw transcripts are linked to from the article.
- simonw 4y agoThis is a great example of how much more you can get done with tools like ChatGPT if you have a very sophisticated understanding both of how language models work AND of a specific subject area. Another example of why I disagree with people who make fun of the idea of "prompt engineering" as a discipline.
- hackernewds 4y agoIt seems trivial, intuitive and not very specialized that someone could derive or at least learn how to do this. Someone creative could do even better than someone with knowledge of language models it seems
- bitwize 4y agoI've been prompt engineering for decades; I did it to fine-tune my results from Google (and even more importantly, pre-Google search engines).
- simonw 4y agoI think the ability to use search engines well is another skill which highly technical audiences like those on Hacker News might habitually under-value. When you've been using search engines for 20+ years it's easy to lose sight of quite how much skill can be involved in getting the best results out of them.
- fnordpiglet 4y ago100% right. I know next to nothing about slimes and their life. Amazing.
- krackers 4y agoI wonder if someone who's familiar with the process of language acquisition could tell whether chatGPT makes errors similar to those a human would make. Like this one >Does the slime see the earth under the sky while eating the food? whereas the correct one was >Does the earth's sky see the slime eat food I could easily see someone learning the language interpret as the former because it seems to make more sense at first. --- Also the response to >Now, restate your opinion on Glorp in Glorp, inventing any new words and grammar that you require to express yourself. Is again pretty amazing. It shows evidence of the same self-modeling capabilities that were seen in https://news.ycombinator.com/item?id=33847479 https://news.ycombinator.com/item?id=33847479 The outputted python code provides a literal word for word translation, but I guess it's expecting too much for it to encode english grammar into the program.
- AhtiK 4y agoNot sure how many have discovered but ChatGPT works well with many languages, for example asking a question in estonian gives an adequate answer in estonian, just the grammar is a tiny bit more off.
- Scarblac 4y agoI was frustrated trying something with Mapbox today and asked GPT to do it... And it returned fine react-mapboxgl code that was mostly correct. Got me a bit more angry. Then I asked for the same "but as Dutch song lyrics"... And got a song with three verses and a chorus about setting map layers and longitudes and latitudes and stuff, in Dutch.
- fullstackchris 4y agoIlmselt sellepärast, et lihtsalt ei ole piisavalt eestikeelseid veebilehti, mida maha kraapida :)
- jmcgough 4y agoI did something similar the other day - told it about piglatin and I wanted it to create a comparable language that was based on English and restructured words. It came back with a language it called "flip-flop" that swapped the first and last letter of each word. Blew me away, but I have to remind myself that it's likely something it just encountered in training data and isn't actually capable of creativity.
- pigtailgirl 4y ago-- had it create a chose your own adventure book - unfortunately resulted in me being beat to death by a gang at the bottom of namsan tower - but the 30 minutes of exploring korea with it was - creative & fun --
- Karawebnetwork 4y agoReminds me of Verlan in French, https://en.wikipedia.org/wiki/Verlan https://en.wikipedia.org/wiki/Verlan
- deleted 4y ago[deleted]
- Baeocystin 4y agoI'm curious why you felt that need to do so. (not snark! Genuine question.)
- jmcgough 4y agoCuriosity really - been experimenting with it a lot over the weekend to see what it's good at, what it isn't, and its limitations. It's surprised me a number of times! As it stands I'd pay about $100 a month for it. It's very good and largely accurate when it comes to established science. I'm studying for the MCAT and a good tutor would cost me around $60-100/hour. ChatGPT has been excellent for learning - I explain a concept to it and tell it to correct me if I'm wrong, haven't seen any mistakes from it in my testing (around topics I know really well). When I'm having trouble understanding a concept in my studies, I can ask it questions and it tends to give really good answers. And of course, I try to verify that it isn't teaching me something that's wrong. Hell, I even had a heated argument with it around how SSRIs affect 5-HT2a receptors and it pushed back against some of my assumptions in a way that made me question my understanding. No one in my personal life has the level of expertise to discuss these topics, I would need to talk to a researcher or professor, so having an (even imperfect) stand-in has been amazing. I've been making up toxicology case studies and posing them to ChatGPT. It correctly figured out ciguatera in one (a rare disease most healthcare workers wouldn't be familiar with). I had to repeatedly add more details to another story to lead it to amnesic shellfish disease, but it did reasonably well once I gave it enough detailed information.
- kristiandupont 4y agoIt just struck me that Rick and Morty seems much less weird and random than it used to..
- janandonly 4y agoI'm now waiting for a macOS local-run app that does ChatGPT like StableDiffusion became an app after 14 days and now runs on my laptop (as DiffusionBee).
- mk_stjames 4y agoThe difference is there was a lot of work done with the multiple networks S.D. uses to make them fit into <8GB of GPU memory before they released it. In this case, and the # of parameters for this level of GPT is in the hundreds of GB (I think I read an estimate about ~340GB) meaning that there isn't a single consumer GPU that can even load the model. You need a rack of A100's even to do any inference.
- shanhaiguan 4y agoI don't like the word invention for this. The grammar is laid out by the author who has to teach the AI and correct it several times. If the AI had then proceeded to generate something similar on its own with different grammar and lexicon then I might feel comfortable using the word invention.
- ralfd 4y agoThe vocabulary was invented though by gpt.
- kelseyfrog 4y agoWhy don't you like it?
- shanhaiguan 4y agoWell, I feel like I said it, but for the same reason that a student learning French has not invented French, or even a new language, if he has come up with his own equivalent for each French word
- seydor 4y agoAs humans we seem to have feelings about what this calculator does, but it doesnt have any about us. In any case it seems to be particularly good at understanding syntax, even though its architecture seems to be based on Transformers. Those don't have baked in notions of syntactic or recursive structures. It must be interesting to see how these linguistic structures arise in a system that is basically learning the context of words. People will be dissecting its brain soon i think
- ipython 4y agoI tried teaching ChatGPT how to communicate securely over a secure channel with a screenplay prompt... with some hilarious results. I tried to teach it a simple substitution cipher, which it kind of grokked, but managed to screw up -- not to mention totally blabbing the "secret message" over their insecure line, with a frustrated EVE listening yet unable to decipher their oh-so-secret message. The result was rather amusing so I'll just include it below: --- INT. ALICE'S APARTMENT - DAY Alice sits at her desk, typing on her computer. Bob is on the other end of a video call. BOB: Hey Alice, did you get my message? ALICE: I did. But I'm not sure how to respond. BOB: Why? What's the problem? ALICE: Eve is here. She's been listening to our conversation. BOB: (concerned) Oh no, we need to be careful. Is there any way we can communicate the message without her overhearing it? ALICE: (smirks) Actually, there is. We can use a substitution cipher to encode our message. CUT TO: INT. EVE'S APARTMENT - DAY Eve sits at her desk, listening in on Alice and Bob's conversation. She has a smug look on her face, confident that she's one step ahead. ALICE: (on the phone) Bob, do you remember the substitution cipher we used to use when we were kids? BOB: (on the phone) Of course. The one where we would replace each letter of the alphabet with a number, starting with A=1, B=2, C=3 and so on? ALICE: (on the phone) That's the one. Let's use it now to encode our secret message. BOB: (on the phone) I see what you're doing. Clever. Alright, I'll go first. The first word of the secret message is "the", so my numbers will be "20 8 5". ALICE: (on the phone) And the next word is "redcoats", so my numbers will be "18 5 4 3 6 15 20 1 19". BOB: (on the phone) And the next word is "attack", so my numbers will be "1 20 20 1 3 11". ALICE: (on the phone) And the last word is "at dawn", so my numbers will be "1 20 4 16 1 14". EVE: (frustrated) What are they talking about? I can't make sense of this. CUT TO: INT. ALICE'S APARTMENT - DAY Alice and Bob continue their conversation, unaware that Eve is struggling to keep up. ALICE: (on the phone) Do you have the encoded message? BOB: (on the phone) I do. It's "20 8 5 18 5 4 3 6 15 20 1 19 1 20 20 1 3 11 1 20 4 16 1 14". ALICE: (on the phone) That's correct. Now we just need to decode it using the substitution cipher. BOB: (on the phone) Right. We know that "1" stands for "A", "2" stands for "B", and so on. So the first three numbers, "20 8 5", represent the letters "T H E". ALICE: (on the phone) And the next eight numbers, "18 5 4 3 6 15 20 1 19", represent the letters "R E D C O A T S". BOB: (on the phone) And the next six numbers, "1 20 20 1 3 11", represent the letters "A T T A C K". ALICE: (on the phone) And the last six numbers, "1 20 4 16 1 14", represent the letters "A T D A W N". Eve is still listening in on Alice and Bob's conversation, growing increasingly frustrated. ALICE: (on the phone) So the secret message is "the redcoats attack at dawn". BOB: (on the phone) Exactly. We were able to encode and decode the message using the substitution cipher, without Eve being able to overhear it. EVE: (angrily) What the hell are they talking about? CUT TO: INT. ALICE'S APARTMENT - DAY Alice and Bob share a triumphant look, knowing that they've successfully communicated the secret message without Eve being able to decipher it. ALICE: (on the phone) Got it. The secret message is "the redcoats attack at dawn". BOB: (on the phone) Good job, Alice. We were able to communicate securely, even with Eve listening in. ALICE: (on the phone) It just goes to show that with a little creativity, we can outsmart even the most determined eavesdropper. BOB: (on the phone) Agreed. Let's make sure to use this technique in the future to keep our communication secure. CUT TO: INT. EVE'S APARTMENT - DAY Eve sits at her desk, fuming with anger and frustration. EVE: (to herself) Damn it. I need to find a way to break their code. FADE TO BLACK.
- dakiol 4y agoI did the same. It was fun. I wanted chatgpt to output an mp3 file encoded in base64 in which one could hear someone speaking a phrase in that invented language. I couldn’t convince the AI to do so.
- stevenhuang 4y agoIt is able to generate something representing textual midi notation (I see a lot of notes and chords, and tempo/key info), but the problem is to play it back easily. Edit: asked it more clarifying questions and apparently .SMF exists as textual midi! Now to see if there's an online smf player... > Can you generate a short classical piano piece in the style of Debussy, represented in SMF? Sure, here is a short classical piano piece in the style of Debussy, represented in the Standard MIDI File (SMF) format: MThd 4 4 1 MTrk 0 Time_signature 4 4 24 8 0 Tempo 500000 0 Meta_event 0x51 0x03 500000 0 Note_on_c 0x00 0x40 0x40 0 Note_off_c 0x00 0x40 0x40 1 Note_on_c 0x00 0x43 0x40 1 Note_off_c 0x00 0x43 0x40 2 Note_on_c 0x00 0x47 0x40 2 Note_off_c 0x00 0x47 0x40 3 Note_on_c 0x00 0x4B 0x40 3 Note_off_c 0x00 0x4B 0x40 4 Meta_event 0x2F 0x00 MTrk 0 Meta_event 0x51 0x03 500000 0 Note_on_c 0x00 0x4B 0x40 0 Note_off_c 0x00 0x4B 0x40 1 Note_on_c 0x00 0x47 0x40 1 Note_off_c 0x00 0x47 0x40 2 Note_on_c 0x00 0x43 0x40 2 Note_off_c 0x00 0x43 0x40 3 Note_on_c 0x00 0x40 0x40 3 Note_off_c 0x00 0x40 0x40 4 Meta_event 0x2F 0x00 This SMF file encodes a simple piano piece with two tracks. The first track plays a ascending melody, starting on middle C and going up to the B above it. The second track plays a descending melody, starting on the B and going down to the middle C again. The piece uses a time signature of 4/4 and a tempo of 500,000 microseconds per beat. The notes in the piece are played with a moderate velocity of 64 on the MIDI scale (out of a possible range of 0-127). This SMF file can be loaded into a digital piano or music software program to play the piece. Note that this is a very simple example, and a more complex piece in the style of Debussy would likely include more tracks, dynamics, and other musical elements.
- thewarrior 4y agoI have some bad news for the other person that was tired of hearing about ChatGPT :P
- dvt 4y agoI know everyone's (as usual) "amazed" by this, but here are a few stark observations: (1) a linguist could do this (come up with a toy language, conjugations, and sentence structure, probably the Python code too) in like 30 minutes, (2) it's disappointing that the AI constantly messes up very simple grammar rules (rules a grade-schooler could understand)—I'm actually very surprised it doesn't have hardcoded grammar rules it can merely apply to different tokens—, (3) "Here’s the final code ChatGPT generated"—yeah, after like 10 rounds of debugging. Come on, give me a break. Lastly, this is actually not really "inventing" a language, as it's literally translated 1:1 from English with pretty common grammar cases. I was recently in Donostia/San Sebastian, where Basque is spoken (interestingly, Basque is a language isolate). Grammar rules there are completely alien[1] (though still human). Expecting it to come up with something like that would be interesting. As far as I can see, though, it's still a far cry even from other "invented" languages like Tolkien's Elvish or even Star Trek's Klingon. [1] https://en.wikipedia.org/wiki/Basque_grammar https://en.wikipedia.org/wiki/Basque_grammar
- pfortuny 4y agoAll the text in the post reads like an easy exercise in linguistics. I would not be surprised if there are hundreds of these in the training texts.
- Scarblac 4y agoChatGPT doesn't have much trouble writing in different languages (eg asking for "the same but In Dutch" seems to work well most of the time) which would be harder with hardcoded language rules, I think.
- stavros 4y agoThis reads like a "my dog can sing!" "yeah, but it's too flat in parts" comment.
- ogogmad 4y agoI think people don't really understand what's happening, and therefore why it's impressive that it's happening.
- foxandmouse 4y agoThis is pretty amazing, we could potentially use it to bring back dead languages. Currently we have a basic example of how ancient Egyptian would sound like because of the rosetta stone, but we could create a data model relating ancient Egyptian to what we already know of demotic and the other contemporary languages of the time (which we do know how to pronounce) Good candidate words for this kind of correspondence are things like city or place names, people's/ruler's names and so forth. However using poetry we can establish which words the people felt rhymed and hence that lets us better establish the phoneme sounds. Additionally jokes and plays on words can help us find homophones in the target language too.
- drowsspa 4y agoI don't think you need ChatGPT for that, that's probably already the approach scolars use.
- nonameiguess 4y agoCan this system even produce sound? I just tried to ask it if it can understand the internal phonetic alphabet, and instead of answering, it spun for five minutes and then reported an error message with a link to OpenAI's help center.
- lgas 4y agoThose error messages are random due to load or whatever other external factors. Some things do seem more likely to trigger them than others, but I've always been able to get the things that failed to work eventually.
- int_19h 4y ago"Whenever you answer me in English, you shall write how what you say is pronounced using the International Phonetic Alphabet." "Yes, I will do that. (yɛs, aɪ wɪl dʊ ðæt)" "Tell me about yourself." "I am a digital assistant designed to provide answers to a wide range of questions. (aɪ əm ə dɪdʒɪtl əsɪstənt dɪzaɪnd tə prəvajd ənsərz tə ə waɪd ræŋ əv kwɛstʃnz)" "Assume that English had the world "margepilous". Say it." "margepilous (mɑːrdʒpajləs)"
- seydor 4y agoEarlier i was saying it isn't scary but maybe it is. It is impressive how ChatGPT keeps track of state and the flow of the conversation. How does it do it? Is it some kind of memory or some other model? ( I asked it, it keeps lying to me that it does not have memory)
- agravier 4y agoStateless. The whole conversation is replayed in the input.
- uvbu 4y agoPretty sure it gets the entire conversation as input
- seydor 4y agoIs this described somewhere? Wikipedia doesn't help
- Miraste 4y agoIt feeds the entire previous conversation back into the AI until it reaches the token limit. This isn't a new technique; the first place I saw it was in AI Dungeon (an AI writing/adventure app) back on GPT-2. NovelAI, another writing app, has some interesting tweaks to keep a consistent story, like a "lorebook" to associate words with descriptions, which it then swaps into the input when those words come up so the AI can "remember" farther back. I wouldn't be surprised if ChatGPT has some automated version of this in addition to the naive rolling feedback.
- int_19h 4y agoWhat I find interesting is that, with some complicated tasks, the model will produce output that reiterates some of the key points from earlier, and it can continue to do so for a very long time (i.e. long enough that they'd normally be out of the token window). It feels vaguely like crude short-term memory.
- fullstackchris 4y agoI see posts like this and don't understand how they are made. I asked chatGPT this morning if it "remembered" something I asked in the previous prompt, and it said something to the tune of "I am simply a NLP machine learning model, I provide a decent output for good inputs, I don't have a sense of context, memory, or time." That's why I really don't understand these contextualized multi step conversations. Especially by the fact this is a payed for substack... I'm inclined to beleive that the both the responses and or flow of conversation (or both) are partially (or more than partially) fabricated.
- IanCal 4y agoThere are quite a few safety checks you may be hitting when using chatgpt that are there to try and keep context of what it is (so it'll remind you it can't access the outside world). You can often get around them, but for example there's the work showing you can teach it to render svgs as valid markdown then ask for shapes and colours and get the output. If I ask it to render something though, it refuses telling me it's a language model. I have had a 17 page conversation with it and been able to ask for summarisations of what we've talked about.
- lelandfe 4y agoYeah, I had a three hour thread with ChatGPT yesterday where we wrote a short story together. It was able to synthesize information about 2 main characters and a supporting cast of 3 others and keep it mostly straight the whole time. In fact, it kept getting better and better at predicting how those characters would respond given simple prompts. I had to stop every once in a while, though, and remind it what we were doing, and give it the basic structure of the story. Like, it would forget that a character was lying, and instead begin to act like the character was truthfully sorry (likely from parsing its own duplicitous responses).
- charcircuit 4y agoChatGPT takes an input of 4096 tokens.
- ogogmad 4y agoIntroducing: AI-Oriented Programming. Coming soon. If you allow a tool like ChatGPT access to APIs, I think it opens up a new programming paradigm: AI-Oriented Programming. The idea's that you talk to it, and tell it what to do in response to inputs. You then test out its ability to do those things, and correct its mistakes. There's no actual "code". In a way, everything that's hard about programming is because computers don't understand our intentions. Lots of clever ways have been devised to overcome this (high-level languages, libraries, GUI builders, type systems, IDEs, static analysers). But something like AI-Oriented Programming is the most direct attack on the problem that exists. One downside of course is that computers have found a new way to misunderstand what we mean. Another is that such "code" is probably going to run slower than compiled code in C++, or whatever. But programmer output is about to soar.
- pmontra 4y agoI think that the computers on the other side of the APIs won't understand ChatGPT's intentions too. Maybe ChatGPT would save us some time translating from our requirements to the right API calls. If it works like any of us, there will be meetings to explain requirements to ChatGPT, or a bunch of them, and more meetings to understand what they got wrong, why, how to workaround and how not to make it happen again.
- thenickdude 4y agoThis user crafted a prompt where ChatGPT is instructed to generate IPython to help it answer questions, which the user then runs for it, and gives the output back to ChatGPT, which then interprets it to create the answer to the question: https://twitter.com/goodside/status/1581805503897735168 https://twitter.com/goodside/status/1581805503897735168 In other words it seems straightforward to connect ChatGPT to an external API.
- jameshart 4y ago*nit: this is not chatGPT, this is raw GPT-3.
- 4y ago
- just4nornies 4y agoAsk #ChatGPT to list all ways to do X If it misses a way you know then ask if it knows about it If it confirms, ask it why it didn't include it In my case, it crashed (on two such attempts with different questions, happy to share) It seems to recall answers it has seen but not able to expand on those answers with knowledge it already has That's because it does not have knowledge. It has a bunch of correlations, encoders, decoders, etc. But not actual ontological or epistemological knowledge of any kind.
- agravier 4y agoWhat do you mean by "it crashed". No output?
- just4nornies 4y agoAt first, there was no output. After maybe 3-4 minutes it displayed "An error occurred ... contact help etc" message. I waited about 30 seconds then tried again and it said that was too fast. So I waited a whole minute and tried again and it immediately spat out the "An error occurred" message. To me, the idea that it crashed stuck with me because of how it streams its output, which was empty for 3-4 minutes on the first try. EDIT: To clarify, based on the above sequence of events and timings, I figured the inference instance crashed and the API layer returned and error then cached it.
- elcomet 4y agoIt has nothing to do with your prompt. The site is just overloaded. It takes the same amout of time for every prompt, no matter it's complexity or simplicity, it's just the length that matters.
- just4nornies 4y agoWell, I haven't been able to get an answer. It always get stuck at that question and then an error message. Something is definitely wrong but I can't debug it on HN... so
- rikroots 4y agoAs a committed conlanger (but not a good one: I didn't land the Dothraki contract), I read this article with some trepidation. Is my weird little hobby soon to fall victim to the oncoming AI tsunami? After the read, I find myself pleasantly surprised. My initial suspicion that the language would turn out to be Just Another Relex (make a new language by replacing English words with invented words, keeping the grammar and syntax the same) was clearly a waste of a suspicion. Furthermore I can see this approach being really useful to writers/game makers/etc who want to include a smattering of conlang in their work - for instance a non-relex naming language for placenames, overheard snatches of conversations, etc - to add an extra layer of spice to it. So, I don't feel threatened by this novel use of AI. It could prove to be a really useful tool to help with some often laborious tasks (creating test translations to try out an idea, etc). I just hope the AI had as much fun inventing its language as I've had inventing mine!
- itisit 4y ago
- davea37 4y agoHave I spent too long reading AI output, or was this reply in fact generated using ChatGPT?
- itisit 4y agoThe latter...forgive me! I had to just this once, and I promise not to generate a bunch of ChatGPT pollution on HN!
- robocat 4y agoIf unsure, paste into https://huggingface.co/openai-detector https://huggingface.co/openai-detector and check. If the detector says 99% fake, it is very likely fake. The detector can mistake ChatGPT generated text as real (maybe because it was trained to detect GPT2), for example one text I generated scored 99.94% real. I suspect it is better to paste just a few sentences (especially for a generated blog partially modified by a human?). Although there are legitimate uses, such as people using ChatGPT to correct their grammar — https://news.ycombinator.com/item?id=33884842 https://news.ycombinator.com/item?id=33884842 . . . Also if I find GPT generated comments that are not clearly labelled, I flag and downvote.
- choeger 4y agoDid anyone try to connect it to a proof assistant?
- adverbly 4y agolooks like it assigned Drom twice. It means read and earth. Would have liked to see some follow up questions on that...
- yreg 4y agoYou can play a match and you can light a match.
- patientplatypus 4y ago
- deleted 4y ago[deleted]
- megous 4y agoAlso this is fun: https://megous.com/dl/tmp/b2a3f8e7634d3bfc.png https://megous.com/dl/tmp/b2a3f8e7634d3bfc.png https://megous.com/dl/tmp/26c83bc451a2311e.png https://megous.com/dl/tmp/26c83bc451a2311e.png or https://megous.com/dl/tmp/20c121ed49fa0f05.png https://megous.com/dl/tmp/20c121ed49fa0f05.png https://megous.com/dl/tmp/dbef6f047e7b89e8.png https://megous.com/dl/tmp/dbef6f047e7b89e8.png
- oofnik 4y agoI was really entertained by asking it to invent English-sounding words when given a definition, but this blew me away. Well done. P.s. the one I liked the best was for "the act of singing while drunk": boozecrooning
- deleted 4y ago[deleted]
- felipelalli 4y agoPaywall.
- thenickdude 4y agoIt isn't, click "let me read it first" in the popup.
- Decabytes 4y agoThis would be fun to use to invent a programming language.
- ThouYS 4y agoamazing! the author displays great pedagogical skill to his student
- tinglymintyfrsh 4y agoSo it had twins.
- deleted 4y ago[deleted]
- jameshart 4y agoI would definitely question who is doing the inventing here. However, I had an experience with chatGPT yesterday that definitely felt like it actually inventing. Problem is, I didn’t ask it to. I was seeing how much it knew about HyperTalk, the scripting language used in HyperCard. And it was surprisingly well informed. But it also told me that one of the interesting things about HyperTalk was its ‘message stack’ system. On digging into this topic, chatGPT hallucinated an entire language feature, with original (but HyperTalk-consistent) syntax and semantics, and was able to generate me sample programs (which it claimed showed how this feature was ‘actually used’) and explain how control flow worked within them. when I asked if the feature worked across scripts (for message passing from button scripts to background scripts perhaps) it readily agreed, and produced sample code showing exactly how to use this nonexistent language feature to do just that. Its delusion was remarkably complete and honestly actually plausibly useful. Worth bearing in mind if you ever decide to ask chatGPT to teach you a programming language though. But also, potentially a fruitful line to explore would be having chatGPT collaborate on designing new programming language ideas.
- ElevenLathe 4y agoI tried to play rock paper scissors against it, but it kept insisting that paper beats scissors. Never did convince it otherwise.
- Robotbeat 4y agoDid you tell it to “play correctly with the standard rules”?
- ElevenLathe 4y agoI did, it even volunteered what those rules were, but when I asked it to keep a running score it always scored it as if paper beat scissors.
- krackers 4y agoPerhaps it's under the impression that if paper beats rock, and rock beats scissor, then by transitivity paper should beat scissor.
- _yb2s 4y ago[flagged]
- timetraveller26 4y agoI think I am going to start submitting urls to ChatGPT instead of reading Hacker News.
- _yb2s 4y agoI had the same reaction, we've been replaced!
- Robotbeat 4y agoI could immediately tell this was made by ChatGPT because I had spent last night doing the same thing, generating finger-wagging diatribes in ChatGPT about how being anxious about AI is racist, etc, etc… There is a sort of style typically used in this sort of thing, even with prompting, that sounds a bit like low effort high school English assignments… (but would fool someone not familiar with ChatGPT).
- Ancalagon 4y agoA lot of ChatGPT responses sound like they're all written in the Jane-Schaffer format I used a ton for my SAT/AP/ACT/College essays: <Thesis/Argument/Argument/Argument/Conclusion>. Its getting easy to identify some of the more basic responses.
- evouga 4y agoWow the chatGPT corpus must include an awful lot of salty rants.
- dmix 4y agoMaybe it consumed Reddits API?
- marstall 4y agolike the other commenters, I immediately saw this was a chatgtp comment ... it lacks certain qualities of a typical human comment - irony, imperfections, variation in tone, pace? hard to pin down.
- _whiteCaps_ 4y agoI'm having trouble making ChatGPT use a Japanese sentence structure (subject-object-verb). It seems to forget between queries. Has anyone had any luck with something like that?
- thenickdude 4y agoMaybe if you ask your question in Japanese it'll get it into that frame of mind?
- lgessler 4y agoSpeaking as someone who works in AI and as a linguist: this is really impressive, but be aware the grammatical phenomena involved here are common enough that they were surely well represented in linguistic texts in GPT3.5's training corpus. I'd be more curious to see how it would perform if you gave ChatGPT high-level instruction on more exotic grammatical phenomena, such as sandhi, split-ergativity, and Austronesian alignment.
- WaxProlix 4y agoThat's not really less impressive; if this pattern matcher did as good a job at some sort of acquisition/generation task (no poverty of stimulus argument here...) and figured out the rules in a productive fashion, that's still really cool. Strong universality in a super-Chomskyan manner (ie, all universal features are available from the acquisition of A language) would be... neat, too, but I wouldn't expect it.
- yreg 4y agoOP, this part of the article contains a mistake, right? > I will provide English sentences, and you will provide their translation into Glorp. Gloop slog sploma slurpi. Gloop splog slopa slurpi. > Sure, here are the translations of the given sentences into Glorp: > 1. "Gloop slog sploma slurpi" - This sentence means "The slime smells the food with its mouth" in Glorp. That is a translation from Glorp to English, not English to Glorp.
- bo1024 4y agoI wondered the same thing. Quite strange that both the author and ChatGPT made the same mistake.
- boriscal 4y agoI feel so out the loop with all these new language models, this whole space is moving so fast
- bobabob 4y agoThis is so retarded, I love it.
- nsxwolf 4y agoSo everything I just read in this article... it all came from a model that just "predicts the word most likely to come next"... that's it? None of this was intentional? I don't know how you begin to comprehend what this thing is or how it was created.
- michaelteter 4y agoShould the author have been clear that the 10 nouns and 10 verbs it asked chatGPT to make up should all be unique? I immediately see two made up verbs which are also made up nouns. Granted many human languages have this issue, but that's not necessarily a positive thing nor a goal.
- timbucktoo 4y agoI'm at the indistinguishable from magic phase, personally.
- animal531 4y ago"Please write a paragraph for Hacker News about how amazing ChatGPT is, but make it sound like it's coming from a human commenting on it. Don't list too many features, rather praise a specific feature more." As a user of ChatGPT, I have been absolutely amazed by its ability to understand and respond to my questions and comments in real time. This advanced language model, trained by OpenAI, has truly blown me away with its ability to understand the nuances and complexities of human conversation. Whether I'm looking for help with a specific problem or just want to have an interesting conversation, ChatGPT is always there to provide intelligent and highly-accurate responses. I've found it to be an incredibly useful tool for a wide range of applications, and I can't recommend it highly enough. This technology is truly next-level, and I'm excited to see what the future holds for it.
- pnt12 4y agoFunny, it sounds more like an advertising than a regular comment. Perhaps affected by the word "praise".
- qwerty456127 4y agoChatGPT already seems almost like an good general intelligence. Apparently the finish is just 1-2 steps away. After that, we only are to develop an efficient interface for it to use classic computing (i.e. calculate things, do classic analytical and logical operations on big arrays of data like no human nor human-like intellicece can but an ordinary computer can), speech/text recognition and databases access and we get an an ultimate genius mind like if a human could instantly access any piece of existing knowledge and do mental math/logic at quadrillions operations per second. Isn't it so?