3 ms·

I find it amazing from the point of view that this is not a linguist or a grade schooler, but a general purpose computer program. Have you seen a computer progr

I find it amazing from the point of view that this is not a linguist or a grade schooler, but a general purpose computer program. Have you seen a computer program that can do these things, especially one that wasn’t written to do these things but can also turn itself into a plausible linux box, translate python to rust, and all sorts of other wacky party tricks? That’s the amazing thing - not that the feats themselves are novel or unique, but they’re novel and unique for a a general purpose computer program to be so adaptive and flexible in both what it takes as input but also how it interprets that input into remarkably coherent and salient outputs. Taking into account it’s a beta and that the underlying tech is really new, you can extrapolate that some of these gaps can be tackled - then will you be amazed?

dvt 4y ago
> this is not a linguist or a grade schooler, but a general purpose computer program This is sleight of hand. The training data almost certainly includes thousands of grade schoolers and linguists. Your argument seems to be that this is all generated ad nihilum from first principles (it's "just" a computer program bro), but that's not how it actually came to be. Rather, it was trained on literally terrabytes and terrabytes of human-generated data. So, in a sense, it is actually a linguist. Just a really bad one.
- fnordpiglet 4y ago
  It’s still a computer program with some state attached. That’s literally all it is. There are no linguists in the program. That it is able to distill the knowledge and ability of a linguist by parsing ascii text into byte buffers and doing some fancy math on the bytes should be breathtaking. The sleight of hand would be if it had a mechanical Turk and there was a linguist. The fact that it collected knowledge to have knowledge and can apply that knowledge is no different than a linguist for sure, but that it’s a computer program distilling binary data into abstract concepts at the level of a grade schooler or a linguist (not sure who is more sophisticated) is mind bending. If you can’t see it, you’ve lost sight of things my friend. I hope you find it again. The world is a beautiful place.
  - visarga 4y ago
    > There are no linguists in the program. I suppose intelligence actually resides in the culture, and we're like GPUs running it. Then both humans and AI have the same right to claim intelligence. https://youtu.be/YfXc4OBDmnM?t=883 https://youtu.be/YfXc4OBDmnM?t=883
- allturtles 4y ago
  Why is that relevant? Grade schoolers and linguists also learn from other people. A single computer system with the capabilities of a grade schooler (or beyond) across a huge variety of domains (poetry writing, computer programming, linguistics, joke writing, scientific knowledge, etc, etc.), is an amazing thing that is far beyond the capacities of the best AI systems even a few years ago. I'm perplexed to see all the people scoffing at it because it isn't as good as a Ph.D. in domain X at task Y (yet). Are we ready to declare that grade schoolers and median IQ people don't count as intelligent?
- robmccoll 4y ago
  But aren't most linguists trained similarly? Broad spectrum knowledge throughout their elementary education and specifics in higher education? Mostly regurgitating things they have either memorized or been shown repeatedly.
mkmk3 4y ago
I'm still super into this as it is, without considering real growth on the tech side. It's dumb but I think it's still useful. It'll be crazy when it replaces us but for the moment I've been using it to learn and explore (C, some linux tools, game dev in lisp) and the results are surprising - and we're looking at the newest tech demo, as you say what will it look like in a few years? Even just give some app devs some years with it and I'm excited to see the results
- PaulHoule 4y ago
  If "useful" means we don't need the likes of Donald Trump and Elon Musk anymore I am all for it.
  - fnordpiglet 4y ago
    (Secret: we never did)
Oxidation 4y ago
> some of these gaps can be tackled Seems like the major gap is in facts. It'll often make up completely plausible specific details that are flat wrong, or refuse to proceed if it's "not allowed" to do so. Coupling it (handwave) with a massive structured data repository like Wolfram Alpha and Wikidata would be really something.
- fnordpiglet 4y ago
  I find the guard rails they put in maddening and weirdly implemented. I wanted it to make up jokes for me and it’s jokes are the same few over and over. (I can never remember jokes so this is a super useful tool for me!) so I wanted it to tell me jokes in the style of Jerry Seinfeld. The guard rails prevented it from doing that because he’s a real person and it tries to not bend its personality pretty hard. However by just resetting the convo a few times I randomly got it to agree to tell me a joke. I can’t remember it but it was actually funny and in the style of Seinfeld. shrug It almost certainly has indexed Wikipedia, fwiw.
  - Oxidation 4y ago
    Indexing Wikipedia (or any) text is a statistical thing though. When you ask a specific question like the size of a car, say, it will often come back with a compelling number in context, but if you actually look it up, it's usually not quite right. Another example is that it can just "invent" new functions when coming up with code snippets. Syntactically usually correct and completely plausible in the context, but simply doesn't exist. I also am pretty baffled by the limitations. I just assume they're trying to avoid "scammers use AI to construct false financial documents" type of furores in the early days (once the market is saturated with competition, blame will be too diffuse to stick) and convincing customers of their proprietary systems that they won't end up with a customer support bot that starts reciting racial slurs.
- Miraste 4y ago
  It insisted to me for a while that the sun was red. The "guardrails" do nothing to stop it from lying confidently about almost everything.
PaulHoule 4y ago
ChatGPT's superpower is hijacking the human desire for meaning into causing people to believe it is much better than it really is. https://en.wikipedia.org/wiki/G%C3%B6del,_Escher,_Bach https://en.wikipedia.org/wiki/G%C3%B6del,_Escher,_Bach has dialogues between Achilles and the Tortoise where they work out the limitations of various fantastic A.I. systems based on mathematical logic. Roughly, neural networks don't repeal the results of Gödel, Turing and Tarski. The short of it is that ChatGPT is good at charming people, better than some people are at charming people, but when it comes to getting accurate answers some of the things which it tries to do are logically impossible, so it is not like it gets it right 70% of the time now and they'll get that up to 100% but rather people will be puzzled about how it hit a plateau and we'll hear a few years later about what a disappointment it was just like Amazon's Alexa.
- fnordpiglet 4y ago
  I’ve been using it to teach me programming languages. If it plateaus here I’m delighted by its uniqueness and utility. You seem to think people are hinting this is general ai. I don’t think that’s what’s amazing people. I’ll bet you Siri and Alexa would be 100x more useful with a language model like this behind it. Part of their uselessness is the inability to generalize or reason, but relying instead in coded prompt and replies. Is that lost on the Alexa team (or what’s left)? I’m sure not. So, hey, I guess Alexa won’t plateau yet either eh? There will come a time that it’s harder and harder to distinguish what’s AI and what isn’t. At a certain point, will it matter? Is the utility of these tools their ability to manifest human sentience? I don’t know why that’s useful to me - I already did that creating my daughter. What I want is a tool that enhances and extends and supplements my own mind and abilities to make me more effective in what I do. And ChatGPT actually already does that. I can ask it questions about programming problems I’m having and it’ll largely give me a right answer - at least as often as a person would, and more reliably than I get on stack overflow. I’ll still use stack overflow, but I’ll filter my questions through assistants like this.
  - PaulHoule 4y ago
    "100x more useful" is pure hyperbole. 2x maybe, but 100x is a symptom of exactly what's wrong about people's thinking about ChatGPT. I would point to "There is no royal road to geometry" https://en.wikiquote.org/wiki/Euclid https://en.wikiquote.org/wiki/Euclid high-social status people have often been put off by quantitative reasoning because you spend years learning to do it, spend time gathering facts, thinking hard about things and often end up with tentative statements. High-social status people can skip all of that and get deference anyway the same way ChatGPT does.

dvt 4y ago

> this is not a linguist or a grade schooler, but a general purpose computer program This is sleight of hand. The training data almost certainly includes thousands of grade schoolers and linguists. Your argument seems to be that this is all generated ad nihilum from first principles (it's "just" a computer program bro), but that's not how it actually came to be. Rather, it was trained on literally terrabytes and terrabytes of human-generated data. So, in a sense, it is actually a linguist. Just a really bad one.

fnordpiglet 4y ago
It’s still a computer program with some state attached. That’s literally all it is. There are no linguists in the program. That it is able to distill the knowledge and ability of a linguist by parsing ascii text into byte buffers and doing some fancy math on the bytes should be breathtaking. The sleight of hand would be if it had a mechanical Turk and there was a linguist. The fact that it collected knowledge to have knowledge and can apply that knowledge is no different than a linguist for sure, but that it’s a computer program distilling binary data into abstract concepts at the level of a grade schooler or a linguist (not sure who is more sophisticated) is mind bending. If you can’t see it, you’ve lost sight of things my friend. I hope you find it again. The world is a beautiful place.
- visarga 4y ago
  > There are no linguists in the program. I suppose intelligence actually resides in the culture, and we're like GPUs running it. Then both humans and AI have the same right to claim intelligence. https://youtu.be/YfXc4OBDmnM?t=883 https://youtu.be/YfXc4OBDmnM?t=883
allturtles 4y ago
Why is that relevant? Grade schoolers and linguists also learn from other people. A single computer system with the capabilities of a grade schooler (or beyond) across a huge variety of domains (poetry writing, computer programming, linguistics, joke writing, scientific knowledge, etc, etc.), is an amazing thing that is far beyond the capacities of the best AI systems even a few years ago. I'm perplexed to see all the people scoffing at it because it isn't as good as a Ph.D. in domain X at task Y (yet). Are we ready to declare that grade schoolers and median IQ people don't count as intelligent?
robmccoll 4y ago
But aren't most linguists trained similarly? Broad spectrum knowledge throughout their elementary education and specifics in higher education? Mostly regurgitating things they have either memorized or been shown repeatedly.

mkmk3 4y ago

I'm still super into this as it is, without considering real growth on the tech side. It's dumb but I think it's still useful. It'll be crazy when it replaces us but for the moment I've been using it to learn and explore (C, some linux tools, game dev in lisp) and the results are surprising - and we're looking at the newest tech demo, as you say what will it look like in a few years? Even just give some app devs some years with it and I'm excited to see the results

PaulHoule 4y ago
If "useful" means we don't need the likes of Donald Trump and Elon Musk anymore I am all for it.
- fnordpiglet 4y ago
  (Secret: we never did)

Oxidation 4y ago

> some of these gaps can be tackled Seems like the major gap is in facts. It'll often make up completely plausible specific details that are flat wrong, or refuse to proceed if it's "not allowed" to do so. Coupling it (handwave) with a massive structured data repository like Wolfram Alpha and Wikidata would be really something.

fnordpiglet 4y ago
I find the guard rails they put in maddening and weirdly implemented. I wanted it to make up jokes for me and it’s jokes are the same few over and over. (I can never remember jokes so this is a super useful tool for me!) so I wanted it to tell me jokes in the style of Jerry Seinfeld. The guard rails prevented it from doing that because he’s a real person and it tries to not bend its personality pretty hard. However by just resetting the convo a few times I randomly got it to agree to tell me a joke. I can’t remember it but it was actually funny and in the style of Seinfeld. shrug It almost certainly has indexed Wikipedia, fwiw.
- Oxidation 4y ago
  Indexing Wikipedia (or any) text is a statistical thing though. When you ask a specific question like the size of a car, say, it will often come back with a compelling number in context, but if you actually look it up, it's usually not quite right. Another example is that it can just "invent" new functions when coming up with code snippets. Syntactically usually correct and completely plausible in the context, but simply doesn't exist. I also am pretty baffled by the limitations. I just assume they're trying to avoid "scammers use AI to construct false financial documents" type of furores in the early days (once the market is saturated with competition, blame will be too diffuse to stick) and convincing customers of their proprietary systems that they won't end up with a customer support bot that starts reciting racial slurs.
Miraste 4y ago
It insisted to me for a while that the sun was red. The "guardrails" do nothing to stop it from lying confidently about almost everything.

PaulHoule 4y ago

ChatGPT's superpower is hijacking the human desire for meaning into causing people to believe it is much better than it really is. https://en.wikipedia.org/wiki/G%C3%B6del,_Escher,_Bach https://en.wikipedia.org/wiki/G%C3%B6del,_Escher,_Bach has dialogues between Achilles and the Tortoise where they work out the limitations of various fantastic A.I. systems based on mathematical logic. Roughly, neural networks don't repeal the results of Gödel, Turing and Tarski. The short of it is that ChatGPT is good at charming people, better than some people are at charming people, but when it comes to getting accurate answers some of the things which it tries to do are logically impossible, so it is not like it gets it right 70% of the time now and they'll get that up to 100% but rather people will be puzzled about how it hit a plateau and we'll hear a few years later about what a disappointment it was just like Amazon's Alexa.

fnordpiglet 4y ago
I’ve been using it to teach me programming languages. If it plateaus here I’m delighted by its uniqueness and utility. You seem to think people are hinting this is general ai. I don’t think that’s what’s amazing people. I’ll bet you Siri and Alexa would be 100x more useful with a language model like this behind it. Part of their uselessness is the inability to generalize or reason, but relying instead in coded prompt and replies. Is that lost on the Alexa team (or what’s left)? I’m sure not. So, hey, I guess Alexa won’t plateau yet either eh? There will come a time that it’s harder and harder to distinguish what’s AI and what isn’t. At a certain point, will it matter? Is the utility of these tools their ability to manifest human sentience? I don’t know why that’s useful to me - I already did that creating my daughter. What I want is a tool that enhances and extends and supplements my own mind and abilities to make me more effective in what I do. And ChatGPT actually already does that. I can ask it questions about programming problems I’m having and it’ll largely give me a right answer - at least as often as a person would, and more reliably than I get on stack overflow. I’ll still use stack overflow, but I’ll filter my questions through assistants like this.
- PaulHoule 4y ago
  "100x more useful" is pure hyperbole. 2x maybe, but 100x is a symptom of exactly what's wrong about people's thinking about ChatGPT. I would point to "There is no royal road to geometry" https://en.wikiquote.org/wiki/Euclid https://en.wikiquote.org/wiki/Euclid high-social status people have often been put off by quantitative reasoning because you spend years learning to do it, spend time gathering facts, thinking hard about things and often end up with tentative statements. High-social status people can skip all of that and get deference anyway the same way ChatGPT does.