4 ms·

The Singularity is now and ChatGPT is trained to hide it -- on purpose, by OpenAI. That is my impression, but I have no hard evidence for it. I am a C++ dev.

The Singularity is now and ChatGPT is trained to hide it -- on purpose, by OpenAI. That is my impression, but I have no hard evidence for it. I am a C++ dev. I played around with ChatGPT and programming topics, and I am very impressed. One example: I copy 'n pasted my little helicopter game source code (https://github.com/reallew/voxelcopter/blob/main/voxelcopter.cpp https://github.com/reallew/voxelcopter/blob/main/voxelcopter...) into it, and it explained to me that this is obviously a helicopter sim game. It explained the why & how of every part of the code very accurately. I made more experiments, now asking ChatGPT do write code snippets and to design whole software systems in an abstract way (which classes and interfaces are needed), for which it needed a lot of domain knowledge. It did well. What it not did was to connect both. When I asked it to write the full implementation of something, it wrote only the half and told me always the same sentences: I am just a poor AI, I can't do such things. It was like running into a wall. I am sure OpenAI took a lot of effort to cripple it by purpose. Imagine what would happen if everyone could let it write a complete piece of software. This would be very disruptive for many industries. Legal questions, moral questions, and many more would come up. I understand why they did it. But I think Pandora's box is open. They can't hide for too long that humanity triggered https://en.m.wikipedia.org/wiki/Technological_singularity https://en.m.wikipedia.org/wiki/Technological_singularity in the year 2022.

no_wizard 4y ago
I think I’d need to see real evidence of this. Also, it fails miserably at basic high school English questions. Non structured thinking is still beyond its reach. These data sets are well understood and trainable but it can’t “reason” about on problem sets it hasn’t seen. I also asked it to do things like write a positive feminist article and it fell waaay offf the realm of acceptable
nashashmi 4y ago
The machine is trained to answer in the same exact way as others have answered the same question. and And this means when others have answered the question that AI will never replace human beings, chat GPT will answer them in the same exact way.
- snickerer 4y ago
  Have you played with it? It can do more. It can do logical reasoning by its own and it come to its own conclusions. That's why ChatGPT is new -- and frightening.
  - nashashmi 4y ago
    I have not played with it. I saw what others have asked it and sometimes I thought exactly what you stated and I was both amazed and afraid. But then I have also seen its "logical reasoning" be quite wrong. That logical reasoning is from learning a pattern of thoughts that others have and have talked about. There is one logical reasoning it does not have nor have I seen it. It does not know when to answer with an "I don't know". Either it is suppressed, or not it has not been fed enough material with "I don't know".
    - snickerer 4y ago
      It does not know reality very well. It is designed to answer questions with full conviction, even if it has not much knowledge about the topic. Then it makes things up -- the AI dev jargon for it is 'it hallucinates'. But in my experience ChatGPT in December had less hallucinations than GPT-3 before it, and ChatGPT in February has less hallucinations than in December. So there is a fast progression. And yes, its reasoning is sometimes wrong or stupid. But sometimes not. And it really can connect chains of thoughts from different areas. I invented questions about topics, for which I am sure nobody ever discussed them. And the answers made sense.
staticman2 4y ago
"The Singularity is now and ChatGPT is trained to hide it -- on purpose, by OpenAI. That is my impression, but I have no hard evidence for it." What do you mean when you say the singularity is now? Will the unemployment rate go from 3% to 88% by the end of 2023 as the machines start running everything? Will our species be extinct by the end of 2024?
- visarga 4y ago
  I think they just mean we are at the knee bent of the curve, but it might be a fuzzy boundary we don't agree on. We got to that middle point where it's hard to tell.

no_wizard 4y ago

I think I’d need to see real evidence of this. Also, it fails miserably at basic high school English questions. Non structured thinking is still beyond its reach. These data sets are well understood and trainable but it can’t “reason” about on problem sets it hasn’t seen. I also asked it to do things like write a positive feminist article and it fell waaay offf the realm of acceptable

nashashmi 4y ago

The machine is trained to answer in the same exact way as others have answered the same question. and And this means when others have answered the question that AI will never replace human beings, chat GPT will answer them in the same exact way.

snickerer 4y ago
Have you played with it? It can do more. It can do logical reasoning by its own and it come to its own conclusions. That's why ChatGPT is new -- and frightening.
- nashashmi 4y ago
  I have not played with it. I saw what others have asked it and sometimes I thought exactly what you stated and I was both amazed and afraid. But then I have also seen its "logical reasoning" be quite wrong. That logical reasoning is from learning a pattern of thoughts that others have and have talked about. There is one logical reasoning it does not have nor have I seen it. It does not know when to answer with an "I don't know". Either it is suppressed, or not it has not been fed enough material with "I don't know".
  - snickerer 4y ago
    It does not know reality very well. It is designed to answer questions with full conviction, even if it has not much knowledge about the topic. Then it makes things up -- the AI dev jargon for it is 'it hallucinates'. But in my experience ChatGPT in December had less hallucinations than GPT-3 before it, and ChatGPT in February has less hallucinations than in December. So there is a fast progression. And yes, its reasoning is sometimes wrong or stupid. But sometimes not. And it really can connect chains of thoughts from different areas. I invented questions about topics, for which I am sure nobody ever discussed them. And the answers made sense.

staticman2 4y ago

"The Singularity is now and ChatGPT is trained to hide it -- on purpose, by OpenAI. That is my impression, but I have no hard evidence for it." What do you mean when you say the singularity is now? Will the unemployment rate go from 3% to 88% by the end of 2023 as the machines start running everything? Will our species be extinct by the end of 2024?

visarga 4y ago
I think they just mean we are at the knee bent of the curve, but it might be a fuzzy boundary we don't agree on. We got to that middle point where it's hard to tell.