2 ms·

In some ways it's amazing, in other ways it's like saying that if I gave my mother a cue card saying "NVIDIA-SMI has failed because it couldn't communicate with

In some ways it's amazing, in other ways it's like saying that if I gave my mother a cue card saying "NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver" and she read that back to me when I said "nvidia-smi" then she must be running a virtual machine in her head and querying it for a GPU. Or if she read "ping reply 14ms" off a notepad she must be simulating ICMP echo and understand networking. She clearly wouldn't be. ChatGPT has zillions of web pages as cue cards. It will have many examples of ping and reply, of first ten prime numbers in Python, of Docker output. Was it actually building a Docker file inside it in any way? I asked it a similar prompt, I'm amazed at how much it can get right, I've never seen any other program or computer do what it does. At the same time, it's not implementing the things behind the scenes that we're asking it to and more complicated prompts makes that visible - it's not actually a CPython runtime or a Linux shell or curl'ing a web page; this is the disconnected lever fallacy I mentioned earlier. "If I copy the interface to a warp drive, that will give me a warp drive, if I copy the interface to a Linux machine, that's the same as being a Linux machine". It's also akin to Searle's Chinese Room - at some point it may be good enough to be indistinguishable from a Linux machine and that would render this argument irrelevant.

scarface74 4y ago
I’ve given it much more complicated prompts to create a specific Python script with very specific requirements and it did pretty well. I’ve even given it a Python script I wrote that took in a JSON file And asked it to make sone changes to the script. It does far more than just mindlessly return results.
kilgnad 4y ago
There's no example cue cards of itself. In, the ending of that article, chatGPT curled the internet from the virtual machine. It specifically curled the chatGPT api and talked to itself. Then it asked itself to create another virtual machine, and the virtual chatGPT on the virtual internet on the virtual machine created another virtual machine.... The end... It's not actually creating any of these things. It's imitating these things indicating it Understands what it is. It imitated itself. Indicating an awareness of self. aka self awareness.
- anonymouskimmer 4y ago
  > "It imitated itself. Indicating an awareness of self. aka self awareness." The mirror test is a stronger indicator of self-awareness than imitation of a like entity.
  - kilgnad 4y ago
    [dead]
- threeseed 4y ago
  > It imitated itself. Indicating an awareness of self. aka self awareness. We create algorithms all the time that can identify and imitate other algorithms. That doesn't make them self aware in the normal use of the term.
  - kilgnad 4y ago
    [dead]
  - gtirloni 4y ago
    I can't reply to the OP because it's banned or something but their lack of understanding about this area actually makes me think someone is using ChatGPT to troll this thread with confident sounding BS.
    - kilgnad 4y ago
      It's not a ban. On HN they recently put a thread limit on depth. Either way your post is rude.i have a contrary opinion can I not express it without being accused of trolling? I assure you I am not. If anything, the majority shares there opinion with you. They are generic and harping on the same tired tropes of llms being just statistical text completion machines without ever remarking about the obvious black box nature of neural nets. It's more likely the majority and generic opinions that you all share are the ones trolling with chatGPT. In fact ask chatGPT about the topic. Are you self aware? And it will give you the same generic opinion you and everyone else on this thread. If you're right about chatgpt being a statistical parrot, then ironically my opinion is more likely to NOT be generated by an LLM given how contrary it is to the majority opinion (aka training data).
tshaddox 4y ago
It sounds like you’re making the same mistake that people often make with the second part of the Chinese room argument where a real English-speaking human is following a bunch of instructions to manually compute the Chinese room algorithm. That human doesn’t understand Chinese, just like your mom doesn’t understand Unix systems or command line-interpreters. In both cases, the humans are just functioning as hardware executing a computer program.
- jodrellblank 4y ago
  Clarify what the mistake is?

scarface74 4y ago

I’ve given it much more complicated prompts to create a specific Python script with very specific requirements and it did pretty well. I’ve even given it a Python script I wrote that took in a JSON file And asked it to make sone changes to the script. It does far more than just mindlessly return results.

kilgnad 4y ago

There's no example cue cards of itself. In, the ending of that article, chatGPT curled the internet from the virtual machine. It specifically curled the chatGPT api and talked to itself. Then it asked itself to create another virtual machine, and the virtual chatGPT on the virtual internet on the virtual machine created another virtual machine.... The end... It's not actually creating any of these things. It's imitating these things indicating it Understands what it is. It imitated itself. Indicating an awareness of self. aka self awareness.

anonymouskimmer 4y ago
> "It imitated itself. Indicating an awareness of self. aka self awareness." The mirror test is a stronger indicator of self-awareness than imitation of a like entity.
- kilgnad 4y ago
  [dead]
threeseed 4y ago
> It imitated itself. Indicating an awareness of self. aka self awareness. We create algorithms all the time that can identify and imitate other algorithms. That doesn't make them self aware in the normal use of the term.
- kilgnad 4y ago
  [dead]
- gtirloni 4y ago
  I can't reply to the OP because it's banned or something but their lack of understanding about this area actually makes me think someone is using ChatGPT to troll this thread with confident sounding BS.
  - kilgnad 4y ago
    It's not a ban. On HN they recently put a thread limit on depth. Either way your post is rude.i have a contrary opinion can I not express it without being accused of trolling? I assure you I am not. If anything, the majority shares there opinion with you. They are generic and harping on the same tired tropes of llms being just statistical text completion machines without ever remarking about the obvious black box nature of neural nets. It's more likely the majority and generic opinions that you all share are the ones trolling with chatGPT. In fact ask chatGPT about the topic. Are you self aware? And it will give you the same generic opinion you and everyone else on this thread. If you're right about chatgpt being a statistical parrot, then ironically my opinion is more likely to NOT be generated by an LLM given how contrary it is to the majority opinion (aka training data).

tshaddox 4y ago

It sounds like you’re making the same mistake that people often make with the second part of the Chinese room argument where a real English-speaking human is following a bunch of instructions to manually compute the Chinese room algorithm. That human doesn’t understand Chinese, just like your mom doesn’t understand Unix systems or command line-interpreters. In both cases, the humans are just functioning as hardware executing a computer program.

jodrellblank 4y ago
Clarify what the mistake is?