4 ms·

From my experience working with ChatGPT, I believe that it exhibits many of the characteristics of AGI. For example, it can correctly interpret and parse novel

From my experience working with ChatGPT, I believe that it exhibits many of the characteristics of AGI. For example, it can correctly interpret and parse novel requests, complete tasks that are virtually impossible for a machine to accomplish (example below), perform at the level of an average high school student in most areas, demonstrate judgment and opinion (go ahead, ask it to give you an opinion about something you propose to it), and assemble plans for novel situations. However, ChatGPT still has limitations, such as difficulty with numeracy, handling individual characters, and visual tasks. It's also worth noting that ChatGPT's mistakes sometimes sound like those of a child, and it can sometimes produce code that needs minor changes to work. Despite these obvious shortcomings, it passes my personal standard for the first demonstration of limited AGI. [above is based on chatgpt's summary of my long draft here: https://hastebin.com/raw/muzuvodupu https://hastebin.com/raw/muzuvodupu - I also added the last line above and the parentheticals.]

ilaksh 4y ago
As far as the supervisor/worker idea, it can act as both. You can just say "outline the steps for this" and then "implement step 1 above", "implement step 2". It does much better than when you try to get it to fulfill an entire complex task in one shot. I have been testing some things with text-davinci-003 which is not the same as ChatGPT but quite similar. https://aidev.codes/u/runvnc/flappy/edit https://aidev.codes/u/runvnc/flappy/edit
- logicallee 4y ago
  Quite interesting! Great job on what you put up so far. I was thinking along the same lines. Can you put some form of contact on your profile or contact me at mine, I'd love to chat with you about what you're doing. One thing to note: I don't think a visual game is the best scenario for this because it is very bad at recognizing images, which means it is like asking a blind person to judge a painting. Not a fair task, since it doesn't have a visual cortex at all. For example, I tried to get chatgpt to output vector graphics in svg format, but it didn't do a great job. I also asked it to recognize what object is in an svg vector image and it took a guess that wasn't bad but was far from being a suitable object detection, it didn't really recognize or describe the object in the svg graphic accurately. Here is the svg I asked it to describe, it is the default image when you open this svg editor: https://www.svgviewer.dev/ https://www.svgviewer.dev/ I copied this default image into chatgpt and asked it to describe it, and likewise you can ask it to generate its own svg, same as code, but it does very badly. For the example image, it thought it was a mobile phone, whereas it was a depiction of a piece of paper with the corner bent down and some writing on it - a mobile phone is not a bad guess but far worse than it does for language-based tasks, and it didn't describe any part of the square, the circle, or the text "SVG".) I just repeated the experiment and got this interesting transcript you could look at if you want: https://hastebin.com/raw/cuqodivotu https://hastebin.com/raw/cuqodivotu As you can see it just does okay, not great. So instead of these types of tasks, I think the supervision should be something that does not involve any imagery at all but is still a sort of generic puzzle. If you have some form of contact I'd love to chat with you about this area of research (this is not job-related).
  - ilaksh 4y ago
    Thanks. If it's possible maybe you could click the Discord link in the upper right hand corner of that web site? That is my new Discord. I am runvnc in there. If not I am in the OpenAI Discord under the api-projects. You can also just email me runvnc at gmail dot com. Yeah, it's actually kind of funny when you ask it to make something with SVG. It can get some of the shapes in there but doesn't know how to arrange them at all. I was aware of the lack of visual data in the training etc, flappy was just kind of a late night random idea. But I have done some simple tests with for example telling it to write a a few basic unit tests and putting it in a loop. Also was kind of a mixed result but it depends on how you do it. Would love to discuss this stuff whenever.

ilaksh 4y ago

As far as the supervisor/worker idea, it can act as both. You can just say "outline the steps for this" and then "implement step 1 above", "implement step 2". It does much better than when you try to get it to fulfill an entire complex task in one shot. I have been testing some things with text-davinci-003 which is not the same as ChatGPT but quite similar. https://aidev.codes/u/runvnc/flappy/edit https://aidev.codes/u/runvnc/flappy/edit

logicallee 4y ago
Quite interesting! Great job on what you put up so far. I was thinking along the same lines. Can you put some form of contact on your profile or contact me at mine, I'd love to chat with you about what you're doing. One thing to note: I don't think a visual game is the best scenario for this because it is very bad at recognizing images, which means it is like asking a blind person to judge a painting. Not a fair task, since it doesn't have a visual cortex at all. For example, I tried to get chatgpt to output vector graphics in svg format, but it didn't do a great job. I also asked it to recognize what object is in an svg vector image and it took a guess that wasn't bad but was far from being a suitable object detection, it didn't really recognize or describe the object in the svg graphic accurately. Here is the svg I asked it to describe, it is the default image when you open this svg editor: https://www.svgviewer.dev/ https://www.svgviewer.dev/ I copied this default image into chatgpt and asked it to describe it, and likewise you can ask it to generate its own svg, same as code, but it does very badly. For the example image, it thought it was a mobile phone, whereas it was a depiction of a piece of paper with the corner bent down and some writing on it - a mobile phone is not a bad guess but far worse than it does for language-based tasks, and it didn't describe any part of the square, the circle, or the text "SVG".) I just repeated the experiment and got this interesting transcript you could look at if you want: https://hastebin.com/raw/cuqodivotu https://hastebin.com/raw/cuqodivotu As you can see it just does okay, not great. So instead of these types of tasks, I think the supervision should be something that does not involve any imagery at all but is still a sort of generic puzzle. If you have some form of contact I'd love to chat with you about this area of research (this is not job-related).
- ilaksh 4y ago
  Thanks. If it's possible maybe you could click the Discord link in the upper right hand corner of that web site? That is my new Discord. I am runvnc in there. If not I am in the OpenAI Discord under the api-projects. You can also just email me runvnc at gmail dot com. Yeah, it's actually kind of funny when you ask it to make something with SVG. It can get some of the shapes in there but doesn't know how to arrange them at all. I was aware of the lack of visual data in the training etc, flappy was just kind of a late night random idea. But I have done some simple tests with for example telling it to write a a few basic unit tests and putting it in a loop. Also was kind of a mixed result but it depends on how you do it. Would love to discuss this stuff whenever.