3 ms·
Quite interesting! Great job on what you put up so far. I was thinking along the same lines. Can you put some form of contact on your profile or contact me at
by logicallee 4y ago
Quite interesting! Great job on what you put up so far.
I was thinking along the same lines. Can you put some form of contact on your profile or contact me at mine, I'd love to chat with you about what you're doing.
One thing to note: I don't think a visual game is the best scenario for this because it is very bad at recognizing images, which means it is like asking a blind person to judge a painting. Not a fair task, since it doesn't have a visual cortex at all.
For example, I tried to get chatgpt to output vector graphics in svg format, but it didn't do a great job. I also asked it to recognize what object is in an svg vector image and it took a guess that wasn't bad but was far from being a suitable object detection, it didn't really recognize or describe the object in the svg graphic accurately.
Here is the svg I asked it to describe, it is the default image when you open this svg editor:
https://www.svgviewer.dev/ https://www.svgviewer.dev/
I copied this default image into chatgpt and asked it to describe it, and likewise you can ask it to generate its own svg, same as code, but it does very badly.
For the example image, it thought it was a mobile phone, whereas it was a depiction of a piece of paper with the corner bent down and some writing on it - a mobile phone is not a bad guess but far worse than it does for language-based tasks, and it didn't describe any part of the square, the circle, or the text "SVG".) I just repeated the experiment and got this interesting transcript you could look at if you want: https://hastebin.com/raw/cuqodivotu https://hastebin.com/raw/cuqodivotu
As you can see it just does okay, not great.
So instead of these types of tasks, I think the supervision should be something that does not involve any imagery at all but is still a sort of generic puzzle. If you have some form of contact I'd love to chat with you about this area of research (this is not job-related).
- ilaksh 4y agoThanks. If it's possible maybe you could click the Discord link in the upper right hand corner of that web site? That is my new Discord. I am runvnc in there. If not I am in the OpenAI Discord under the api-projects. You can also just email me runvnc at gmail dot com. Yeah, it's actually kind of funny when you ask it to make something with SVG. It can get some of the shapes in there but doesn't know how to arrange them at all. I was aware of the lack of visual data in the training etc, flappy was just kind of a late night random idea. But I have done some simple tests with for example telling it to write a a few basic unit tests and putting it in a loop. Also was kind of a mixed result but it depends on how you do it. Would love to discuss this stuff whenever.