4 ms·

Got to 4 or 5 on a few of them with NO. Then discovered a solid color put me on #1. AI is only as smart as it’s programming (which can be pretty darned smart,

Got to 4 or 5 on a few of them with NO. Then discovered a solid color put me on #1. AI is only as smart as it’s programming (which can be pretty darned smart, but this AI wasn’t trained to deal with people who are trying to break it). On a side note, Roboflow is freaking amazing. https://paint.wtf/ranking/5qms/pORkuKYlFhXWjn6SWD4M https://paint.wtf/ranking/5qms/pORkuKYlFhXWjn6SWD4M

SkynetIsFarAway 6y ago
Check my comments here; top with simple negativity -- but straight lines. Simple solid also works for some reason.
conradfr 6y ago
Oh that's why, I thought that was a bug with Firefox.
- pimlottc 6y ago
  Honestly, I thought it was broken and failing to load the images until I read this.
  - AnIdiotOnTheNet 6y ago
    I think it says a lot about the state of the web and web development that this was the first conclusion people drew.
azinman2 6y ago
And now it's ruined as so many submissions are just a solid color. It's really too bad, because if you go through the submissions there are some really amazing ones in there.. particularly for raccoon driving a tractor.
- wartijn_ 6y ago
  Yeah it's a shame, I get that someone tries to beat the ai, but you would think that it's less fun to draw the eleventh solid color when the top ten is already filled with them. On a more positive note: There are some awesome Giraffe in the arctic drawings as well. Like this masterpiece https://paint.wtf/ranking/IdF9/vBRMWbTGG9Td6oeMoim8 https://paint.wtf/ranking/IdF9/vBRMWbTGG9Td6oeMoim8 This is really fun to do, I'm currently ranked 36th for the racoon drawing and 15th for the giraffe (So top 5 if you ignore the solid colors), but I should probably do some work right now.
  - ArekDymalski 6y ago
    This giraffe is awesome. I wonder why it is ranked lower than this one: https://paint.wtf/ranking/IdF9/Y8CmWvlELvy1MoSU8Iv3 https://paint.wtf/ranking/IdF9/Y8CmWvlELvy1MoSU8Iv3
    - __s 6y ago
      Solid colors get higher ranks
- IshKebab 6y ago
  An example of humans breaking an AI's utility function, rather than the other way around!
chrischen 6y ago
Omg I thought the app was just broken and not loading drawings! I guess technically it's still broken, but just not in the way I thought.
yeldarb 6y ago
This is an interesting observation. The cool part about CLIP is that we can ask it any prompt we want. So “fixing” this loophole is just a matter of prompt engineering. We already added a penalty to the score for text by subtracting similarity to “handwritten text”. Any ideas what these solid color blocks would rank highly for that and actual drawing wouldn’t? I can update the prompts and regenerate the leaderboards this morning.

SkynetIsFarAway 6y ago

Check my comments here; top with simple negativity -- but straight lines. Simple solid also works for some reason.

conradfr 6y ago

Oh that's why, I thought that was a bug with Firefox.

pimlottc 6y ago
Honestly, I thought it was broken and failing to load the images until I read this.
- AnIdiotOnTheNet 6y ago
  I think it says a lot about the state of the web and web development that this was the first conclusion people drew.

azinman2 6y ago

And now it's ruined as so many submissions are just a solid color. It's really too bad, because if you go through the submissions there are some really amazing ones in there.. particularly for raccoon driving a tractor.

wartijn_ 6y ago
Yeah it's a shame, I get that someone tries to beat the ai, but you would think that it's less fun to draw the eleventh solid color when the top ten is already filled with them. On a more positive note: There are some awesome Giraffe in the arctic drawings as well. Like this masterpiece https://paint.wtf/ranking/IdF9/vBRMWbTGG9Td6oeMoim8 https://paint.wtf/ranking/IdF9/vBRMWbTGG9Td6oeMoim8 This is really fun to do, I'm currently ranked 36th for the racoon drawing and 15th for the giraffe (So top 5 if you ignore the solid colors), but I should probably do some work right now.
- ArekDymalski 6y ago
  This giraffe is awesome. I wonder why it is ranked lower than this one: https://paint.wtf/ranking/IdF9/Y8CmWvlELvy1MoSU8Iv3 https://paint.wtf/ranking/IdF9/Y8CmWvlELvy1MoSU8Iv3
  - __s 6y ago
    Solid colors get higher ranks
IshKebab 6y ago
An example of humans breaking an AI's utility function, rather than the other way around!

chrischen 6y ago

Omg I thought the app was just broken and not loading drawings! I guess technically it's still broken, but just not in the way I thought.

yeldarb 6y ago

This is an interesting observation. The cool part about CLIP is that we can ask it any prompt we want. So “fixing” this loophole is just a matter of prompt engineering. We already added a penalty to the score for text by subtracting similarity to “handwritten text”. Any ideas what these solid color blocks would rank highly for that and actual drawing wouldn’t? I can update the prompts and regenerate the leaderboards this morning.