8 ms·

Quickdraw with Google AI

132 points by aloknnikhil 6y ago

deleted 6y ago
[deleted]
Google234 6y ago
Well, I learned the I’m bad at drawing :(
vekker 6y ago
Does anyone know if this is available as an API?
- narrationbox 6y ago
  You can throw this together pretty quickly using one of the AutoML APIs.
- pluc 6y ago
  you mean an API to train Google's AI? google.com
- calebegg 6y ago
  The data is available at least: https://quickdraw.withgoogle.com/data https://quickdraw.withgoogle.com/data
muglug 6y ago
Maybe needs a (2016) in the title. Past discussion: https://news.ycombinator.com/item?id=12965311 https://news.ycombinator.com/item?id=12965311
chipgap98 6y ago
I assume this is picking from a predefined set of things? As in not all nouns, but a smaller list of possibilities. Otherwise it is pretty impressive that it went 6 for 6 with my terrible drawing abilities.
- Edd314159 6y ago
  It has to be. I was prompted to draw "police car", and started about drawing a regular car with a siren on top. It guessed police car before I was even done drawing a generic car body - so I assume it wasn't trained on just a regular "car". Edit: I was half wrong. It is selecting from a limited list, but both police car _and_ a regular car are actually in that list. https://quickdraw.withgoogle.com/data https://quickdraw.withgoogle.com/data
  - ryandrake 6y ago
    I’m not sure I understand it. It prompts you to draw a certain thing, then it “guesses” what you drew, but of course it already knows because it just told you exactly what to draw. Maybe I’m missing something but the game makes no sense. If I told you what to draw then tried to tell you what you were drawing I’d get 100%. It would be better if it just said “draw something.”
    - sellyme 6y ago
      > of course it already knows because it just told you exactly what to draw It's a computer. It doesn't know that unless it's explicitly told to remember it. You can very easily test this by just drawing whatever you want as if it did say "draw something". It's very accurate at guessing any of the objects in the dataset, even if it's not the one you're meant to be drawing.
    - wendelscardua 6y ago
      By telling you what to draw, Googles gets a training set of drawings and their (sanitized) descriptions.
- magicroot75 6y ago
  It'd be cool if the learning set was built on humans coming up with challenges and then strangers drawing them, and then them being guess by a third person, and then validated by the challenger as true/false.
BugsJustFindMe 6y ago
Hmmm... https://m.imgur.com/a/y73R5Ir https://m.imgur.com/a/y73R5Ir
- smartties 6y ago
  Here is mine : https://i.imgur.com/5Ul3x0e.png https://i.imgur.com/5Ul3x0e.png
- srg0 6y ago
  https://i.imgur.com/wS4bMIi.png https://i.imgur.com/wS4bMIi.png I remember it worked better in 2016...
OnlyMortal 6y ago
I read the title as if it was some kind of classic Macintosh API to Google’s “AI”. The title needs rethinking.
tyingq 6y ago
"Draw Flip Flops in Under 20 Seconds". And, of course, I wasted half of it trying to remember what a latch circuit looked like. Before remembering they probably meant beach shoes.
_joel 6y ago
Hrm, I'm not sure maybe it was a fluke, my drawing is terrible https://imgur.com/a/R8KE87K https://imgur.com/a/R8KE87K
- dvhh 6y ago
  don't be too hard on yourself, it wasn't able to recognize my badly drawn rake
tonyteate 6y ago
As a few other other have pointed out, the data from this game is open-source and accessible in number of ways [1]. For an introductory exercise to deep learning for image classification, it's a great alternative (or follow-up) to the classic MNIST dataset [2], which serves as a common "Hello, world" for image-based ML. We trained and deployed such a model for a demo of our mobile ML tool [3][4]. Feel free to ping me if you're interested, would love to chat. [1] https://github.com/googlecreativelab/quickdraw-dataset#get-the-data https://github.com/googlecreativelab/quickdraw-dataset#get-t... [2] https://codelabs.developers.google.com/codelabs/cloud-tensorflow-mnist/#2 https://codelabs.developers.google.com/codelabs/cloud-tensor... [3] https://imgur.com/UagduZX https://imgur.com/UagduZX [4] https://palletml.com https://palletml.com
gregsadetsky 6y ago
Many people here have pointed out that the data is available -- https://github.com/googlecreativelab/quickdraw-dataset https://github.com/googlecreativelab/quickdraw-dataset I toyed with it some time ago and was impressed to see that -- in the raw data set -- each drawing is a time-series of strokes i.e. you get a person's drawing (of a penguin, the Mona Lisa, etc.) after 0.1 second of drawing, after 0.2 seconds, etc. I made and (shameless plug!) sell giant algorithmically generated posters which illustrate and play with this idea: each group of 8 rows shows doodles after a decreasing number of seconds. It's fascinating to see how someone's drawing of a "koala" is pretty much set for "success" after a few strokes, while other drawings don't ever really improve with time... or how universal and "well-defined" are drawings of matchsticks, unlike those of kangaroos. https://gumroad.com/l/quickdrawposter https://gumroad.com/l/quickdrawposter if anyone's ever so inclined! Cheers
- tonyteate 6y ago
  This is neat!
- goberoi 6y ago
  Love that! I too was inspired to use this dataset in some way, and made this toy program where you point your camera at your face, and it renders your eyes and nose as doodles (and barfs out more if you open your mouth): https://github.com/goberoi/sketch_face https://github.com/goberoi/sketch_face
  - gregsadetsky 6y ago
    That's really great, congrats! I'm sure that a web/javascript version of that would be popular. Let me know if you'd like to do a quick collaboration!
    - goberoi 6y ago
      Thanks. Alas I don’t have bandwidth to take it on, but encourage you to do so wholeheartedly. Bonne chance!
Wowfunhappy 6y ago
Is there any way to get to a “free-play” mode? I’d like to just try drawing stuff and see if the AI gets it.
poglet 6y ago
Draw: Sock "I see socks" "sorry I couldn't guess it"
dirtyid 6y ago
Recognized my poor squibbles better than my parents.
wdutch 6y ago
I love using this as an English Foreign Language teacher. I just wish I could choose a subset of the vocab because some of the words are a bit obscure like "megaphone"
domatic1 6y ago
Fun thing to do is draw a penis first and then start the real drawing
_Donny 6y ago
I drew a beautiful sea turtle; I was sure it was going to guess it! But no, it couldn't. Then I checked the training set, and it was full of tortoises... I guess they should check their training set :P
jdblair 6y ago
When I read the headline, I thought it was QuickDraw, and it was going to be some kind of classic MacOS / Google mashup.
- shellac 6y ago
  Same here. This is "Quick, Draw!". The punctuation is important. Like "Works on Contingency No Money Down".
  - soylentgraham 6y ago
    "Let's eat grandma"
numlock86 6y ago
What is amazing takes the fun away at the same time: The detection is way too fast/early. For example you are tasked to draw an octagon, the detection will already trigger once you drew three lines that are roughly aligned at 135° to each other. Draw an elephant? I can see there is something that remotely looks like a trunk and there is an attempt to draw an ear that's merely a stroke at this point. It's an elephant alright! Things like that made me play the game in a different way: Draw it so the AI won't detect it but a human would most likely instantly recognize it. Example: Microphone. Just draw a microphone hanging from a two-segment microphone arm. Start with the arm and add the microphone last and draw a circle around it or point at it. Clearly someone would recognize this as a microphone, while the AI struggles and thinks it's something completely unrelated.
- academia_hack 6y ago
  Check this repo out - didn't make it but I use it to teach my students about adversarial learning: https://github.com/jayelm/bad-flamingo https://github.com/jayelm/bad-flamingo
- errantspark 6y ago
  That's how I play this too! I've found it's very very bad at dealing with rotations. Carrot right side up? No problem, carrot at a 230° angle? It'll never figure it out.
aerodog 6y ago
Something tells me this would make for a good IQ test
holistio 6y ago
It doesn't recognise dicks, even though I'm pretty sure it's, uhm, well trained for that.
rickdeveloper 6y ago
I made a camera version of this a few years ago (https://www.youtube.com/watch?v=GEUrMbx_uac https://www.youtube.com/watch?v=GEUrMbx_uac) using QuickDraw to train the model. I generated thousands of paper-like backgrounds (grayish noise) and pasted the raw drawings on top of it to generate JPEGs.
amelius 6y ago
Warning: emits audio.
JrProgrammer 6y ago
"Draw the mona lisa in under 20 seconds" Who do you think I am?
scaraffe 6y ago
A bit off-topic, but is there a dataset like this for memes?
allwynpfr 6y ago
Link to previous discussion on HN, 4 years ago! https://news.ycombinator.com/item?id=12965311 https://news.ycombinator.com/item?id=12965311
ChrisArchitect 6y ago
(2016) https://news.ycombinator.com/item?id=12965311 https://news.ycombinator.com/item?id=12965311

132 points by aloknnikhil 6y ago

deleted 6y ago

[deleted]

Google234 6y ago

Well, I learned the I’m bad at drawing :(

vekker 6y ago

Does anyone know if this is available as an API?

narrationbox 6y ago
You can throw this together pretty quickly using one of the AutoML APIs.
pluc 6y ago
you mean an API to train Google's AI? google.com
calebegg 6y ago
The data is available at least: https://quickdraw.withgoogle.com/data https://quickdraw.withgoogle.com/data

muglug 6y ago

Maybe needs a (2016) in the title. Past discussion: https://news.ycombinator.com/item?id=12965311 https://news.ycombinator.com/item?id=12965311

chipgap98 6y ago

I assume this is picking from a predefined set of things? As in not all nouns, but a smaller list of possibilities. Otherwise it is pretty impressive that it went 6 for 6 with my terrible drawing abilities.

Edd314159 6y ago
It has to be. I was prompted to draw "police car", and started about drawing a regular car with a siren on top. It guessed police car before I was even done drawing a generic car body - so I assume it wasn't trained on just a regular "car". Edit: I was half wrong. It is selecting from a limited list, but both police car _and_ a regular car are actually in that list. https://quickdraw.withgoogle.com/data https://quickdraw.withgoogle.com/data
- ryandrake 6y ago
  I’m not sure I understand it. It prompts you to draw a certain thing, then it “guesses” what you drew, but of course it already knows because it just told you exactly what to draw. Maybe I’m missing something but the game makes no sense. If I told you what to draw then tried to tell you what you were drawing I’d get 100%. It would be better if it just said “draw something.”
  - sellyme 6y ago
    > of course it already knows because it just told you exactly what to draw It's a computer. It doesn't know that unless it's explicitly told to remember it. You can very easily test this by just drawing whatever you want as if it did say "draw something". It's very accurate at guessing any of the objects in the dataset, even if it's not the one you're meant to be drawing.
  - wendelscardua 6y ago
    By telling you what to draw, Googles gets a training set of drawings and their (sanitized) descriptions.
magicroot75 6y ago
It'd be cool if the learning set was built on humans coming up with challenges and then strangers drawing them, and then them being guess by a third person, and then validated by the challenger as true/false.

BugsJustFindMe 6y ago

Hmmm... https://m.imgur.com/a/y73R5Ir https://m.imgur.com/a/y73R5Ir

smartties 6y ago
Here is mine : https://i.imgur.com/5Ul3x0e.png https://i.imgur.com/5Ul3x0e.png
srg0 6y ago
https://i.imgur.com/wS4bMIi.png https://i.imgur.com/wS4bMIi.png I remember it worked better in 2016...

OnlyMortal 6y ago

I read the title as if it was some kind of classic Macintosh API to Google’s “AI”. The title needs rethinking.

tyingq 6y ago

"Draw Flip Flops in Under 20 Seconds". And, of course, I wasted half of it trying to remember what a latch circuit looked like. Before remembering they probably meant beach shoes.

_joel 6y ago

Hrm, I'm not sure maybe it was a fluke, my drawing is terrible https://imgur.com/a/R8KE87K https://imgur.com/a/R8KE87K

dvhh 6y ago
don't be too hard on yourself, it wasn't able to recognize my badly drawn rake

tonyteate 6y ago

As a few other other have pointed out, the data from this game is open-source and accessible in number of ways [1]. For an introductory exercise to deep learning for image classification, it's a great alternative (or follow-up) to the classic MNIST dataset [2], which serves as a common "Hello, world" for image-based ML. We trained and deployed such a model for a demo of our mobile ML tool [3][4]. Feel free to ping me if you're interested, would love to chat. [1] https://github.com/googlecreativelab/quickdraw-dataset#get-the-data https://github.com/googlecreativelab/quickdraw-dataset#get-t... [2] https://codelabs.developers.google.com/codelabs/cloud-tensorflow-mnist/#2 https://codelabs.developers.google.com/codelabs/cloud-tensor... [3] https://imgur.com/UagduZX https://imgur.com/UagduZX [4] https://palletml.com https://palletml.com

gregsadetsky 6y ago

Many people here have pointed out that the data is available -- https://github.com/googlecreativelab/quickdraw-dataset https://github.com/googlecreativelab/quickdraw-dataset I toyed with it some time ago and was impressed to see that -- in the raw data set -- each drawing is a time-series of strokes i.e. you get a person's drawing (of a penguin, the Mona Lisa, etc.) after 0.1 second of drawing, after 0.2 seconds, etc. I made and (shameless plug!) sell giant algorithmically generated posters which illustrate and play with this idea: each group of 8 rows shows doodles after a decreasing number of seconds. It's fascinating to see how someone's drawing of a "koala" is pretty much set for "success" after a few strokes, while other drawings don't ever really improve with time... or how universal and "well-defined" are drawings of matchsticks, unlike those of kangaroos. https://gumroad.com/l/quickdrawposter https://gumroad.com/l/quickdrawposter if anyone's ever so inclined! Cheers

tonyteate 6y ago
This is neat!
goberoi 6y ago
Love that! I too was inspired to use this dataset in some way, and made this toy program where you point your camera at your face, and it renders your eyes and nose as doodles (and barfs out more if you open your mouth): https://github.com/goberoi/sketch_face https://github.com/goberoi/sketch_face
- gregsadetsky 6y ago
  That's really great, congrats! I'm sure that a web/javascript version of that would be popular. Let me know if you'd like to do a quick collaboration!
  - goberoi 6y ago
    Thanks. Alas I don’t have bandwidth to take it on, but encourage you to do so wholeheartedly. Bonne chance!

Wowfunhappy 6y ago

Is there any way to get to a “free-play” mode? I’d like to just try drawing stuff and see if the AI gets it.

poglet 6y ago

Draw: Sock "I see socks" "sorry I couldn't guess it"

dirtyid 6y ago

Recognized my poor squibbles better than my parents.

wdutch 6y ago

I love using this as an English Foreign Language teacher. I just wish I could choose a subset of the vocab because some of the words are a bit obscure like "megaphone"

domatic1 6y ago

Fun thing to do is draw a penis first and then start the real drawing

_Donny 6y ago

I drew a beautiful sea turtle; I was sure it was going to guess it! But no, it couldn't. Then I checked the training set, and it was full of tortoises... I guess they should check their training set :P

jdblair 6y ago

When I read the headline, I thought it was QuickDraw, and it was going to be some kind of classic MacOS / Google mashup.

shellac 6y ago
Same here. This is "Quick, Draw!". The punctuation is important. Like "Works on Contingency No Money Down".
- soylentgraham 6y ago
  "Let's eat grandma"

numlock86 6y ago

What is amazing takes the fun away at the same time: The detection is way too fast/early. For example you are tasked to draw an octagon, the detection will already trigger once you drew three lines that are roughly aligned at 135° to each other. Draw an elephant? I can see there is something that remotely looks like a trunk and there is an attempt to draw an ear that's merely a stroke at this point. It's an elephant alright! Things like that made me play the game in a different way: Draw it so the AI won't detect it but a human would most likely instantly recognize it. Example: Microphone. Just draw a microphone hanging from a two-segment microphone arm. Start with the arm and add the microphone last and draw a circle around it or point at it. Clearly someone would recognize this as a microphone, while the AI struggles and thinks it's something completely unrelated.

academia_hack 6y ago
Check this repo out - didn't make it but I use it to teach my students about adversarial learning: https://github.com/jayelm/bad-flamingo https://github.com/jayelm/bad-flamingo
errantspark 6y ago
That's how I play this too! I've found it's very very bad at dealing with rotations. Carrot right side up? No problem, carrot at a 230° angle? It'll never figure it out.

aerodog 6y ago

Something tells me this would make for a good IQ test

holistio 6y ago

It doesn't recognise dicks, even though I'm pretty sure it's, uhm, well trained for that.

rickdeveloper 6y ago

I made a camera version of this a few years ago (https://www.youtube.com/watch?v=GEUrMbx_uac https://www.youtube.com/watch?v=GEUrMbx_uac) using QuickDraw to train the model. I generated thousands of paper-like backgrounds (grayish noise) and pasted the raw drawings on top of it to generate JPEGs.

amelius 6y ago

Warning: emits audio.

JrProgrammer 6y ago

"Draw the mona lisa in under 20 seconds" Who do you think I am?

scaraffe 6y ago

A bit off-topic, but is there a dataset like this for memes?

allwynpfr 6y ago

Link to previous discussion on HN, 4 years ago! https://news.ycombinator.com/item?id=12965311 https://news.ycombinator.com/item?id=12965311

ChrisArchitect 6y ago

(2016) https://news.ycombinator.com/item?id=12965311 https://news.ycombinator.com/item?id=12965311