4 ms·

CaptionBot team here. Thanks for the images and captions! Please keep sharing them and give us feedback.

phodo 10y ago
First of all congratulations on a) the science (built on the shoulder of giants...) b) the accessibility / interface and service Wondering if you plan to open up a caption API of any sort? Can definitely use something like this. If you desire the training feedback, then that could be added as well as part of the API. I'd be willing to do that for some images. So if you do add a training feedback API, please make it optional.
- gilnahmias 10y ago
  Thanks! We published all the APIs for free. Check them out @ https://www.captionbot.ai/Home/Magic https://www.captionbot.ai/Home/Magic
  - phodo 10y ago
    Thank you! Don't know how I missed that Cognitive Services link...
jedberg 10y ago
It would be great if you added a text box under the stars so I can (optionally) tell you why I didn't give you five stars. For example, I uploaded a picture of my daughter as an infant, and it said, "This is a baby on a bed and he's :D" which I gave four stars to because it said he instead of she. But honestly you really have no way of knowing that. :)
- gilnahmias 10y ago
  Thank you jedberg! That's a great idea. We love it and will look into adding it soon.
raus22 10y ago
Do you know why it puts a lot of things on surfboards? It seems from the comments that that is one of the most represented misclassifications.
YeGoblynQueenne 10y ago
Thank you very much for putting your work out there for people to have fun with (and criticise!). CaptionBot seems to have a bit of trouble with simple two-colour outline drawings. In one case I saw it even get the colour wrong ("red and white" for a black and red image). Is that something you would have expected? Also- I notice it doesn't do very well with character recognition either. Is that surprising?
6stringmerc 10y ago
Have you considered an 'abstract' type of version? As in, rather than simply describing the image as the caption, take the information that would be used, fill it in a MAD-LIBS[1] style setup, and see how that turns out? Maybe it's just me but a surrealist CaptionBot could be pretty fun. [1] https://en.wikipedia.org/wiki/Mad_Libs https://en.wikipedia.org/wiki/Mad_Libs

phodo 10y ago

First of all congratulations on a) the science (built on the shoulder of giants...) b) the accessibility / interface and service Wondering if you plan to open up a caption API of any sort? Can definitely use something like this. If you desire the training feedback, then that could be added as well as part of the API. I'd be willing to do that for some images. So if you do add a training feedback API, please make it optional.

gilnahmias 10y ago
Thanks! We published all the APIs for free. Check them out @ https://www.captionbot.ai/Home/Magic https://www.captionbot.ai/Home/Magic
- phodo 10y ago
  Thank you! Don't know how I missed that Cognitive Services link...

jedberg 10y ago

It would be great if you added a text box under the stars so I can (optionally) tell you why I didn't give you five stars. For example, I uploaded a picture of my daughter as an infant, and it said, "This is a baby on a bed and he's :D" which I gave four stars to because it said he instead of she. But honestly you really have no way of knowing that. :)

gilnahmias 10y ago
Thank you jedberg! That's a great idea. We love it and will look into adding it soon.

raus22 10y ago

Do you know why it puts a lot of things on surfboards? It seems from the comments that that is one of the most represented misclassifications.

YeGoblynQueenne 10y ago

Thank you very much for putting your work out there for people to have fun with (and criticise!). CaptionBot seems to have a bit of trouble with simple two-colour outline drawings. In one case I saw it even get the colour wrong ("red and white" for a black and red image). Is that something you would have expected? Also- I notice it doesn't do very well with character recognition either. Is that surprising?

6stringmerc 10y ago

Have you considered an 'abstract' type of version? As in, rather than simply describing the image as the caption, take the information that would be used, fill it in a MAD-LIBS[1] style setup, and see how that turns out? Maybe it's just me but a surrealist CaptionBot could be pretty fun. [1] https://en.wikipedia.org/wiki/Mad_Libs https://en.wikipedia.org/wiki/Mad_Libs