3 ms·
We made a site that lets you collaboratively tag a bunch of images, called tagpls.com. For example, users decided to re-tag imagenet for fun: https://twitter.co
by sillysaurusx 6y ago
We made a site that lets you collaboratively tag a bunch of images, called tagpls.com. For example, users decided to re-tag imagenet for fun: https://twitter.com/theshawwn/status/1262535747975868418 https://twitter.com/theshawwn/status/1262535747975868418
And the tags ended up being hilarious: https://pbs.twimg.com/media/EYXRzDAUwAMjXIG?format=jpg&name=large https://pbs.twimg.com/media/EYXRzDAUwAMjXIG?format=jpg&name=...
(I'm particularly fond of https://i.imgur.com/ZMz2yUc.png https://i.imgur.com/ZMz2yUc.png)
The data is freely available via API: https://www.tagpls.com/tags/imagenet2012validation.json https://www.tagpls.com/tags/imagenet2012validation.json
It exports the data in yolo format (e.g. it has coordinates in yolo's [0..1] range), so it's straightforward to spit it out to disk and start a yolo training run on it.
Gwern recently used tagpls to train an anime hand detector model: https://www.reddit.com/r/AnimeResearch/comments/gmcdkw/help_build_an_anime_hand_detector_by_tagging/ https://www.reddit.com/r/AnimeResearch/comments/gmcdkw/help_...
People seem willing to tag things for free, mostly for the novelty of it.
The NSFW tags ended up being shockingly high quality, especially in certain niches: https://twitter.com/theshawwn/status/1270624312769130498 https://twitter.com/theshawwn/status/1270624312769130498
I don't think we could've paid human labelers to create tags that thorough or accurate.
All the tags for all experiments can be grabbed via https://www.tagpls.com/tags.json https://www.tagpls.com/tags.json, so over time we hope the site will become more and more valuable to the ML community.
tagpls went from 50 users to 2,096 in the past three weeks. The database size also went from 200KB a few weeks ago to 1MB a week ago and 2MB today. I don't know why it's becoming popular, but it seems to be.
- rocauc 6y agoI remember following this as it came out (and learning windshield wipers should be called "swipey bois") Surprised and happy to hear you're seeing high labeling quality. We'll re-host with credit on https://public.roboflow.ai https://public.roboflow.ai What license is this?
- sillysaurusx 6y agoThanks! We've decided to license the data as CC-0. We'll add that to the footer. We don't host any images directly – we merely serve a list of URLs (e.g. https://battle.shawwn.com/tfdne.txt https://battle.shawwn.com/tfdne.txt). But any data served via the API endpoints is CC-0.
- sillysaurusx 6y agoWell, that didn't take long – our API endpoint keeled over. Luckily, you can fetch all the data directly from firebase: # fetch raw tag data $ curl -fsSL https://experiments-573d7.firebaseio.com/results/.json > tags.json $ du -hs tags.json 14M tags.json # fetch tag metadata (colors, remapping label names, possibly other stuff in the future) $ curl -fsSL https://experiments-573d7.firebaseio.com/user_meta/.json > tags_meta.json $ du -hs tags_meta.json 376K tags_meta.json $ jq tags_meta.json Note that's the raw unprocessed data (no yolo). To get info about all experiments, you can use this: curl -fsSL https://experiments-573d7.firebaseio.com/meta/.json | jq I'm a bit worried about the bill. It's up to $50 and rising: https://imgur.com/ZgmXsWU https://imgur.com/ZgmXsWU almost entirely egress bandwidth. Be gentle with those `curl` statements. :) (I think that's due to a poor architectural decision on my part, which is solvable, and not due to egress bandwidth via the API endpoint. But it's always fun to see a J curve in your bill... It's about $1 a day right now. https://imgur.com/4gUTLO7 https://imgur.com/4gUTLO7)
- foota 6y agoCan you set it up so that it's only available via cloud? I'm sure that would bother people, but is a better alternative to losing access or you going broke :)
- sillysaurusx 6y agoWe're motivated to keep this as open as possible. I really like the idea of an open dataset that continues to grow with time. If it keeps growing, then within a couple years it should have a vast quantity of tags on a variety of diverse datasets, which we hope might prove helpful. If anyone wants to contribute, I started a patreon a few minutes ago: https://www.patreon.com/shawwn https://www.patreon.com/shawwn
- zb1plus 6y agoPerhaps you can mirror it to an s3 bucket or GH repo for people to CURL more easily?
- sillysaurusx 6y ago
- knicholes 6y agoI need a dataset and tags for hair, face, neck, arms, left breast, right breast, nipple, torso. Any tips? I'm training a GAN, but I need to specifically segment the parts, as I don't want nipples in the middle of a face. I don't want to have to manually annotate 1,000 images
- sillysaurusx 6y agoAt the moment, the only experiments with enough data to be useful are e621-portraits (5,407 tags https://www.tagpls.com/exp?n=e621-portraits https://www.tagpls.com/exp?n=e621-portraits) and danbooru-e (344 tags https://www.tagpls.com/exp?n=danbooru2019-e https://www.tagpls.com/exp?n=danbooru2019-e) both of which are NSFW. Those are also drawings/anime, not photos. We have an /r/pics experiment (SFW, 99 tags https://www.tagpls.com/exp?n=r-pics https://www.tagpls.com/exp?n=r-pics) and /r/gonewild (NSFW, 57 tags https://www.tagpls.com/exp?n=r-gonewild https://www.tagpls.com/exp?n=r-gonewild) but currently I haven't gathered enough urls to be very useful -- it only scrapes about 100 or so images every half hour. So there is a lack of tags right now on human photos. We also have a pps experiment (NSFW, exactly what you think it is, 306 tags https://www.tagpls.com/exp?n=pps https://www.tagpls.com/exp?n=pps) but I assume that's not quite what you were looking for. If you have an idea for a dataset, you can create a list of image URLs like https://battle.shawwn.com/r/pics.txt https://battle.shawwn.com/r/pics.txt and we can add them to the site. You can request an addition by joining our ML discord (https://discordapp.com/invite/x52Xz3y https://discordapp.com/invite/x52Xz3y) and posting in the #tagging channel. Also, if anyone's curious, here's how I'm measuring the tag count: $ curl -fsSL https://experiments-573d7.firebaseio.com/results/danbooru2019-e/.json | jq '.' | grep points | wc -l 344 $ curl -fsSL https://experiments-573d7.firebaseio.com/results/e621-portraits/.json | jq '.' | grep points | wc -l 5407 $ curl -fsSL https://experiments-573d7.firebaseio.com/results/r-gonewild/.json | jq '.' | grep points | wc -l 57 $ curl -fsSL https://experiments-573d7.firebaseio.com/results/r-pics/.json | jq '.' | grep points | wc -l 99 $ curl -fsSL https://experiments-573d7.firebaseio.com/results/pps/.json | jq '.' | grep points | wc -l 306
- knicholes 6y agoYeah, I mean, the tagging is awesome, but I'm thinking I'll need more image segmentation than object recognition. With a segmentation map, I can make a great image->image translator.
- dang 6y agoYou should post this as a Show HN!
- sillysaurusx 6y agoOkay! Thank you. We appreciate the encouragement. It looks like an HN user on an EC2 server decided to fetch data from our firebase as quickly as possible, running up a $3,700 bill. Once (or if) that's sorted out, and once we verify tagpls can handle HN's load without charging thousands of dollars, we'll add an "about" page to tagpls and submit it.
- nerderloo 6y agoHow does this have anything to do with the linked article?
- sillysaurusx 6y agoThe idea with the site is that you can tag your own datasets, and then get the data suitable for yolo training. We've done that ourselves to train an anime hand detector, and other users have reported similar successes. I could've been a bit clearer about that.