3 ms·
Well, that didn't take long – our API endpoint keeled over. Luckily, you can fetch all the data directly from firebase: # fetch raw tag data $ curl -fsSL h
by sillysaurusx 6y ago
Well, that didn't take long – our API endpoint keeled over. Luckily, you can fetch all the data directly from firebase:
# fetch raw tag data
$ curl -fsSL https://experiments-573d7.firebaseio.com/results/.json > tags.json
$ du -hs tags.json
14M tags.json
# fetch tag metadata (colors, remapping label names, possibly other stuff in the future)
$ curl -fsSL https://experiments-573d7.firebaseio.com/user_meta/.json > tags_meta.json
$ du -hs tags_meta.json
376K tags_meta.json
$ jq tags_meta.json
Note that's the raw unprocessed data (no yolo). To get info about all experiments, you can use this:
curl -fsSL https://experiments-573d7.firebaseio.com/meta/.json | jq
I'm a bit worried about the bill. It's up to $50 and rising: https://imgur.com/ZgmXsWU https://imgur.com/ZgmXsWU almost entirely egress bandwidth. Be gentle with those `curl` statements. :)
(I think that's due to a poor architectural decision on my part, which is solvable, and not due to egress bandwidth via the API endpoint. But it's always fun to see a J curve in your bill... It's about $1 a day right now. https://imgur.com/4gUTLO7 https://imgur.com/4gUTLO7)
- foota 6y agoCan you set it up so that it's only available via cloud? I'm sure that would bother people, but is a better alternative to losing access or you going broke :)
- sillysaurusx 6y agoWe're motivated to keep this as open as possible. I really like the idea of an open dataset that continues to grow with time. If it keeps growing, then within a couple years it should have a vast quantity of tags on a variety of diverse datasets, which we hope might prove helpful. If anyone wants to contribute, I started a patreon a few minutes ago: https://www.patreon.com/shawwn https://www.patreon.com/shawwn
- zb1plus 6y agoPerhaps you can mirror it to an s3 bucket or GH repo for people to CURL more easily?
- sillysaurusx 6y agoHeh, $1 per day? Try $1k per day. https://imgur.com/duugqHK https://imgur.com/duugqHK
- sillysaurusx 6y agoWe've confirmed that this was someone running `while true; curl ...`, resulting in a $3,700 bill. https://twitter.com/theshawwn/status/1271365062913961984 https://twitter.com/theshawwn/status/1271365062913961984 I guess "be gentle" means "please troll us."