3 ms·

Show HN: UniversalDataTool – open-source collaborative data labeling

70 points by seveibar 7y ago

rg2004 7y ago
to make this more effective, add keyboard shortcuts
- seveibar 7y ago
  for sure- a couple seconds saved per sample will amount to many hours of saved time even for a small dataset. I created an issue to track interest in keyboard shortcuts, but I've heard this feedback from the friends I had beta-test so I think it's gotta be next on the agenda :) https://github.com/UniversalDataTool/universal-data-tool/issues/10 https://github.com/UniversalDataTool/universal-data-tool/iss...
a_c 7y ago
May I suggest to have some sample datasets in the demo. Am a bit confused as to what the tool can do as I don't mingle data frequently
- seveibar 7y ago
  Absolutely, will add some larger/easier to use datasets. There is a button to import cat images in "Samples -> Import -> Import Cat Images" which you may find interesting for testing Computer Vision stuff
mkl 7y ago
> Scales to tens of thousands of data points per dataset Can you clarify what this means? That sounds pretty small.
- seveibar 7y ago
  You can load tens of thousands of images into the web app at a time. Unfortunately after 100,000 I start to see performance issues- especially with collaboration. I'd like to fix this in the future- but with a web application these limits are hard to break through.
  - mkl 7y ago
    Yes, that should definitely be fixable. I have a simple Flask image labeling app (whole images, not items within them like this), and it has no upper limit. Millions is just as quick and easy as dozens. It's so primitive I don't even use a DB, just one flat file per 10,000 images, that can then easily be processed with grep etc.
djohnston 7y ago
very cool, i was wondering what open source data annotation tooling existed, and coincidentally this popped up at the same time.
kwerk 7y ago
How does this compare with Label Studio or Doccano?
erezsh 7y ago
Does it have an API for adding labels programatically? I couldn't find any documentation, or even installation instructions..

70 points by seveibar 7y ago

rg2004 7y ago

to make this more effective, add keyboard shortcuts

seveibar 7y ago
for sure- a couple seconds saved per sample will amount to many hours of saved time even for a small dataset. I created an issue to track interest in keyboard shortcuts, but I've heard this feedback from the friends I had beta-test so I think it's gotta be next on the agenda :) https://github.com/UniversalDataTool/universal-data-tool/issues/10 https://github.com/UniversalDataTool/universal-data-tool/iss...

a_c 7y ago

May I suggest to have some sample datasets in the demo. Am a bit confused as to what the tool can do as I don't mingle data frequently

seveibar 7y ago
Absolutely, will add some larger/easier to use datasets. There is a button to import cat images in "Samples -> Import -> Import Cat Images" which you may find interesting for testing Computer Vision stuff

mkl 7y ago

> Scales to tens of thousands of data points per dataset Can you clarify what this means? That sounds pretty small.

seveibar 7y ago
You can load tens of thousands of images into the web app at a time. Unfortunately after 100,000 I start to see performance issues- especially with collaboration. I'd like to fix this in the future- but with a web application these limits are hard to break through.
- mkl 7y ago
  Yes, that should definitely be fixable. I have a simple Flask image labeling app (whole images, not items within them like this), and it has no upper limit. Millions is just as quick and easy as dozens. It's so primitive I don't even use a DB, just one flat file per 10,000 images, that can then easily be processed with grep etc.

djohnston 7y ago

very cool, i was wondering what open source data annotation tooling existed, and coincidentally this popped up at the same time.

kwerk 7y ago

How does this compare with Label Studio or Doccano?

erezsh 7y ago

Does it have an API for adding labels programatically? I couldn't find any documentation, or even installation instructions..