4 ms·

Mostly unrelated, but that sketch recognition demo on the landing page is worse [1] than the Xerox photocopier firmware from a while back [2]. EDIT: to be fair

Mostly unrelated, but that sketch recognition demo on the landing page is worse [1] than the Xerox photocopier firmware from a while back [2]. EDIT: to be fair, it does work slightly better on mobile. [1]: https://imgur.com/a/pZMNiIU https://imgur.com/a/pZMNiIU. [2]: https://www.dkriesel.com/en/blog/2013/0802_xerox-workcentres_are_switching_written_numbers_when_scanning https://www.dkriesel.com/en/blog/2013/0802_xerox-workcentres...

abidlabs 5y ago
Asking for clarification so that we can improve it -- is it that the UI is not usable, or is that the model predicts things inaccurately? If it's the latter, it might say more about the model (a convolutional network with high accuracy on the MNIST dataset) than Gradio
- BasilPH 5y ago
  The UI is fine. The model seems to struggle with me drawing 6 on desktop. Reading "Sketch Recognition" I was expecting something akin to Google draw which recognises objects like cars and trees. The digit classifier is of course fine, but I felt a bit disappointed when I realised it "only" does numbers. I also think it's the least impressive of the demos you have.
- PeterisP 5y ago
  Probably not even the model, but the preprocessing - MNIST-trained models expect all the digits to have the same preprocessing that MNIST had (because that's all they saw), so if you apply a MNIST-optimized model directly to user-generated input without e.g. resizing and re-centering the images (or, alternatively, a "robustized" model trained with various data augmentations), then you're going to have horrible results.
- AstroDogCatcher 5y ago
  The latter - the results are astoundingly bad. You should remove that demo ASAP.
  - fennecfoxen 5y ago
    I just drew a vertical line, slightly off center to the left, almost perfectly straight, starting about x=0.1 and proceeding to x=0.95. I expected it would show as a digit 1. Page said it was a 6. Tried a 1 with a serif on top. Page said it was an 8. Added a serif on the bottom. Still an 8. Heck, if you mouse over the area without drawing, the model is torn between 1, 9 and 3.
    - fennecfoxen 5y ago
      Then I went to the next demo and uploaded a picture of a Christmas choir in a church. Model said "altar" and "vestments". Highlight that one.
BasilPH 5y ago
Came here to say the same. When I draw a 6 on desktop, it doesn't even show up in the list of candidates.

abidlabs 5y ago

Asking for clarification so that we can improve it -- is it that the UI is not usable, or is that the model predicts things inaccurately? If it's the latter, it might say more about the model (a convolutional network with high accuracy on the MNIST dataset) than Gradio

BasilPH 5y ago
The UI is fine. The model seems to struggle with me drawing 6 on desktop. Reading "Sketch Recognition" I was expecting something akin to Google draw which recognises objects like cars and trees. The digit classifier is of course fine, but I felt a bit disappointed when I realised it "only" does numbers. I also think it's the least impressive of the demos you have.
PeterisP 5y ago
Probably not even the model, but the preprocessing - MNIST-trained models expect all the digits to have the same preprocessing that MNIST had (because that's all they saw), so if you apply a MNIST-optimized model directly to user-generated input without e.g. resizing and re-centering the images (or, alternatively, a "robustized" model trained with various data augmentations), then you're going to have horrible results.
AstroDogCatcher 5y ago
The latter - the results are astoundingly bad. You should remove that demo ASAP.
- fennecfoxen 5y ago
  I just drew a vertical line, slightly off center to the left, almost perfectly straight, starting about x=0.1 and proceeding to x=0.95. I expected it would show as a digit 1. Page said it was a 6. Tried a 1 with a serif on top. Page said it was an 8. Added a serif on the bottom. Still an 8. Heck, if you mouse over the area without drawing, the model is torn between 1, 9 and 3.
  - fennecfoxen 5y ago
    Then I went to the next demo and uploaded a picture of a Christmas choir in a church. Model said "altar" and "vestments". Highlight that one.

BasilPH 5y ago

Came here to say the same. When I draw a 6 on desktop, it doesn't even show up in the list of candidates.