8 ms·
I went over to Gradio. They have a demo on their front page. I choose "Q&A with Paragraph" since "understanding" the text is a pet peeve of mine. I entered a s
by hdjjhhvvhga 5y ago
I went over to Gradio. They have a demo on their front page. I choose "Q&A with Paragraph" since "understanding" the text is a pet peeve of mine.
I entered a simple text "John kissed Mary in 2010. Two years later Adam was born." and a question "When was Adam born?" The answer was. . . "Two years."
This is one of the reasons I hate the current AI hype. People would do much better being honest and realistic about our progress in the field - it's enormous, but not near what the marketing teams claim it to be.
- hdjjhhvvhga 5y agoSimple tasks like digit recognition work much better, but still...: https://i.imgur.com/q39gxip.png https://i.imgur.com/q39gxip.png
- julien_c 5y agoFWIW this is extractive question answering so the output of the model can only be a span of the input paragraph. SQuAD is the prototypical example of a dataset for this task, see https://rajpurkar.github.io/SQuAD-explorer/ https://rajpurkar.github.io/SQuAD-explorer/
- hdjjhhvvhga 5y agoThe problem is it fails even simplest tests (Q: "Adam was not born in 2012. When was Adam born?" A: "2012"; "Mary says Adam was born in 2012. John says Adam was born in 2013. And in fact the latter date is correct." A: "2012").