4 ms·
I find it interesting how hard it is to think of a question that truly cannot be answered by just reading lots of text. Stuff like "how can you carry water with
by nothis 6y ago
I find it interesting how hard it is to think of a question that truly cannot be answered by just reading lots of text. Stuff like "how can you carry water without a vessel?" (you freeze it!), which might stump a lot of AI models. But then you think... there should be texts that explain that ice is water and that ice can be carried. Similarly, the problem with numbers (lenghth, height, etc) isn't a lack of data, it's messy notation which is still easily parsed by human readers and probably could be solved.
If anything, I've become more convinced that text alone has enough information to solve some eerily specific problems. It's quite a powerful tool.
- selestify 6y ago> Stuff like "how can you carry water without a vessel?" (you freeze it!), which might stump a lot of AI models. What? Even I couldn't answer that. I thought it was a brainteaser. "Water" in common parlance refers to its liquid form, as opposed to ice or steam.
- rangibaby 6y agoIt is a brain teaser and you explained why
- k_sze 6y agoIn an alternate universe, a really “smart” AI would be able to answer the “how do you carry water without a vessel” question, still not in the normal human way (you freeze it), but in the same vein as what you would find in Randall Munroe’s “How To” book.
- unityByFreedom 6y agoThat question is hard for current language models. Theoretically you could get there but you'd need to connect a lot of dots in your algorithm. Throwing more text at existing algorithms won't reliably answer this kind of question.
- mannykannot 6y agoOne answer can be found in the issue being addressed here, which is that the models were not, just from reading lots of text, performing well on questions involving scale.