3 ms·
Thanks very much for trying it out and for giving us feedback. We can't see what people search, so it's really helpful to see reports when things go wrong. For
by jedwhite 5y ago
Thanks very much for trying it out and for giving us feedback. We can't see what people search, so it's really helpful to see reports when things go wrong.
For "who is the current president" I get "The current president of the United States is Joe Biden since January 20, 2021". Did you see any results at all? I'm guessing something glitched there. The previous president I just got the same as you, so that's one re-training!
It's early days, but it tends to do best with factual extraction with concrete and specific terms included. Linguistic references (anaphors, previous, next) are still works in progress. But it's heading in the right direction. So you can join concrete questions with more complex phrases and it has enough to work with.
So if you ask:
"who is the 45th president of the the USA and where was he born?"
you get:
"Donald Trump is the 45th president of the United States and he was born in Queens, New York City."
The leap year one was way off! The intent detection was way off the mark there!
Thank you again for giving is feedback. It really does help having examples because we can't see what folks search. The encouraging thing there is that it is almost always misunderstanding the question when things go wrong, rather than identifying inaccurate facts (so answering the wrong question correctly). You can see that with these examples.
Our Discord community likes to have challenges to break Andi's answers, and it really helps us see where it is strong and where it needs the most work. There's a whole school of thought around "tricking AI" and we know how to trick Andi pretty well. But one of the advantages of the search approach is that the underlying results are always displayed alongside the answer. As with many early products, having people use it and give us feedback on what goes right and wrong is incredibly valuable for us, as we can keep iterating and improving the things that go wrong.
So we're grateful for every example of where it is off the mark as well as does well.