4 ms·

I don't like how Bing takes information from the Internet, summaries it, and then provide it to me, with little footnote, in its own voice. I just don't fully t

I don't like how Bing takes information from the Internet, summaries it, and then provide it to me, with little footnote, in its own voice. I just don't fully trust information on the internet. I would love that Bing provide context on where it found the information and provide an assessment on how reliable it is, but I am sure it'll be gamed by SEO very quickly. Plus a demo of this, even through it's useful, wouldn't look impressive as it lacks confidence.

deleted 4y ago
[deleted]
deleted 4y ago
[deleted]
rtkwe 4y ago
I think that would require a huge leap in the abilities of these models. Right now they can't know because afaik they're not working on a corpus of facts they're just coming up with what the response should look like regardless of the actual facts. Maybe you could make a companion module that pre or post processes the GPT-* outputs to slot in facts using a less AI-y but more accurate knowledge graph system? There are things at google or something like Wolfram Alpha that could provide those inserts perhaps. That's definitely been my big hang up about the usefulness of Bing Chat or ChatGPT for answering questions. If you actually care about the truth of what you're asking you have to go do a lot of the same searching you would have to do to look up the answer in the first place. At best it could provide an idea of what to search when you don't know the language to use to find something, which is often a roadblock for when I'm learning a new system or service.
runlevel1 4y ago
You can ask it a follow-up question for sources. However, it's hit-and-miss. In a few cases, I've seen it give citations to things that clearly never existed. For example, I asked it for US auto-pedestrian death statistics. It printed out a nicely formatted table. Then, I asked it for a source. It pointed me to a specific table on a dot.gov page. The table didn't exist and, according to the Wayback Machine, it never did. I ended up finding the information the old-fashioned way, and numbers that it gave were way off. I suspect the majority of folks won't be bother to fact check the data it returns. It's going to be a problem.
frognumber 4y ago
I asked ChatGPT to give me a biography of myself. I'm slightly famous. It got the general field-of-work correct (which is niche). Yay! Everything else, it hallucinated -- my school, my work history, etc.
- hombre_fatal 4y ago
  It knew about a forum that I made long ago, and it knew that it's still running and that I've essentially abandoned it and that my users feel bad. It wrote a better summary about my website and its creator (me) than I could ever have. Truly amazed me that such a tiny part of the internet landed in its model.

deleted 4y ago

[deleted]

deleted 4y ago

[deleted]

rtkwe 4y ago

I think that would require a huge leap in the abilities of these models. Right now they can't know because afaik they're not working on a corpus of facts they're just coming up with what the response should look like regardless of the actual facts. Maybe you could make a companion module that pre or post processes the GPT-* outputs to slot in facts using a less AI-y but more accurate knowledge graph system? There are things at google or something like Wolfram Alpha that could provide those inserts perhaps. That's definitely been my big hang up about the usefulness of Bing Chat or ChatGPT for answering questions. If you actually care about the truth of what you're asking you have to go do a lot of the same searching you would have to do to look up the answer in the first place. At best it could provide an idea of what to search when you don't know the language to use to find something, which is often a roadblock for when I'm learning a new system or service.

runlevel1 4y ago

You can ask it a follow-up question for sources. However, it's hit-and-miss. In a few cases, I've seen it give citations to things that clearly never existed. For example, I asked it for US auto-pedestrian death statistics. It printed out a nicely formatted table. Then, I asked it for a source. It pointed me to a specific table on a dot.gov page. The table didn't exist and, according to the Wayback Machine, it never did. I ended up finding the information the old-fashioned way, and numbers that it gave were way off. I suspect the majority of folks won't be bother to fact check the data it returns. It's going to be a problem.

frognumber 4y ago

I asked ChatGPT to give me a biography of myself. I'm slightly famous. It got the general field-of-work correct (which is niche). Yay! Everything else, it hallucinated -- my school, my work history, etc.

hombre_fatal 4y ago
It knew about a forum that I made long ago, and it knew that it's still running and that I've essentially abandoned it and that my users feel bad. It wrote a better summary about my website and its creator (me) than I could ever have. Truly amazed me that such a tiny part of the internet landed in its model.