3 ms·

I expect it to provide information to me on topics I don’t already know. If it can’t do so accurately on topics I do know, what on earth would make me believe i

I expect it to provide information to me on topics I don’t already know. If it can’t do so accurately on topics I do know, what on earth would make me believe it’s any better on everything else? I had absolutely zero reason to believe it would mischaracterize me in advance of asking that question. In fact I presumed that would be an easy gimme: simply Googling me is enough to provide a pretty accurate assessment even before following any of the links.

airstrike 2y ago
> I expect it to provide information to me on topics I don’t already know. Presumably you already know about yourself, yet that was the example you chose to pick. It comes across as you basically leading the witness just to be able to say say "gotcha! I knew you'd suck". It's not a search engine, although you can ask some models/chatbots to search the web. Again, you're holding it wrong. Instead of trying to confirm your bias that LLMs are bad, try to find discomforming evidence. “The human understanding when it has once adopted an opinion, draws all things else to support and agree with it. And though there be a greater number and weight of instances to be found on the other side, yet these it either neglects and despises, or else by some distinction sets aside and rejects.” — Francis Bacon
- stouset 2y ago
  > Presumably you already know about yourself, yet that was the example you chose to pick. It comes across as you basically leading the witness just to be able to say say "gotcha! I knew you'd suck". With all due respect, how the hell else am I supposed to evaluate its ability to answer accurately on topics without testing it first on topics I know about? > Instead of trying to confirm your bias that LLMs are bad, try to find discomforming evidence. I wasn't trying to confirm my bias. I literally thought that with all the information OpenAI has collected throughout the web they can probably give me a pretty good summary of the publicly available information about me. They probably even have stuff that's a bit more obscure or difficult to find. This seemed like an extremely easy way for me to be impressed. I was trying to find disconforming evidence. Yet again I was thoroughly disappointed. If spot-checking AI with softball questions is considered a "gotcha", that is an extremely damning comment on the current state of things.
  - airstrike 2y ago
    But that's not a softball question. You're asking your microwave oven to toast some bread and complaining it comes out hot but not toasted. It's not a toaster, just like an LLM is not meant to be used as a search tool although some integration exists. Ask it some programming question, to draft an email, to create a marketing campaign, to help you dig deeper into a research topic, I don't know.. things an LLM was built for.
    - stouset 2y ago
      Summarizing the publicly-available information on a person or topic is what LLMs are supposedly built for.
      - joquarky 2y ago
        The summarizing feature of LLMs requires that you provide the input you want to be summarized.
      - dragonwriter 2y ago
        No, summarizing information directly provided to them in their prompt is what LLMs are built for. Tool-use frameworks with data retrieval tools add can be wrapped around an LLM to make the combined system try to do what you describe, but even the best of those is a lot less reliable than the underlying LLM is at its core functions like summarizing directly provided information.
    - deleted 2y ago
      [deleted]
- mvdtnz 2y ago
  Did you literally read the first sentence and then reply without reading the next one?
dragonwriter 2y ago
> I expect it to provide information to me Yeah, that's something language models are exceptionally bad at, and, yeah, ChatGPT is more than an LLM it is a UI around an LLM core that has some other facilities for data retrieval, but, still way out of its area of strength (unfortunately, that seems to be a lot of what people want LLM-centered products like ChatGPT to be.)

airstrike 2y ago

> I expect it to provide information to me on topics I don’t already know. Presumably you already know about yourself, yet that was the example you chose to pick. It comes across as you basically leading the witness just to be able to say say "gotcha! I knew you'd suck". It's not a search engine, although you can ask some models/chatbots to search the web. Again, you're holding it wrong. Instead of trying to confirm your bias that LLMs are bad, try to find discomforming evidence. “The human understanding when it has once adopted an opinion, draws all things else to support and agree with it. And though there be a greater number and weight of instances to be found on the other side, yet these it either neglects and despises, or else by some distinction sets aside and rejects.” — Francis Bacon

stouset 2y ago
> Presumably you already know about yourself, yet that was the example you chose to pick. It comes across as you basically leading the witness just to be able to say say "gotcha! I knew you'd suck". With all due respect, how the hell else am I supposed to evaluate its ability to answer accurately on topics without testing it first on topics I know about? > Instead of trying to confirm your bias that LLMs are bad, try to find discomforming evidence. I wasn't trying to confirm my bias. I literally thought that with all the information OpenAI has collected throughout the web they can probably give me a pretty good summary of the publicly available information about me. They probably even have stuff that's a bit more obscure or difficult to find. This seemed like an extremely easy way for me to be impressed. I was trying to find disconforming evidence. Yet again I was thoroughly disappointed. If spot-checking AI with softball questions is considered a "gotcha", that is an extremely damning comment on the current state of things.
- airstrike 2y ago
  But that's not a softball question. You're asking your microwave oven to toast some bread and complaining it comes out hot but not toasted. It's not a toaster, just like an LLM is not meant to be used as a search tool although some integration exists. Ask it some programming question, to draft an email, to create a marketing campaign, to help you dig deeper into a research topic, I don't know.. things an LLM was built for.
  - stouset 2y ago
    Summarizing the publicly-available information on a person or topic is what LLMs are supposedly built for.
    - joquarky 2y ago
      The summarizing feature of LLMs requires that you provide the input you want to be summarized.
    - dragonwriter 2y ago
      No, summarizing information directly provided to them in their prompt is what LLMs are built for. Tool-use frameworks with data retrieval tools add can be wrapped around an LLM to make the combined system try to do what you describe, but even the best of those is a lot less reliable than the underlying LLM is at its core functions like summarizing directly provided information.
  - deleted 2y ago
    [deleted]
mvdtnz 2y ago
Did you literally read the first sentence and then reply without reading the next one?

dragonwriter 2y ago

> I expect it to provide information to me Yeah, that's something language models are exceptionally bad at, and, yeah, ChatGPT is more than an LLM it is a UI around an LLM core that has some other facilities for data retrieval, but, still way out of its area of strength (unfortunately, that seems to be a lot of what people want LLM-centered products like ChatGPT to be.)