4 ms·
> Presumably you already know about yourself, yet that was the example you chose to pick. It comes across as you basically leading the witness just to be able t
by stouset 2y ago
> Presumably you already know about yourself, yet that was the example you chose to pick. It comes across as you basically leading the witness just to be able to say say "gotcha! I knew you'd suck".
With all due respect, how the hell else am I supposed to evaluate its ability to answer accurately on topics without testing it first on topics I know about?
> Instead of trying to confirm your bias that LLMs are bad, try to find discomforming evidence.
I wasn't trying to confirm my bias. I literally thought that with all the information OpenAI has collected throughout the web they can probably give me a pretty good summary of the publicly available information about me. They probably even have stuff that's a bit more obscure or difficult to find. This seemed like an extremely easy way for me to be impressed.
I was trying to find disconforming evidence. Yet again I was thoroughly disappointed.
If spot-checking AI with softball questions is considered a "gotcha", that is an extremely damning comment on the current state of things.
- airstrike 2y agoBut that's not a softball question. You're asking your microwave oven to toast some bread and complaining it comes out hot but not toasted. It's not a toaster, just like an LLM is not meant to be used as a search tool although some integration exists. Ask it some programming question, to draft an email, to create a marketing campaign, to help you dig deeper into a research topic, I don't know.. things an LLM was built for.
- stouset 2y agoSummarizing the publicly-available information on a person or topic is what LLMs are supposedly built for.
- joquarky 2y agoThe summarizing feature of LLMs requires that you provide the input you want to be summarized.
- dragonwriter 2y agoNo, summarizing information directly provided to them in their prompt is what LLMs are built for. Tool-use frameworks with data retrieval tools add can be wrapped around an LLM to make the combined system try to do what you describe, but even the best of those is a lot less reliable than the underlying LLM is at its core functions like summarizing directly provided information.
- deleted 2y ago[deleted]