3 ms·

> If you happened to get information from it that turned out to be ok, you were lucky. This is just saying that sometimes ChatGPT is right and sometimes it's w

> If you happened to get information from it that turned out to be ok, you were lucky. This is just saying that sometimes ChatGPT is right and sometimes it's wrong, with an implicit stance on the relative frequencies. In my own experience it would be more accurate to say you're unlucky if it gets it wrong—but then much of this hinges on having a good sense of what it's going to be good at / useful for. (The other thing I see people miss all the time when assessing its correctness: it is somewhat "on demand"—it may include bits that are vague and only correct-ish, but if you point out an error or request refinement you can generally get it to clear/tighten things up. It's a bit like using a Google Maps-like zooming UI, but in addition to being variably abstract it's always approximating: the potential for error is ever present.)

pdonis 4y ago
> This is just saying that sometimes ChatGPT is right and sometimes it's wrong No, it's saying that ChatGPT is not reliable. It's not reliable because getting things right or wrong is not part of its design at all. All it does is generate text that matches a pattern. There is nothing anywhere in it that filters or evaluates text based on any semantic connection with anything else.
- westoncb 4y ago
  > No, it's saying that ChatGPT is not reliable That's another way of saying sometimes it is right and sometimes it is wrong... > All it does is generate text that matches a pattern This is about as meaningful as saying, "all things are is collections of atoms". We are barely beginning to explore the implications of these pattern-extending structures: their most interesting features emerge from their structure, cannot be simply derived from the fact that they do pattern continuation in the same way you're not gonna derive the concept of friendship from analyzing chemical bond structure.

pdonis 4y ago

> This is just saying that sometimes ChatGPT is right and sometimes it's wrong No, it's saying that ChatGPT is not reliable. It's not reliable because getting things right or wrong is not part of its design at all. All it does is generate text that matches a pattern. There is nothing anywhere in it that filters or evaluates text based on any semantic connection with anything else.

westoncb 4y ago
> No, it's saying that ChatGPT is not reliable That's another way of saying sometimes it is right and sometimes it is wrong... > All it does is generate text that matches a pattern This is about as meaningful as saying, "all things are is collections of atoms". We are barely beginning to explore the implications of these pattern-extending structures: their most interesting features emerge from their structure, cannot be simply derived from the fact that they do pattern continuation in the same way you're not gonna derive the concept of friendship from analyzing chemical bond structure.