4 ms·

> God help us if people start trying to use an overconfident chatbot to replace documentation :(. A chat bot looks like a great help to parse through huge volu

> God help us if people start trying to use an overconfident chatbot to replace documentation :(. A chat bot looks like a great help to parse through huge volumes of documentation. If the chatbot built around the docs outputs garbage, that is a telltale sign that the documentation was garbage to start with. Just because people started developing clever chatbots that misfire, let's not fool ourselves into believing documentation was a solved problem and all docs were squeaky clean.

ziml77 4y ago
Poor output from a chat bot indicating poor documentation would make sense if the chat bot could limit itself to authoritative information from the documentation, but that's not how these models operate. I'm not even sure how you could make them work that way because if you trained them solely on the documentation, they wouldn't be able to operate in a conversational manner.
- imtringued 4y ago
  You can tune ChatGPT with custom data.
  - saurik 4y ago
    This is, AFAIK, not a task for fine tuning--which is more like trying to get a certain kind of style-but maybe a task for "semantic search". I watched this video a few days ago, and at least vaguely recommend it: https://youtu.be/9qq6HTr7Ocw https://youtu.be/9qq6HTr7Ocw
imtringued 4y ago
Here is the documentation that you consider unclear >If the container is not empty, the function never throws exceptions (no-throw guarantee). Otherwise, it causes undefined behavior. ChatGPT failed at basic regurgitation.
- tialaramex 4y ago
  This is, at best, clumsily worded, because it requires that the reader hold two negatives simultaneously. "If the container is not empty, the function never throws" How about this: If the container is empty the function causes undefined behaviour. Otherwise it never throws exceptions (no-throw guarantee). We avoided having to hold two negatives, and we also put the thing you need to care about up front where it's more likely to be noticed.
  - chipsa 4y ago
    The function never throws, whether empty or not. So, skip the "otherwise".
    - tialaramex 4y ago
      It's not called "Undefined except we promise it can't possibly throw" behaviour.
geraneum 4y ago
> If the chatbot built around the docs outputs garbage, that is a telltale sign that the documentation was garbage to start with. That’s not how the chat bot works. This particular chat bot can be trained on a bunch of documents and still tell you something that contradicts the facts that are clear to a human in one of the said documents. It’s a known phenomenon called “hallucination” and this actually gives the chat bot, to some extent, it’s ability to imitate creativity (to put it simply). edit: typo

ziml77 4y ago

Poor output from a chat bot indicating poor documentation would make sense if the chat bot could limit itself to authoritative information from the documentation, but that's not how these models operate. I'm not even sure how you could make them work that way because if you trained them solely on the documentation, they wouldn't be able to operate in a conversational manner.

imtringued 4y ago
You can tune ChatGPT with custom data.
- saurik 4y ago
  This is, AFAIK, not a task for fine tuning--which is more like trying to get a certain kind of style-but maybe a task for "semantic search". I watched this video a few days ago, and at least vaguely recommend it: https://youtu.be/9qq6HTr7Ocw https://youtu.be/9qq6HTr7Ocw

imtringued 4y ago

Here is the documentation that you consider unclear >If the container is not empty, the function never throws exceptions (no-throw guarantee). Otherwise, it causes undefined behavior. ChatGPT failed at basic regurgitation.

tialaramex 4y ago
This is, at best, clumsily worded, because it requires that the reader hold two negatives simultaneously. "If the container is not empty, the function never throws" How about this: If the container is empty the function causes undefined behaviour. Otherwise it never throws exceptions (no-throw guarantee). We avoided having to hold two negatives, and we also put the thing you need to care about up front where it's more likely to be noticed.
- chipsa 4y ago
  The function never throws, whether empty or not. So, skip the "otherwise".
  - tialaramex 4y ago
    It's not called "Undefined except we promise it can't possibly throw" behaviour.

geraneum 4y ago

> If the chatbot built around the docs outputs garbage, that is a telltale sign that the documentation was garbage to start with. That’s not how the chat bot works. This particular chat bot can be trained on a bunch of documents and still tell you something that contradicts the facts that are clear to a human in one of the said documents. It’s a known phenomenon called “hallucination” and this actually gives the chat bot, to some extent, it’s ability to imitate creativity (to put it simply). edit: typo