5 ms·

> These AI systems are not able to describe their own capabilities or strengths and are not aware of their limitations and weaknesses I've experienced this wit

> These AI systems are not able to describe their own capabilities or strengths and are not aware of their limitations and weaknesses I've experienced this with github copilot. At the beginning of a copilot chat, there's a short paragraph. It tells you to use "slash commands" for various purposes. I ask for a list of what slash commands are available. It responds by giving me a general definition of the term "slash command". No. I want to know which slash commands you support. Then it tells me it doesn't actually support slash commands. I definitely feel like I'm falling into the non-power-user category described here in most of my AI interactions. So often I just end up arguing them in circles and them constantly agreeing and correcting, but never addressing my original goal.

ddxv 2y ago
Another issue is trust. When it does tell you inrormation, how do you know you can trust that? I treat it now more like advice from a friend. Great information that isn't necessarily right and often wrong without having any idea it is wrong.
- Syonyk 2y ago
  > I treat it now more like advice from a friend. Great information that isn't necessarily right and often wrong without having any idea it is wrong. "Drunken uncle at a bar, known for spinning tales, and a master BSer who hustled his way through college in assorted pool halls" is my personal model of it. Often right, or nearly so. Frequently wrong. Sometimes has made things up on the spot. Absolutely zero ability to tell which it is, from the conversation.
- skydhash 2y ago
  You actually have a confidence measure for your friend advice. I’d trust a mechanic friend if he says I should have someone take a look at my car, or my librarian friend when he recommends a few books. Not everyone tell a lie and the truth in the same breath. And there’s the quantifier like “I think…”, “I believe…”, “Maybe…”
  - ddxv 2y ago
    True, I've started to develop my own model of that. I completely trust AI models around Javascript, generic code etc. The more mission critical something is, I'm more likely to only read what it says and avoid copy pasting. SQL I've learned I need to 100% read/comprehend the logic, too easy to be 'right' that later turns out to be wrong. Less common / newer libraries are the least trustable. I can barely get anything working with ClickHouse/Svelte 5 etc
deleted 2y ago
[deleted]
yorwba 2y ago
To find out about slash commands, you should type "/help". Of course, you'd only know about the "/help" slash command if you were already at least a bit familiar with slash commands. It is a conundrum.
- recursive 2y ago
  Or... it could say "type /help to learn more". But maybe that would make it too easy.

ddxv 2y ago

Another issue is trust. When it does tell you inrormation, how do you know you can trust that? I treat it now more like advice from a friend. Great information that isn't necessarily right and often wrong without having any idea it is wrong.

Syonyk 2y ago
> I treat it now more like advice from a friend. Great information that isn't necessarily right and often wrong without having any idea it is wrong. "Drunken uncle at a bar, known for spinning tales, and a master BSer who hustled his way through college in assorted pool halls" is my personal model of it. Often right, or nearly so. Frequently wrong. Sometimes has made things up on the spot. Absolutely zero ability to tell which it is, from the conversation.
skydhash 2y ago
You actually have a confidence measure for your friend advice. I’d trust a mechanic friend if he says I should have someone take a look at my car, or my librarian friend when he recommends a few books. Not everyone tell a lie and the truth in the same breath. And there’s the quantifier like “I think…”, “I believe…”, “Maybe…”
- ddxv 2y ago
  True, I've started to develop my own model of that. I completely trust AI models around Javascript, generic code etc. The more mission critical something is, I'm more likely to only read what it says and avoid copy pasting. SQL I've learned I need to 100% read/comprehend the logic, too easy to be 'right' that later turns out to be wrong. Less common / newer libraries are the least trustable. I can barely get anything working with ClickHouse/Svelte 5 etc

deleted 2y ago

[deleted]

yorwba 2y ago

To find out about slash commands, you should type "/help". Of course, you'd only know about the "/help" slash command if you were already at least a bit familiar with slash commands. It is a conundrum.

recursive 2y ago
Or... it could say "type /help to learn more". But maybe that would make it too easy.