3 ms·
Pretty high chance isn’t what the intent or impression the end user often has.
by j45 5mo ago
Pretty high chance isn’t what the intent or impression the end user often has.
- kergonath 5mo agoIndeed, and it is a complicated problem to solve. A GUI or CLI can hide footguns or make them less likely to be misused. But an AI agent is perfectly happy to use a wrecking ball to put a nail without any second thought or confirmation.
- j45 5mo agoIt’s a human articulation problem. When it receives a generic vague input it is free to interpret according to how its corpus fires like any human interaction. How to articulate better is like writing a sentence that will stand the test of model updates.
- kergonath 5mo agoEven then. I don’t have an example off the top of my head but even perfectly clear sentences can lead the agent to strange places. Even between humans, miscommunication is easy, but then anyone sensible would ask for confirmation if their interpretation is weird. But the LLM very rarely questions the user. I don’t think it’s fair to blame the user here. The tool must be operated by normal users.
- j45 5mo agoI'm trying to think of other types of tooling that normal users can all use equally well, or in the best ways possible.