3 ms·
When things go wrong with AI people seem to often make it prostrate itself, explain why it went wrong and promise to never do it again - which it does, but ther
by joegibbs 1y ago
When things go wrong with AI people seem to often make it prostrate itself, explain why it went wrong and promise to never do it again - which it does, but there’s no point, it’s not going to remember because it doesn’t have memory, and the reasoning as to why it went wrong is usually more hallucinated than regular conversation - like saying that it panicked (which it doesn’t do) or that it ran tests locally, which it can’t.
Perhaps getting something wrong puts in a state that makes it more likely to give wrong answers. It seems like GPT is the most likely to do this.
Also I don’t think you should be letting an LLM just make up commands and run them, that seems like a recipe for disaster, you should at the very least have to see what it’s going to do yourself.