I think you are exaggerating the problem. I am doing LLM "AI assistant" and even if I trusted the output, there are still cases of just errors and misunderstan

I think you are exaggerating the problem. I am doing LLM "AI assistant" and even if I trusted the output, there are still cases of just errors and misunderstandings. What I am doing is after getting the LLM "decision" what to do, ask user for confirmation (show simple GUI dialog - do you want to delete X). And after that still make the standard permission check if that user is allowed to do that. I don't think is that any company with proper engineering is doing something like "let LLM write me a SQL query based on user input and execute it raw on the db".