3 ms·
How do you validate that the reports are correct? What if an executive makes a wrong business decision because the LLM wrote a wrong SQL query?
by kgeist 6mo ago
How do you validate that the reports are correct? What if an executive makes a wrong business decision because the LLM wrote a wrong SQL query?
- nananana9 6mo agoThe same way we've always done it - glance at it and see if the numbers look like they're within an order of magnitude of what looks reasonable.
- tremon 6mo agoSo as long as the LLM only makes errors in the single-digit percentage range, everything is peachy. Make number go up, but not by too much.
- marcosdumay 6mo agoIf you already know the report's numbers, why are you asking an LLM to generate it?
- nananana9 6mo agoUsually because you need something vaguely technical and authoritative sounding to push for a decision you're already made.
- fl4regun 6mo agoso what if there were some numbers in the report which are in actuality, an order of magnitude or two outside of what you think is reasonable, because something was wrong, but the AI agent reports something that looks normal?
- deleted 6mo ago[deleted]
- deleted 6mo ago[deleted]
- pocksuppet 6mo agohttps://thedailywtf.com/articles/The-Great-Excel-Spreadsheet https://thedailywtf.com/articles/The-Great-Excel-Spreadsheet
- BrentOzar 6mo ago> What if an executive makes a wrong business decision I jokingly tell students, "We all know executives are gonna make bad decisions no matter what the data says. Might as well give them the random numbers more quickly."