4 ms·
Any way to tell if the convincing final numbers it told you are real or halucinated ?
by m4rtink 1y ago
Any way to tell if the convincing final numbers it told you are real or halucinated ?
- jaggederest 1y agoI checked them carefully myself with various other tools. It was using python to do the math so I trust it to a single standard deviation at least.
- mb7733 1y agoStandard deviation of what
- caminante 1y agoI'm lost too. Financials are technology agnostic. They probably meant that they could read (and trace) the logic in Python for correctness.
- deleted 1y ago[deleted]
- jaggederest 1y agoI wouldn't publish it as statistically significant but it's within the error bounds for a real human accomplishing the same task, to reword.
- caminante 1y agoI see your edit. I would recommend spending that "couple thousand" for quote(s). It's a second opinion from someone who hopefully has high volume in your local market. And your downside could be the entire system plus remediation, fines, etc. To be clear, I'm not opposed to experimenting, but I wouldn't rely on this. Appreciate your comment for the discussion.
- jaggederest 1y agoNo I'm not relying on it in the sense of going out and running the entire project through it, but as an accurate screener for whether it's worth doing, there's nothing comparable available.
- visarga 1y agoSolve the same task with ChatGPT, Gemini and Claude. If they agree, you can be reasonably sure.
- caminante 1y agoI'm not opposed to experimenting, but that's a a recipe for false confidence in a final decision.
- visarga 1y agoWhere they agree it shows the data supports that answer - not necessarily that it is true, where they disagree it shows you need to hedge. That's useful.
- caminante 1y agoThis is so wrong! e.g., if you had a heart condition, you can't just poll three LLMs and be "reasonably sure" you've properly diagnosed the ailment.