4 ms·

Do modern AI systems have a API call to "show your work"? e.g. What data sets and logic brought the AI to its conclusion.

jqpabc123 4y ago
What data sets and logic brought the AI to its conclusion. Even those who wrote the software don't know how to answer that qauestion. They also can't prove the conclusion is not erroneous or based on flawed or incomplete data or judgment. AI may provide an answer. But whether the answer is a real, viable solution is left undecided. For example, given free reign, AI may decide that arsenic is an effective antibiotic.
- LinuxBender 4y ago
  This could very well be true, but if so then would that not make what people are calling AI some form of a mechanical-turk, possibly an evolution of the societal control to manipulate people, businesses and governments? Meaning that it may have 99% accurate data-sets but can be tuned to achieve desired answers? I could see such a thing being very powerful when writing scientific research papers when a machine learning system can reach a desired conclusion with very realistic and believable data sources. What I mean is that the societal control that social media have over people may be reaching a plateau so perhaps this AI is the natural evolution. It is not even clear to me that AI exists. Everything described when people talk about AI or ChatGPT just sounds like a market rebranding of Big-Data and Machine Learning. If it can not Show Its Work then the hype around this may just be driving the next set of hidden algorithms to replace Twitter, Facebook, etc...
  - jqpabc123 4y ago
    Any answer obtained from AI is data driven yet still probabilistic in nature. There is always room for error... and manipulation. There are no guarantees. Asking AI to drive a car *will* produce accidents. Whether the accident rate is acceptable --- hopefully only a human will be allowed to decide.
euroderf 4y ago
No, but this should be the 5th Law of Robotics. The 4th Law is that no robot shall employ means of unlimited self-reproduction. The 5th Law is that a robot shall be able to explain on demand how it has made any particular decision.

jqpabc123 4y ago

What data sets and logic brought the AI to its conclusion. Even those who wrote the software don't know how to answer that qauestion. They also can't prove the conclusion is not erroneous or based on flawed or incomplete data or judgment. AI may provide an answer. But whether the answer is a real, viable solution is left undecided. For example, given free reign, AI may decide that arsenic is an effective antibiotic.

LinuxBender 4y ago
This could very well be true, but if so then would that not make what people are calling AI some form of a mechanical-turk, possibly an evolution of the societal control to manipulate people, businesses and governments? Meaning that it may have 99% accurate data-sets but can be tuned to achieve desired answers? I could see such a thing being very powerful when writing scientific research papers when a machine learning system can reach a desired conclusion with very realistic and believable data sources. What I mean is that the societal control that social media have over people may be reaching a plateau so perhaps this AI is the natural evolution. It is not even clear to me that AI exists. Everything described when people talk about AI or ChatGPT just sounds like a market rebranding of Big-Data and Machine Learning. If it can not Show Its Work then the hype around this may just be driving the next set of hidden algorithms to replace Twitter, Facebook, etc...
- jqpabc123 4y ago
  Any answer obtained from AI is data driven yet still probabilistic in nature. There is always room for error... and manipulation. There are no guarantees. Asking AI to drive a car *will* produce accidents. Whether the accident rate is acceptable --- hopefully only a human will be allowed to decide.

euroderf 4y ago

No, but this should be the 5th Law of Robotics. The 4th Law is that no robot shall employ means of unlimited self-reproduction. The 5th Law is that a robot shall be able to explain on demand how it has made any particular decision.