5 ms·
> The laws we have already cover malevolent and abusive uses of software applications. They don't. Or not nearly enough. Otherwise you wouldn't have automated
by troupo 3y ago
> The laws we have already cover malevolent and abusive uses of software applications.
They don't. Or not nearly enough. Otherwise you wouldn't have automated racial profiling, en masse face recognition, credit and social scoring etc.
And it's going to get worse. Because AI is infallible, right? Right?!
That's why, among other thing, EU AI regulation has the following:
- Foundation models have to be thoroughly documented, and developers of these modes have to disclose what data they were trained on
- AI cannot be used in high-risk applications (e.g. social scoring etc.)
- When AI is used, its decisions must be explicable in human terms. No "AI said so, so it's true". Also, if you interact with an AI system it must be clearly labeled as such
- tluyben2 3y agoThis type of regulatory would be better than 'stop' or making all kinds of expensive rules that only big corps can follow.
- troupo 3y agoThere are still quite a few rules, but they seem common sense: https://softwarecrisis.dev/letters/the-truth-about-the-eu-act/ https://softwarecrisis.dev/letters/the-truth-about-the-eu-ac...
- RandomLensman 3y agoAI not being allowed in high-risk applications is a bad idea, same for explicable in human terms (cannot do that now for human decisions anyway). The latter would kind of rule out any quantum computing, too, as the only real explanation there is through maths, not words.
- troupo 3y ago> AI not being allowed in high-risk applications is a bad idea wat > same for explicable in human terms (cannot do that now for human decisions anyway). What? Human decisions can be explained and appealed. Good luck proving something when a blackbox finds you guilty of anything.
- RandomLensman 3y agoYou can have ex-post narratives for what humans do, but that is not the same as an actual explanation. Actual human cognition is a black box as of now. The issue of appeals processes is totally separate. That doesn't mean we handover everything to AI, but the idea that we understand human decisions cannot be the reason for that. For some high risk things like controlling certain complex machinery or processes AI might indeed be needed because control is beyond human understanding (other than in the abstract).
- ryanklee 3y agoThat's a bit of an exaggeration. We understand high level motivations as being highly correlated to certain outcomes. Hunger, eat. Horny, sex. Wronged, vengeance. Money, directed. You don't necessarily need to know the underlying processes to make reliable predictions or valid causal explanations about human behavior.
- RandomLensman 3y agoThere isn't even agreement on the existence of free will. For non-trivial decisions, let's say some judge's deliberation, to claim it is fully explainable is a stretch.
- ryanklee 3y agoI didn't say it was fully explainable. And you don't need to settle debates about free will to offer valid causal explanations for human behaviors. Are you saying we don't know at all why anyone does anything they ever do? That every action is totally unpredictable and after the fact that there is no way for us to offer more or less plausible explanations?
- RandomLensman 3y agoWe are getting off track in our discussion. For non-trivial decisions we know we can have ex-post justifications from humans but at the same time we know that those aren't necessarily complete or even true at times: A credit officer not liking someone will have a justification for refusal that does not include that and we might never know - from the outside - the true explanation and that credit officer might not even know their biases themselves! AI being explainable is just going beyond what we demand of humans (we demand a justification, not a real explanation). Also, predictability isn't the same as understanding the full decision process.
- BlueTemplar 3y agoThe «high risk applications» mentioned here seem to be of social risk.
- RandomLensman 3y agoAnd AI fear cares no social risk? Some people are talking about internment, war, etc. to prevent certain forms of AI - not sure the right risks are in focus here.
- Mordisquitos 3y ago> The latter would kind of rule out any quantum computing, too, as the only real explanation there is through maths, not words. Maths are human terms.
- RandomLensman 3y agoIf the level of explanation is something that the person suffering from the decision need not necessarily understand, fair enough. But then is the limit that one human on earth can understand it? They way I understand the thrust of the regulation that isn't the intention.
- troupo 3y ago> But then is the limit that one human on earth can understand it? They way I understand the thrust of the regulation that isn't the intention. Yes, that is the intention when it comes to humans interacting with systems. https://news.ycombinator.com/edit?id=38113944 https://news.ycombinator.com/edit?id=38113944
- RandomLensman 3y agoFrom my discussions with regulators, I would not necessarily subscribe to that view.