5 ms·

The question not answered here is "why should policy care if AI is open source or not?"

Ftuuky 5y ago
Because they want to control it. Can't let the peasants obtain capabilities once reserved only to the military and big governmental agencies.
- revolvingocelot 5y ago
  Don't forget the inherent value of being able to point to a black box and say "that's why" when questioned about some questionable process. The ability for anyone to vet the source code is a weakness. It exposes attack surface for the forces of Responsibility trying to peer into the black box. "Computer says no" is an incredible force multiplier for Authority, and anything that threatens the truthiness of the black box's output will be mobilized against. Unaccountable security-through-obscurity is actually a bonus for Authority, too. Look at the whole Signal-Cellbrite [0] thing: Moxie found all these vulnerabilities, some going back years. What are the odds that an avatar of Authority('s technically-minded underling) found one or more of these Cellbrite exploits and used them as tools against enemies, or to exonerate friends? "Make sure you scan this cellphone first." Would any of that be possible if Cellbrite was legally mandated to be built from remote, publicly-viewable source every time they wanted to use it? Or, if you want to be less conspiratorial, how many vulnerabilities would Moxie have been able to find if the source had already been public (and subject to pull requests) for years? [0] https://signal.org/blog/cellebrite-vulnerabilities/ https://signal.org/blog/cellebrite-vulnerabilities/
wilde 5y ago
Right? This is good! It means they’re focusing on outcomes rather than prescribing implementations. The article just linked to the actual text of the bill but this summary seemed reasonable. https://www.lawfareblog.com/artificial-intelligence-act-what-european-approach-ai https://www.lawfareblog.com/artificial-intelligence-act-what...
keskival 5y ago
Open source software can be inspected and verified against whatever policy criteria, closed source software cannot.
- mistrial9 5y ago
  the data sets are the difference, can they be "inspected"? .. can the models ?
Proven 5y ago
Because there's no one to fine and coerce, bot.

Because they want to control it. Can't let the peasants obtain capabilities once reserved only to the military and big governmental agencies.

revolvingocelot 5y ago
Don't forget the inherent value of being able to point to a black box and say "that's why" when questioned about some questionable process. The ability for anyone to vet the source code is a weakness. It exposes attack surface for the forces of Responsibility trying to peer into the black box. "Computer says no" is an incredible force multiplier for Authority, and anything that threatens the truthiness of the black box's output will be mobilized against. Unaccountable security-through-obscurity is actually a bonus for Authority, too. Look at the whole Signal-Cellbrite [0] thing: Moxie found all these vulnerabilities, some going back years. What are the odds that an avatar of Authority('s technically-minded underling) found one or more of these Cellbrite exploits and used them as tools against enemies, or to exonerate friends? "Make sure you scan this cellphone first." Would any of that be possible if Cellbrite was legally mandated to be built from remote, publicly-viewable source every time they wanted to use it? Or, if you want to be less conspiratorial, how many vulnerabilities would Moxie have been able to find if the source had already been public (and subject to pull requests) for years? [0] https://signal.org/blog/cellebrite-vulnerabilities/ https://signal.org/blog/cellebrite-vulnerabilities/

wilde 5y ago

Right? This is good! It means they’re focusing on outcomes rather than prescribing implementations. The article just linked to the actual text of the bill but this summary seemed reasonable. https://www.lawfareblog.com/artificial-intelligence-act-what-european-approach-ai https://www.lawfareblog.com/artificial-intelligence-act-what...

keskival 5y ago

Open source software can be inspected and verified against whatever policy criteria, closed source software cannot.

mistrial9 5y ago
the data sets are the difference, can they be "inspected"? .. can the models ?

Proven 5y ago

Because there's no one to fine and coerce, bot.