3 ms·

Say the manager knows about a bug in the AI but it consider that is more expensive to wait and properly fix it then push an update with the bug present. Should

Say the manager knows about a bug in the AI but it consider that is more expensive to wait and properly fix it then push an update with the bug present. Should the decision of fixing or not a bug that can cause lives be influenced only by how much will insurance cost? I am not arguing that a person should pay with his freedom for a mistake, people do mistake, I am afraid that the bad behavior from software industry will apply to self driving cars, the move fast and brake things mentality,ship with known bugs etc.

chrisseaton 9y ago
> Should the decision of fixing or not a bug that can cause lives be influenced only by how much will insurance cost? But the price of the insurance takes into account the risk of a bug costing a life. They know if they make riskier decisions their insurance premiums will go up. Insurance doesn't magically remove costs. It just amortises them. Loss adjusters have been experts at this for centuries.
- simion314 9y ago
  >But the price of the insurance takes into account the risk of a bug costing a life. The possible problem is who sets this price for a life, it needs to be high enough but not absurd.
  - chrisseaton 9y ago
    But this isn't a new problem at all. Loss adjusters have already been doing this for many industries where someone can be killed. Insurance for normal cars already does it even! Why are self-driving cars any different?
    - simion314 9y ago
      I am sorry I am not that good with financial business practice (I was raised to avoid them and never trust the banks or similar institutions, I am not from US) It is an interesting point how would an insurance company calculate the risk when there is not that much real data. If an airplane crashes all similar airplanes won't fly until the cause of the crash will be found and fixed in all the affected airplanes. I want similar responsibility from cars. I see how easy they get approved to test self driving cars without the citizens having to vote if they should be test subjects and I am worried that this companies have a powerful lobby and that the rules and laws won't be fair for the citizens. Other thing that worries me is that you allow self driving cars without a radar or any sensor that can detect a front collision, this also feels as letting companies to test their software on the expense of people lives. This are my opinions, I hope you can understand what some people like me think about this situation and why we think that this is something new that needs good and fair laws and rules for the citizens.
Piskvorrr 9y ago
"Move fast and brake things"? Hmm...we're about to see this x100, methinks: a Therac for our generation. https://en.wikipedia.org/wiki/2009%E2%80%9311_Toyota_vehicle_recalls https://en.wikipedia.org/wiki/2009%E2%80%9311_Toyota_vehicle... (TL;DR: spaghetti code also kills people)

chrisseaton 9y ago

> Should the decision of fixing or not a bug that can cause lives be influenced only by how much will insurance cost? But the price of the insurance takes into account the risk of a bug costing a life. They know if they make riskier decisions their insurance premiums will go up. Insurance doesn't magically remove costs. It just amortises them. Loss adjusters have been experts at this for centuries.

simion314 9y ago
>But the price of the insurance takes into account the risk of a bug costing a life. The possible problem is who sets this price for a life, it needs to be high enough but not absurd.
- chrisseaton 9y ago
  But this isn't a new problem at all. Loss adjusters have already been doing this for many industries where someone can be killed. Insurance for normal cars already does it even! Why are self-driving cars any different?
  - simion314 9y ago
    I am sorry I am not that good with financial business practice (I was raised to avoid them and never trust the banks or similar institutions, I am not from US) It is an interesting point how would an insurance company calculate the risk when there is not that much real data. If an airplane crashes all similar airplanes won't fly until the cause of the crash will be found and fixed in all the affected airplanes. I want similar responsibility from cars. I see how easy they get approved to test self driving cars without the citizens having to vote if they should be test subjects and I am worried that this companies have a powerful lobby and that the rules and laws won't be fair for the citizens. Other thing that worries me is that you allow self driving cars without a radar or any sensor that can detect a front collision, this also feels as letting companies to test their software on the expense of people lives. This are my opinions, I hope you can understand what some people like me think about this situation and why we think that this is something new that needs good and fair laws and rules for the citizens.

Piskvorrr 9y ago

"Move fast and brake things"? Hmm...we're about to see this x100, methinks: a Therac for our generation. https://en.wikipedia.org/wiki/2009%E2%80%9311_Toyota_vehicle_recalls https://en.wikipedia.org/wiki/2009%E2%80%9311_Toyota_vehicle... (TL;DR: spaghetti code also kills people)