That's the problem though: if its lost confidence, you might be gradually slowing down into a concrete median. You must ensure that the autopilot has enough confidence (while said confidence is diminishing quickly) to continue in the path it chooses safely between current speed and 0.
Pretend we're in the car together. We're traveling at 70mph on a two lane road at night. I cover your eyes with my hands on a curvy road. Assure me we will stop in time without hitting something.
> [...] you might be gradually slowing down into a concrete median.
Which seems to be less of a problem than not gradually slowing down as you run into the concrete median.
Just as a human driver would, a road vehicle self-driving system needs to act sensibly to mitigate risk if its confidence in its ability to safely operate in the conditions it finds itself is reduced, until and unless a human driver has resumed active control.
I think we agree, its simply in the execution. Why didn't the vehicle slow down when it lost confidence? Was it software? Could the ultrasound sensors and/or MobileEye camera not see the concrete median at night?
Pretend we're in the car together. We're traveling at 70mph on a two lane road at night. I cover your eyes with my hands on a curvy road. Assure me we will stop in time without hitting something.