I agree that one of the big limitations in advancing artificial intelligence is our capacity to understand what to built, or even what we have built.
There is some progress. Deep neural networks are an example of an AI technique that’s pretty much a black box in terms of human understanding, but we’re finding ways to apply DNNs.
The Tesla Model S uses both camera and radar, but notably not Lidar. Lidar is extraordinarily expensive, but maybe the post-mortem investigation will indicate that it’s necessary.