This is an interesting hypothetical I hadn’t considered, but I have a hard time seeing it as a big problem. If “countless” people were assassinated in self-driving cars, people would just stop riding in them.
Since 35,000 Americans (and 1 million people worldwide) die in human-driven cars each year, I think the overwhelming likelihood is that self-driving cars will save lives.