I wonder what you then think about people who drive after heavily drinking or taking drugs. To be honest, I have more faith in technology than in humans.
Not to mention that self driving can probably solve some other problems too, like traffic jams caused by erratic driving behavior of humans, etc.
If you have vehicle to vehicle communication, it is possible to adapt the speed of all the vehicles on the street to avoid them being stuck in a traffic jam.