It's not all men are murderers, it's enough men are sexually violent that 1 in 5 women are sexually assaulted in their lifetime and pretty much all women have a scary story. Yes, it's a minority of men, but when there's enough of them that you have a very real chance of being sexually assaulted at some point then it's going to be scary regardless because you don't know which ones it is.
Your reaction to that shouldn't be "oh it's only 20%, most women aren't raped and the rest need to suck it up because it was just a scary experience", it should be, "that's fucking terrifying, I should be understanding and helpful".