You're also leaving out that some people feel uncomfortable around firearms. Always forgetting about empathy. I could walk around with clothing that makes people feel uncomfortable, but I don't because that would be inconsiderate of me.
Also, just FYI, even CC doesn't really help you. It puts you more at risk in most cases, and it's often especially bad when dealing with cops. Of course that depends a lot on where you are and what you look like though. Some cops might show you respect for CCing, rather than the typical fear and panic. If you need to use it, a "good guy with a gun" looks exactly the same as the bad guy.