You say that, but there’s a flip side to this. I’ve been in an abusive relationship where my SO was always a hair trigger away from a full on apeshit moment.
You find yourself (regardless of your confidence) wondering if you’ve annoyed them and after a while, you flinch at any shift in tone of voice.
It can be a sign of abuse, but not just in the way you mention.