The way it was explained to me was that regardless of gender, if you see someone in the woods, there might be other people nearby and they might pose a serious threat to you. Bears don't really gang up on people, so you should be okay if you keep your distance.
I don't know whether or not I agree with that risk assessment, but I can see that it comes from a logical standpoint.