You absolutely can love someone because of who they are alone. And if you genuinely, truly, can "get it up for anyone", then great. Or maybe you don't have a need for that stuff in your relationships in the first place.
But as someone who is borderline haphephobic (the fear of touch), yet also absolutely have a psychological and physiological need for physical intimacy, loving someone as a person is not enough to automatically mean I'm also going to feel something physical.
It doesn't matter how strongly I feel about who they are. If I don't want to touch their body, no amount of wishing I wanted to, changes that.