A majority of my shirts have been band related since I was old enough to buy my own clothes. I've never been questioned, interrogated or otherwise questioned about my appreciation for the band.
On that same token I've never felt compelled to interrogate or judge anyone else on their choice of band shirt.