Absolutely you would for the reasons I mentioned. Vinyl is typically made from digital and the first step of mastering is altering it to remove sibilance, loudness and other things that either waste space, cause distortion or cause the needle to jump. It's already lossy and then as it is printed and played, more loss and distortion happens. Even playing the record causes it to wear and for dust to accumulate. While it is completely possible for a badly mastered CD to sound worse than a well mastered LP, the reality is if they are from the same master and other biases are eliminated (i.e. A/B testing) then the CD is going to win out since it has a higher dynamic range and frequency.