Dude, one of the most egregious things a piece of media can do is bore you. Bad can be funny, angry can make you think, fun and happy dont need to be explained why we'd want to watch that, but boring just wastes our time. Media that's been overly focus grouped has the highest likelihood of being bland as shit. Like I said, YES, a LOT of the race swap hatred comes from racism, but it also acts as a signal for people who dislike boring media that it might be a focus group tested waste of our time.
edit Tldr: If its race swapping thats the problem itself? Yeah, likely racist. But race swapping is also a red flag for people that their actual problem with media, bland and focus group wastes of time, is present in said piece of media