This is the issue, not criticising Swift in general.
OP misses the mark in my eyes, not because the misogyny isn't fuelling the recent wave of criticism from the right (who couldn't give two fucks about emissions since they don't believe in climate change), but because it lumps all criticism of Swift together, valid or not, almost feeling like it's pro-Swift rather than being anti-misogyny, and fuck being pro Swift, and excusing any of her actions (downsizing from two jets to one isn't worthy of any praise nor defence, it's not like she can use both at once, and is still flying just as much).
You can (and should) call out misogynists without defending the billionaire.