I mean, they do make your device slow. That why tools like InSpectre exists. For some old cpu's like my notebooks one it can be up to 20% performance impact, so if you not planning to use it with internet (or at least as main access point via browser) ever again, why not get yourself free performance?