I haven't heard of voice-changers that can replicate other people's voices that aren't made with machine learning.
The issue is impersonation. An AI voice generator that does not imitate anyone in specific and has a "unique" voice, I have no issue with that.
And obviously, a human voice imitator that uses it for impersonating others is also an issue. But that's far less common and accessible than a computer powered option.