In my opinion, it’s immoral to profit off of someone’s loneliness. Of course that’s a huge sector of the economy now and why dating apps focus on vapid, meaningless hookups rather than finding real working relationships, and cam girls exploiting whales, so on a so forth.
But I still think that things like AI girlfriends promote isolation, hostility, and anti-social behaviors that are harmful to society.