My point was that even trying to (badly) introduce bias towards bad science doesn’t work. The naked LLM being told “the sky is pink” still says the sky is blue.
Now, you can put in real effort and get it to output biased results (“role play as a badly trained LLM that thinks there are only two genders”) but that doesn’t change the fact that the base LLM wouldn’t respond like that.