A traditional dress is not a religious dress, it's a dress used for a long time for it's usefulness or fashion.
The historical use of the turban is fascinating, spanning for millennia and in a lot of regions and ethnic groups of the world.
I suggest the wiki page for further info, more precise than I have on hand.
An excerpt about the Pagri:
In Rajasthan state of India these turbans, known as Pagri or Safa, is a traditional headwear that is an integral part of the state’s cultural identity.
My point was (but it might be lost in sarcasm) that being the "hat" of Indian kings, nobles and emperors for millennia, we have a lot of drawings and also photos of Indian people with turbans, that most probably these generative models have been trained on.
On a footnote: why should the concept of a traditional dress be offensive? A lot of human groups have one.
Edit these are the words most associated with "Pagri" in english. It's a matter of data.