Welcome to Incremental Social! Learn more about this project here!
Check out lemmyverse to find more communities to join from here!

Trolls have flooded X with graphic Taylor Swift AI fakes

Sexually explicit AI-generated images of Taylor Swift have been circulating on X (formerly Twitter) over the last day in the latest example of the proliferation of AI-generated fake pornography and the challenge of stopping it from spreading.

X’s policies regarding synthetic and manipulated media and nonconsensual nudity both explicitly ban this kind of content from being hosted on the platform.

JokeDeity ,
timo21 ,
@timo21@mastodon.sdf.org avatar

@tardigrada so now Twitter is called XXX?😅

zipzoopaboop ,

This is why you never feed the trolls

darkphotonstudio ,

I am shocked! Shocked, I say!

elfpie ,

The obvious solution on X's side is to ID everyone that wants to post anything. And remember that the obvious solution doesn't have to be the best solution, a good solution or, even, a real solution at all.

jayrodtheoldbod ,

Sharks have flooded Shark Infested Waters with shark asshole stink but this time the asshole stink is AI generated and Taylor Swift has a billion dollars for lawyers.

shortwavesurfer ,

Too bad I'm not on Twitter anymore. Otherwise, I would check some of these out.

M500 ,

I’m against deepfaking others without their consent, but all this coverage has me wondering what the big deal is. Things like this have always existed, what is the difference this time?

jackie_jormp_jomp ,

They're orders of magnitude more real looking.

M500 ,

It’s the Streisand effect. Now I want to see out of curiosity. Not that I’m going to, but all this talk has me wondering why it’s suddenly being spoken about.

shiveyarbles ,

This is actually an excellent way to trigger faster regulation of fakes. I applaud this.

Nomecks ,

You can't regulate something that takes desktop levels of power to make. What are you going to do? Arrest people in China, Russia NK, etc.? Societal change is needed, not regulation.

tal ,
@tal@lemmy.today avatar

Societal change is needed, not regulation.

I agree on the regulation, but I don't think that society is likely to change. Are entertainers going to stop making use of sex appeal?

scoobford ,

We could just...not lose our shit if we see slightly too much of someone's body.

An extra quarter inch of titty just isn't that big of a deal. We literally all have nipples.

tal ,
@tal@lemmy.today avatar

Eh, sounds like not always.

https://en.wikipedia.org/wiki/Athelia_%28disease%29

Athelia is the congenital absence of one or both nipples. It is a rare condition.

SpaceCowboy ,
@SpaceCowboy@lemmy.ca avatar

Block their IPs. Keeps happening? Block their subnet. Of course taking this approach we may end up blocking all of Russia, China, NK, etc.

Nothing of value will be lost.

JimmyBigSausage ,

Who is on X, though? Sigh.

Kolanaki ,
@Kolanaki@yiffit.net avatar

Can't you read? Trolls who post explicit AI images of Taylor Swift!

PatMustard ,

Still literally millions and millions of users who don't care about the things we care about

Franzia ,

A surprisingly high number of leftists still use it as well.

SpaceCowboy ,
@SpaceCowboy@lemmy.ca avatar

Well yeah, the platform owned by the richest guy in the world is the place to go to follow all the monetized socialists that are making millions playing video games on youtube and selling awesome socialist merch.

So of course all the cool socialists hang out there. Gotta be there to find out which products to buy to get socialist cred.

Have they come out with the new socialist NFTs yet? I mean the capitalist (eewww grosss, rite?) crypto market collapsed so it makes sense to buy MarxCoins now right? Vaush needs a new Luxury SUV, Hasan needs a new yacht, buy MarxCoins now! Dialectic NFTs on sale soon!

dan ,
@dan@upvote.au avatar

It's the smallest major social network but there's still 300 million ish people on it.

WarmSoda ,

Cue the Sunny "That's horrible! But where!?" Meme

FaceDeer ,
@FaceDeer@kbin.social avatar

X, apparently.

WarmSoda ,

Xtwitter giving hamster and videos some competition

anachronist ,

ye olde chan

ursakhiin ,

Back in my day we just looked at photoshopped pictures of celebrities like respectable men!

NecroMemories ,

so in twenty years this comment will be "we only ai generated like respectable men" under an article about the formerly Twitter X Friendcorp LinkedIn For Friends headquarters being invaded by naked Taylor swift robots

umbrella ,
@umbrella@lemmy.ml avatar

ngl holodeck porn will ruin lives in the future

WarmSoda ,

I'd be surprised if vr hasn't now.

maniel ,
@maniel@lemmy.ml avatar

Just look at Facebook, yesterday I was spammed by sites with AI fakes of Scarlett Johansson, reported them all, this morning Billie Eilish with biiiig boobs in suggestive positions, reported, now I'm being bombarded by Alexandra Daddario obvious fakes, it's getting ridiculous

DragonTypeWyvern ,

I haven't seen any of this, and Google knows I'm a big old perv.

Have you guys considered

Uhhhh

Not being on Facebook and Twitter?

Overzeetop ,

It's not that at all. I keep tabs on several far-flung friends and relatives on FB. Zero spam. TBF, I make it a point to click on ads for things I don't need but don't mind seeing (rockets, 3D printers, vocal jazz stuff). Of course, I'm on IPv4 with my whole household, so if I search for hiking shoes, everyone in the house gets FB ads for hiking shoes. I got a bunch of ads for Merino Wool outerwear in mid December. My wife was kind enough to get me several base layers for Christmas. There is no good and bad, just poor internet management and hygiene (IMHO).

maniel ,
@maniel@lemmy.ml avatar

I don't mind ads and suggested pages that are vaguely related to my interests, but aside from obscene manga and obvious fake baits for horny men (seriously I watch my porn in private tabs), I'm not interested in groups as exotic as "car spotting Philippines" or "my dream mud house in Congo"

Overzeetop ,

So - honest advice. I remember magazines - some with more ads than articles. You just flip past them. It’s different now because websites know your scrolling rates and FB wants you to engage. It’s why I actually click though a couple of ads every so often. Merrill? Great shoes. Osprey? Yeah, nice backpacks. Anycubic? I’ll probably want a new resin printer some day. Sure, with 2-3 clicks I can - and do - switch to the chronological “friends” feed that is exclusively friend-posted content with some paid ads (not engagement content) to pay the bills.

As for private browsing, I hear you. But, also, your IP is part of your online fingerprint. You don’t need cookies or tracking pixels from previous sessions active for FB to know - through the aggregation data they buy (possibly even from your Internet provider) what you’re looking at.

[Disclaimer - this next bit is anecdotal, no data to support the following theory.]I had a friend who suddenly was getting a ton of MAGA and alien conspiracy ads of his FB page. He doesn’t track his outgoing IP but I suspect that he was just re-assigned an outgoing IP that has previously been used by someone else (his locality is very red, politically, though he ie not). I know for my IP I’ve had my IPv4 for at least 7 months. It’s one reason that my wife, daughter and I all get intertwined ads on what we search.

To attempt get around this, one option is a vpn. Add to that a separate private browser (it’s how I did my online Christmas shopping, and it’s kind of a pain). You’re still in danger of machine fingerprinting, but it’s usually too much hassle for just marketing to wind its way back to you.

essellburns ,

That damn algorithm. You send a dic pic to one celebrity and you're being bombarded for life

scrubbles ,
@scrubbles@poptalk.scrubbles.tech avatar

Wow this is going to be interesting from multiple fronts for me especially.

First, I'm a huge swiftie - and Taylor is probably not going to take this lightly. Who she's going to target will be a more interesting question. (Shameless plug for !taylorswift if you want to join our small community)

Second, as a nerd who has dabbled with generated art - thank you trolls for ruining it for all of us. This is just going to beg for regulations that is going to ruin the generative AI world - as if we didn't have enough regulations barreling towards the area with copyright issues.

Third, as someone who hates Musk - I hope everything focuses on him and the platform formerly known as Twitter.

pimento64 ,

In doesn't matter. Sophisticated models are open-source and have already been forked and archived beyond all conceivable hope of regulation. There's no going back.

theforkofdamocles ,

We’ll just see about that.

jarfil ,
@jarfil@beehaw.org avatar

Neuromorphic hardware is coming to some future gen phones to allow training custom sophisticated models.

Indeed we'll see... the rest of the iceberg.

FaceDeer ,
@FaceDeer@kbin.social avatar

Are you going to somehow reach into my personal computer and remove the software and models from it?

theforkofdamocles ,

Could be. My tines are ever dangling.

FfaerieOxide ,
@FfaerieOxide@kbin.social avatar

This is just going to beg for regulations that is going to ruin the generative AI world

Awesome.

jarfil ,
@jarfil@beehaw.org avatar

Is that hatred, or fear, that I hear in this comment?

FfaerieOxide ,
@FfaerieOxide@kbin.social avatar

Is that hatred, or fear, that I hear in this comment?

That's "suppressing theft masquerading as art is awesome" you hear in that comment.

FaceDeer ,
@FaceDeer@kbin.social avatar

Ah, it was the third option, ignorance.

FfaerieOxide ,
@FfaerieOxide@kbin.social avatar

Ah, it was the third option, ignorance.

Oh, I'm not at all ignorant of how horrible generative " art " is, but I appreciate you checking on me.

FaceDeer ,
@FaceDeer@kbin.social avatar

If it's horrible and it's also "masquerading" as human art, what does that say about human art?

GammaGames ,
@GammaGames@beehaw.org avatar

Misunderstanding doesn’t make the comment into the type of gotcha you think it is

FfaerieOxide ,
@FfaerieOxide@kbin.social avatar

Are you mad at people who can draw or something?

FaceDeer ,
@FaceDeer@kbin.social avatar

No, I'm just pointing out the common contradiction I see in threads like this, where people argue that AI is both a big threat to "traditional" artists and also that AI is terrible compared to "traditional" artists. It can't really be both.

olorin99 ,
@olorin99@kbin.earth avatar

The use of "horrible" in their comment isn't necessarily about the quality of the art. Judging from context it's probably more about the ethical considerations. So not really a contradiction.

FaceDeer ,
@FaceDeer@kbin.social avatar

He put quotes around the word "art", which gives me the opposite impression.

FfaerieOxide ,
@FfaerieOxide@kbin.social avatar

I just notice alot of cheerleaders for this " art " form come from a place of vindictiveness against people with artistic talent and their positions are rooted more in a desire to see people the view as gatekeepers receive comeuppance than an honest defense of an ostensive tool.

It can't really be both.

It totally can. Take the example of fast food. Simultaneously a threat to traditional cooking and terrible.

FaceDeer ,
@FaceDeer@kbin.social avatar

And yet there's still plenty of traditional restaurants.

Fast food provides a new option. It hasn't destroyed the old. And "terrible" is, once again, in the eye of the beholder - some people like it just fine.

FfaerieOxide ,
@FfaerieOxide@kbin.social avatar

Fast food provides a new option.

Fast food damages the health of society and impoverishes communities.

FaceDeer ,
@FaceDeer@kbin.social avatar

Unhealthy things should be forbidden? Even if they were, this is drifting off of the subject of AI art.

FfaerieOxide ,
@FfaerieOxide@kbin.social avatar

Things that are bad for society should be suppressed and things which are good for society should be promoted. That would seem to be the point of a society.

Further, I notice a pastern in your replies of bringing up metaphor then rejecting the very metaphor as off topic or irrelevant when it is engaged to it's logical conclusion.

No accusing you of engaging in bad faith or anything, but it smells (sorry, metaphor again) less-than-fresh.

FaceDeer ,
@FaceDeer@kbin.social avatar

Things that are bad for society should be suppressed and things which are good for society should be promoted. That would seem to be the point of a society.

Great, now we just need to establish whether AI art is "bad for society", and if it is then whether the effects of attempting to ban it would be worse for society.

Further, I notice a pastern in your replies of bringing up metaphor then rejecting the very metaphor as off topic or irrelevant when it is engaged to it's logical conclusion.

What metaphors did I bring up? You're the one who brought fast food into this. I don't see any other metaphors in play.

FfaerieOxide ,
@FfaerieOxide@kbin.social avatar

Great, now we just need to establish whether AI art is "bad for society"

That seems fairly evident

You're the one who brought fast food into this.

You were fine engaging fastfood until I pointed out it, like AI " art " was terrible. Only then did you deride the metaphor as off topic.

FaceDeer ,
@FaceDeer@kbin.social avatar

That seems fairly evident

Hardly. There wouldn't be much debate about it if it was, would there?

You were fine engaging fastfood until I pointed out it, like AI " art " was terrible. Only then did you deride the metaphor as off topic.

Alright, in future I will try to remember to immediately reject any metaphors you bring into play rather than attempt to engage with them.

FfaerieOxide ,
@FfaerieOxide@kbin.social avatar

There wouldn't be much debate about it if it was, would there?

Sure there can be. People debate crypto being good and that's roundly recognized as ecocide. People "debate" who counts as people all the time. People can be wrong and loud.

Alright, in future I will try to remember to immediately reject any metaphors you bring into play rather than attempt to engage with them.

Not saying you have to do that, but if you don't it's rather untoward to bring it up later as though it's a problem.

FaceDeer ,
@FaceDeer@kbin.social avatar

Ethereum switched to proof-of-stake a year and a half ago, it no longer has a significant environmental impact.

Oh wait, this is an analogy, isn't it?

FfaerieOxide ,
@FfaerieOxide@kbin.social avatar

So you're into the other tech scam too, are ya?

Fancy that.

FaceDeer ,
@FaceDeer@kbin.social avatar

No, just pointing out who's in the "loud but wrong" camp on that one. If ecological concerns are why you think crypto is bad, well, that's not clear cut any more.

You want to keep going with this analogy you brought up, then?

FfaerieOxide ,
@FfaerieOxide@kbin.social avatar

I'm not the one who claimed they were off topic. I'm the one who was right about generative " art " being a god-damn scam. Easy mistake to make I suppose.

FaceDeer ,
@FaceDeer@kbin.social avatar

All analogies eventually fail when you dig into them far enough, by nature of what an analogy is. That is, an analogy is not exactly identical to the thing being analogized. If you want to be able to use analogies but refuse to acknowledge that they eventually lose relevance when you stretch them too far then you're simply not amenable to reason.

And then you go and explicitly beg the very question under debate with an "of course I'm right." No, AI art isn't a "scam," whatever you mean by that.

jarfil ,
@jarfil@beehaw.org avatar

Things that are bad for society should be suppressed and things which are good for society should be promoted.

Should we also have a single wise man to decide which is which? That has been tried before, multiple times.

FfaerieOxide ,
@FfaerieOxide@kbin.social avatar

Should we also have a single wise man to decide which is which?

Well we certainly shouldn't have violence for violence, as is the Rule of Beasts.

FaceDeer ,
@FaceDeer@kbin.social avatar

Is AI art literally violent, or is this another analogy?

NattyNatty2x4 ,

Oh buddy come on you can't actually be misunderstanding how they used "horrible." They're not saying it's bad quality they're saying it's bad morally

FaceDeer ,
@FaceDeer@kbin.social avatar

You realize how a word like that can have ambiguous meanings, yes?

NattyNatty2x4 ,

"That's "suppressing theft masquerading as art is awesome" you hear in that comment."

Emphasis mine. The context clues make the intended meaning pretty obvious

Tolookah ,

I just wish my printer could actually print a car. 200mm bed is a little small

FaceDeer ,
@FaceDeer@kbin.social avatar

Break it down into chunks and assemble it like Lego.

jarfil , (edited )
@jarfil@beehaw.org avatar

Now you're stealing from LEGO™! 🙀

itslilith ,
@itslilith@lemmy.blahaj.zone avatar

I have an honest question and would like to hear your (and others, of course) opinion:

I get the anger at the models that exist today. DallE, Midjourney and others were trained on millions of images scraped without consent. That itself is legally ambiguous, and will be interesting how courts rule on it (who am I kidding, they'll go with the corporations).
More importantly though, some of it (and increasingly more, as the controversy reached mainstream) was explicitly disallowed by the author to be used as training data. While I don't think stealing is the right term here, it is without question unethical and should not be tolerated. While I don't feel as strongly about this as many others do, maybe because I'm not reliant on earning money from my art, I fully agree that this is scummy and should be outlawed.

What I don't understand is how many people condemn all of generative AI. For me the issue seems to be one of consent and compensation, and ultimately of capitalism.

Would you be okay with generative AI whose training data was vetted to be acquired consentually?

FfaerieOxide ,
@FfaerieOxide@kbin.social avatar

What I don’t understand is how many people condemn all of generative AI. For me the issue seems to be one of consent and compensation, and ultimately of capitalism.

Would you be okay with generative AI whose training data was vetted to be acquired consentually?

Not if it was used to undercut human artists' livelihoods.

Hypothetical future where everybody gets UBI and/or AI becomes sentient and able to unionize, maybe we look back at this again.

I don't think AI has a soul but there no reason it couldn't be given one.

itslilith ,
@itslilith@lemmy.blahaj.zone avatar

Undercutting artists' livelihoods is definitely a problem that needs to be addressed. I honestly don't think UBI is going far enough, as it's just a bandaid on the festering tumor of capitalism (but that's a discussion for another day). But can't the same be said about numerous other fields? AI can perform many tasks throughout all fields of work. At the moment it is still worse than an expert in most of these, but it's a matter of when, not if, it surpasses that. Engineers, programmers, journalists, accountants, I can't think of any job that is not en route to be streamlined or automated by AI, reducing need for humans and putting people out of work.

Artists have it worse in the sense that they are often self employed, which makes them more vulnerable to exploitation and poverty. But isn't the problem much larger than that?

This whole debate somewhat reminds me of the swing riots. They were often portrait as anti-technology or backwards, when in actuality the reason for the revolts wasn't that machines existed, but that they were used to undercut and exploit workers.

I'm not trying to argue that any of what's happening now is good, just to clarify again. The current "AI revolution" is rotten through and though. But AI is (for now, the consciousness question is super interesting, but not all that relevant at the moment) just a tool. It irks me that so much righteous anger is projected at AI, instead of the people using it to exploit people and maximize their profits, and the system that gives them the power to do so. Capitalists don't care if it's an AI, sweatshop workers overseas or exploited workers competing for jobs domestically. They'll go with that earns them more money. We should be angry at the cause, not the symptoms.

NattyNatty2x4 ,

I'm curious what you mean by soul here, if you're using it in a metaphorical sense or the religious sense

FfaerieOxide ,
@FfaerieOxide@kbin.social avatar

if you’re using it in a metaphorical sense or the religious sense

There's a difference?

NattyNatty2x4 ,

Well I've never heard of a religious person claiming AI could have a soul in the religious sense, and "soul" has other meanings than the religiously literal one, so yes?

FfaerieOxide ,
@FfaerieOxide@kbin.social avatar

Well how many and what difference sorts of religious people have you come across?
People hear "religious" and seem equate it with "Abrahamic malarkey it isn't couth to call folks on."

"Religiously literal" seems a contradiction of terms a well. There is truth and there is ways to understand and to convey that truth.

conorab ,

I don’t have a problem with training on copyrighted content provided 1) a person could access that content and use it as the basis of their own art and 2) the derived work would also not infringe on copyright. In other words, if the training data is available for a person to learn from and if a person could make the same content an AI would and it be allowed, then AI should be allowed to do the same. AI should not (as an example) be allowed to simply reproduce a bit-for-bit copy of its training data (provided it wasn’t something trivial that would not be protected under copyright anyway). The same is true for a person. Now, this leaves some protections in place such as: if a person made content and released it to a private audience which are not permitted to redistribute it, then an AI would only be allowed to train off it if it obtained that content with permission in the first place, just like a person. Obtaining it through a third party would not be allowed as that third party did not have permission to redistribute. This means that an AI should not be allowed to use work unless it at minimum had licence to view the work. I don’t think you should be able to restrict your work from being used as training data beyond disallowing viewing entirely though.

I’m open to arguments against this though. My general concern is copyright already allows for substantial restrictions on how you use a work that seem unfair, such as Microsoft disallowing the use of Windows Home and Pro on headless machines/as servers.

With all this said, I think we need to be ready to support those who lose their jobs from this. Losing your job should never be a game over scenario (loss of housing, medical, housing loans, potentially car loans provided you didn’t buy something like a mansion or luxury car).

Franzia ,

My initial position was that AI art would be exciting when a more carefully curated training data is used.
...
But after some talking with friends, I think we're living in a world that has minimal respect for copyright already, except when a corporation has a problem with it and wants to bring down the hammer of the law.

It does hurt and its easy to be emotional about artists' livelihoods being threatened by AI, they aren't the only laborers threatened by job loss to automation, but this one hurts the most.

So now its just up to AI and artists to make interesting art with it. And for artists to adapt to this environment that has automated art tools.

itslilith ,
@itslilith@lemmy.blahaj.zone avatar

omg Franzia haii :3

with how easy it is to run these models by now, the technology is certainly here to stay, and people will need to adapt, for sure. It only really makes sense to discuss AI in the broader context of capitalism, imo

Pratai ,

This is just going to beg for regulations that is going to ruin the generative AI world

One can only hope! Fingers crossed!!!

autotldr Bot ,

🤖 I'm a bot that provides automatic summaries for articles:

Click here to see the summary

One of the most prominent examples on X attracted more than 45 million views, 24,000 reposts, and hundreds of thousands of likes and bookmarks before the verified user who shared the images had their account suspended for violating platform policy.

In some regions, the term “Taylor Swift AI” became featured as a trending topic, promoting the images to wider audiences.

X’s policies regarding synthetic and manipulated media and nonconsensual nudity both explicitly ban this kind of content from being hosted on the platform.

In response, fans have responded by flooding hashtags used to circulate the images with messages that instead promote real clips of Swift performing to hide the explicit fakes.

The responsibility of preventing fake images from spreading often falls to social platforms — something that can be difficult to do under the best of circumstances and even harder for a company like X that has hollowed out its moderation capabilities.

The company is currently being investigated by the EU regarding claims that it’s being used to “disseminate illegal content and disinformation” and is reportedly being questioned regarding its crisis protocols after misinformation about the Israel-Hamas war was found being promoted across the platform.


Saved 54% of original text.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • technology@beehaw.org
  • incremental_games
  • meta
  • All magazines