cross-posted from: https://piefed.zip/c/privacy/p/717792/massive-leak-shows-erotic-chatbot-users-turned-womens-yearbook-pictures-into-ai-porn
Chatbot roleplay and image generator platform SecretDesires.ai left cloud storage containers of nearly two million of images and videos exposed, including photos and full names of women from social media, at their workplaces, graduating from universities, taking selfies on vacation, and more.
So this is really gross obviously but the question of should it be illegal, and if so, where is the line, is going to be an interesting one moving forward. Getting an AI to draw a naked picture of someone for you is illegal? Comissioning an artist to draw a naked picture? What if it’s just an original character who “happens to look like x person”? Learning to draw and making one yourself? Does it involve disseminatation vs personal use? If you make a nude picture of someone else but no one ever knows does it even matter? What if you have legal rights to their image? Would not want to be a lawyer involved in that field in the future, oof.
If it is public it should be illegal,
If you do it privately, it should not be illegal.
edit: and i think any other stance on this issue would litteraly just be oppression and the actual loss of freedom
But as a thought experiment: AI images are usually derivative, even faces dont look exactly like the original, they take it and alter it a bit. So if someone takes an image and alters it, and then displays it publicly is it AI generated porn or is it art? Because obviously not all nudes are porn and some erotic art is still art. So a lawyer would have to prove that a) the original person is recognizable enough and therefore an offense has been committed and b) that the image is pornographic and not erotic art. That could be one heck of a challenge.
I was going to agree with him but you have a good point. The source should not be real people . The person should have to put in prompts to get something that looks similar like hair color or whatnot. If they can’t get it just the way they want it than boo hoo.
i mean in principle i dont even think people should be allowed to bully me with even a drawing of me publicly
(i do think that the rules for ‘public’ figures and non should be different in this case tho)
Realistically if its private no one will know about it anyway. IIRC the UK goes with private is also illegal and the realistic reason for that is so that if its leaked and you have it they don’t need to prove that it was you who leaked it and “i was hacked though!” isn’t a valid defence.
i mean i get the idea, but i dont agree with it. It like saying “its fine aslong as you dont get caught”
I know what you mean, not saying its right but that is how it apparently works here. Law often struggles when you go down what if scenarios with technology.
Technically I am not allowed to cut back some nettles on a path because I don’t have the land owners permission. In reality no one gives a shit and people may appreciate not getting stung when walking down the path.
‘Ai girls never say no’ is pretty awful
This is pretty gross and not at all surprising.
Half of the requests on /r/grok are “yes but how do it do this to pictures I uploaded??”
NaziGPT will do pretty NSFW images (no genitalia) for stuff it created but even Elmo isn’t stupid enough to allow it for any upload.
I kinda think that’s so people don’t make Elon and Trump images more than legal reasons.
Elon is clearly above the law these days.
This just reminds me of the thing Google pulled not long ago asking users to submit pictures of their younger selves to generate their adult self at the baseball game with them.
Immediately thought it’d be stupid to do that since people are gonna work their ass off to bypass AI guardrails in any case including generating child porn, and lo and behold, few days later I find a tweet of someone calling out another person for creating AI-generated porn of their own daughter.
Social media and Big Tech, in general, has been really awful for privacy. This is just disgusting.
Should be fined $1000 for each image or identifiable piece information of a human being.
