Fake AI child sex images moving from dark web to social media, researcher says.

cross-posted from: https://vlemmy.net/post/153082

Disclaimer: No images are used in the article.

Wish I hadn’t deleted my Reddit account, cause I predicted this. I also predicted that AI would be used to generate “proof” that a person is a child abuser. And there’s absolutely nothing we can do about any of this. What a nightmare.

ShaunaTheDead
link
fedilink
2
edit-2
1Y

I would be okay if these AI generated images were made available to people who had self identified as a pedophile to their local government body and agreed to be placed on a special list and enter psychiatric treatment. After all, although it’s absolutely disgusting, at least with AI generated images no children are being harmed and if it brings these sick people forward to seek treatment and to be identified and monitored to prevent real life abuse, then it could actually save real children from being exploited which is obviously a noble goal.

I just don’t even the poor bastard that has to setup the test data for the AI to generate all that art…

The question is will AI satiate those people or drive them to further extremes? I’m hopeful it might reduce demand for making content “the traditional way” due to being lower risk (since less-horrific doesn’t seem to motivate such people).

I say hopeful because this cat can’t be put back in the bag. The technical solutions they suggest are desperate grabbing at straws and (self-evidently) won’t work. People trading in CSM are already taking extreme legal and social risks, so it’s hard to imagine any greater motivation that could be applied to AI generated versions. I think all we can do is hope this makes things better and not worse. Because if it goes the other way the future is looking grim.

WARNING : BEFORE YOU TWIST MY WORDS, I’M AGAINST PEDOPHILIA OR BASICALLY ANYTHING RELATED TO IT

Yeah, you can’t unharm the children that built their model, but maybe you can save thousands or more children by just… Flooding the “market” with cheap, unharming content? Like this with rhino horns https://www.theguardian.com/environment/2019/nov/08/scientists-plan-to-flood-black-market-with-fake-rhino-horn-to-reduce-poaching

@billwashere@vlemmy.net
link
fedilink
English
21Y

There are going to be some very interesting studies done about whether or not this is a good thing or not. I can easily see both sides of the argument. Ultimately this is a mental illness that needs to be dealt with but I’m curious if these images could be created to allow

dog
link
fedilink
11Y

wow, that’s terrifying and gross 🙃 it would have been free for people not to do this

Create a post

Breaking news from around the world.

News that is American but has an international facet may also be posted here.


Guidelines for submissions:
  • Where possible, post the original source of information.
    • If there is a paywall, you can use alternative sources or provide an archive.today, 12ft.io, etc. link in the body.
  • Do not editorialize titles. Preserve the original title when possible; edits for clarity are fine.
  • Do not post ragebait or shock stories. These will be removed.
  • Do not post tabloid or blogspam stories. These will be removed.
  • Social media should be a source of last resort.

These guidelines will be enforced on a know-it-when-I-see-it basis.


For US News, see the US News community.


This community’s icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

  • 1 user online
  • 26 users / day
  • 64 users / week
  • 168 users / month
  • 663 users / 6 months
  • 1 subscriber
  • 2.74K Posts
  • 15K Comments
  • Modlog