A Telegram user who advertises their services on Twitter will create an AI-generated pornographic image of anyone in the world for as little as $10 if users send them pictures of that person. Like many other Telegram communities and users producing nonconsensual AI-generated sexual images, this user creates fake nude images of celebrities, including images of minors in swimsuits, but is particularly notable because it plainly and openly shows one of the most severe harms of generative AI tools: easily creating nonconsensual pornography of ordinary people.

  • GhostTheToast@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    11
    ·
    7 months ago

    Don’t get me wrong it’s unsettling, but I agree, I don’t see the initial harm. I see it as creating a physical manifestation of someone’s inner thoughts. I can definitely see how it could become or encourage dangerous situations, but that’s like banning alcohol because it could lead to drunk driving or sexual assault.

    • Mastengwe@lemm.ee
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      1
      ·
      7 months ago

      Innocently drinking alcohol is in NO WAY compared to creating deepfakes of people without consent.

      One is an innocent act that has potentially harsh consequences, the other is a disgusting and invasively violating act that has the potential to ruin an innocent persons life.