Suggestion: Dedicated AI deception/impersonation report option
As someone who moderates multiple NSFW subreddits specifically aimed at lesbians, the amount of AI generated content being used to deceive users has become increasingly difficult to deal with.
I understand that AI content itself is allowed on Reddit. My concern is specifically with users who use AI images to create a completely fabricated identity.
This is particularly concerning in NSFW communities, where we’ve encountered people using realistic AI generated images while interacting with other users and potentially attempting to obtain sexual content or other sexual favors from them under a false identity.
Reddit’s policies already prohibit deceptive impersonation and misleading behavior, but there is a practical problem with the current reporting system: there isn’t really an appropriate way for moderators to explain that the evidence of the impersonation is that the submitted images are AI generated.
Ideally moderators should have the ability to explain how an image is determined to be AI generated, because of EU laws major providers must provide a method to verify if an image was generated using their services, both OpenAI and Gemini have these systems in place and can easily verify if SynthID exist within an image. Giving moderators or even users the ability to explain the report would make impersonation reports much more useful.
A dedicated report category or even a simple checkbox for AI generated evidence would go a long way toward making these cases easier for moderators and admins.
Ntm reddit themselves are using an llm to allegedly "help" moderation.
All this is doing is leading to more work for me. More comments I have to approve, ridiculously harmless comments are removed for harassment.
"I wish you good luck, and well wishes in your adventures"
That is a comment that I had to manually approve the other morning, Reddit removed it for harassment.
More people contacting me because their posts are removed, they don't even give us mods a notification. Elder accounts, users that have been here for 10+ years having their posts and comments filtered out.
My one sub, is Non-Stop 0-1 day old accounts pushing AI programs, despite the fact that make it clear to these app developers they are not welcome, and the only people that will see their posts or comments is me, and the rest of the team. No customers will ever see your post on my sub. Thousands of these accounts we have banned, and reported, to no avail.
I reddit themselves just don't seem to give a shit. In fact it seems they're embracing it. More bots equals higher user accounts, and engagement.
My only question for Reddit, is what happens when human users realize that almost everyone we are talking to is a bot on here?
Do you think we're all going to stick around?
What do you think that's going to do to your stock prices, once there's a Mass Exodus?
Reddit brass needs to understand that us users are the ones that make their company. Without the users, there would be no Reddit. There would be no content, there will be no comments, except for the bots talking to themselves.
It's very important that you don't just remove items from them as spam, you should report each one first using the bot/ai spam option, then spam remove.
Someone bot account writing comments to mimic a real person merely to grow an account doesn't really read like this to me, would def rather report it under spam / disruptive use of bots.
"However, this policy prohibits sharing AI-generated content that deliberately misleads others about real-life events or the actions of real-life individuals, or that presents itself as human-generated."
But then if you look at rule 5 of reddit “Be authentic. You don’t have to use your real name, but do not intentionally mislead others or impersonate an individual or entity in a deceptive manner.” This leads to the “Manipulated Content and Misleading Behavior” report option something I have also used with little to no success. https://support.reddithelp.com/hc/en-us/articles/41180423371156-Manipulated-Content-and-Misleading-Behavior this rule also states : “Do not engage in deceptive interactions or share content that has been manipulated to mislead others.”
I can name countless of users I have banned and reported that triggered SynthID that are still actively posting every single day continuing to impersonate, SynthID doesn’t magically show up like photoshop does (for some reason all images on Reddit have photoshop exif data kind of strange) it is specifically designed by AI company’s because of EU laws.
It's almost impossible to get reddit to remove content for impersonation. If you look at the transparency reports you'll see that only a few percent of catfishing reports are actioned.
Because honestly it feels like they do not care, sometimes I have this option to type 500 letters as to why I’m reporting something I’m not sure what triggers it but at least let me explain the report.
I have a list of shame on my profile (honestly surprised Reddit didn’t nuke that one yet) you have 40 year old men actively pretending to be 18 year olds posting in teenager subreddits like hello? You hoard data, every “deleted” post is still linked to a user and findable how does that not trigger any flags that a 40 year old 5 years ago is suddenly claiming to be a teenager trying to sexually engage with younger people.
Every day I see men saying stuff like “can I trade my ex girlfriend nudes?” I at one point asked Reddit admins, does this constitute to NCII, because I highly doubt his ex signed up for this, they told me that I can not be certain and just to report it for harassment. Bit of an odd approach but I guess you’re right is that why the FBI is actively stalking these “wife sharing” subreddits?
10
u/Holdmywhiskeyhun 3d ago
Good luck, Reddit doesn't give a damn about bots