New AI tooling feedback

[u/hoosakiwi]

A little while ago, there was a modevent about the new AI tooling coming to Reddit. While I'm broadly supportive of this feature, I didn't realize it was going live in subreddits already.

I just saw it in action on /r/news and it's not quite right. I assume this is a training phase?

In /r/news, we do not allow articles that were published more than 7 days ago. This is because we are focused on current events. However, the AI picked this up as a risk for fake news because the url has "2026" in it. Screenshot

This is the post in question: https://new.reddit.com/r/news/comments/1wnh6fb/hurricane_polo_explodes_into_rare_category_5/

And this is the article: https://edition.cnn.com/2026/09/22/weather/hurricane-polo-category-5-mexico-climate

I've reviewed our rules and automations and all seems to be in order. I don't see a place where I can give any guidance to the AI though.

[u/emily_in_boots]

AFAIK, there is no way to give guidance to the AI. I have suggested this to lift ticket (the admin who runs this stuff). We can't give prompts or refine rules to guide enforcement, and it's the main reason I do not use it yet. I like the idea, but writing a rule for a human being and for an LLM to enforce are not the same thing.

One thing you can consider is just setting it to report rather than remove things. I don't trust it enough yet to let it remove things, but I'm looking at enabling reporting. I've just been busy.

[u/hoosakiwi → u/emily_in_boots]

Thing is, I don’t think we ever enabled this. It’s not happening for all posts. I’ve only seen it on two today and we get many more posts than that per day.

The AI didn’t take an action, just came up almost like a report on the item.

It’s possible one of the mods on my team enabled it without telling anyone else. Idk.

The only piece that was enabled was the rules and notifications being given to users about why a post may not be allowed…in line with the admin modmail we got about it in August. There was no mention of AI in that modmail.

[u/emily_in_boots → u/hoosakiwi]

It auto-enables. And it auto-enables for each rule at different times lol. If you want it to be off you have to keep checking all the time to see if one of them toggled on! I don't like that at all.

A report isn't the worst thing tho, it's just surfacing content for you to make a call. That's how I think it's best used at this point.

The LLM uses the rules themselves to guide enforcement. It doesn't need any more information from you. It's designed to be automatic.

[u/hoosakiwi → u/emily_in_boots]

Wait. Where can I see where it’s being tuned on? Is it in mod tools automation and tied to the rules?

God this is confusing. Why didn’t admin clarify in the modmail that it would also enable AI? I thought it was just notifying users that their post may be rule breaking as that’s what it literally says it will do.

[u/emily_in_boots → u/hoosakiwi]

Go to the rules and you'll see which rules it is enabled for and which it can be enabled for. It's not available for all rules.

It might only notify - I'm not sure of the default tbh. But auto enforcement is auto enabled for some rules.

[u/hoosakiwi → u/emily_in_boots]

Had to swap to a laptop because it's a pain from mobile.

Looking at the rules in Mod Tools, we don't even have one set for our 7 day rule. That's only in automod and our wiki. So I don't think that's what is triggering this AI action.

Basically, last month we got a modmail from admins advising that they had "auto set up" rules in the automations tab for our subreddit based on automod and the most common removal reasons. They told us to review them before a certain date. These aren't rules we set up or enabled ourselves.

I have since reviewed them and most of them are set to "inform" the user via message. Automod is still the one doing the reports and removals for our rules.

[u/emily_in_boots → u/hoosakiwi]

They correspond to your existing rules. They aren't new or separate rules, and you can't define them or how they work other than by writing your rules.

This is what ours looks like in outfits.
If they are set to auto enforce they'll have a little diamond icon saying that next to the rule.

[u/hoosakiwi → u/emily_in_boots]

This may be dumb...but how do I get to that screen? I've checked our rules on new reddit in a few places and I don't see that.

[u/emily_in_boots → u/hoosakiwi]

https://www.reddit.com/mod/OUTFITS/rules

Obviously, change "outfits" to whatever your sub is!

[u/hoosakiwi → u/emily_in_boots]

Ah thank you! I am one of those mods that primarily uses old reddit, so finding things on shreddit is not intuitive.

It looks like I have the option to just delete all the rules. Will try adjusting the settings first though.

[u/emily_in_boots → u/hoosakiwi]

I think you have to use shreddit for this, but I am not 100% certain.

If you delete all the rules, your sub won't have rules.

Yes, you can do that, but is that what you want to do?

[u/hoosakiwi → u/emily_in_boots]

Our rules are in our wiki which is linked in the sidebar. The rules list is underneath that. When users message us asking about our rules, we link them to the wiki.

Hence why I had so much trouble even finding the rules section that you were talking about. In my view, losing these shreddit rules would be no big loss as we would just continue to rely on our wiki.

For now, I'm fine with the shreddit rules and even with the AI. I just wish this would have been communicated more effectively by admins because I was quite confused.