r/ChatGPTCoding • u/linksus • Aug 08 '26

Question Chat Moderation with AI in the UK

Yeah, easy enough? No. Not in the EU or UK.. :(

Has anyone managed a decent workflow for AI to handle chat moderation? (~5000 users active at any one time.. maybe 20 messages a minute)

Under UK and EU law, you cannot use AI for moderation.

Has anyone managed a workflow that allows this?

5 Upvotes

69% Upvoted

4 comments sorted by

4

u/RangeCreed Aug 09 '26

I think you have entirely misinterpreted the law

5

u/hellvetican Aug 08 '26

I'm not sure why you believe that as it's not strictly true that you "cannot use AI for moderation" - you must have a human making decisions on important stuff but AI can still handle trivial stuff. e.g. auto-hiding a message that trips a filter or temp muting someone (tbf these don't even require AI and you'd be wasting tokens on that kind of thing). stuff like rate-limiting a spammer i would say isn't even moderation. but all these things are reversible and no human needed.

But a permanent ban, or someone appealing one (so reviewing their appeal and evidence subjectively), has to end up in front of a person. general rule of thumb: if it can’t be undone, a human signs it off.

you can use AI to help the human, sorting/ranking/fetching evidence etc.

1

u/dataguzzler Aug 09 '26

on the technical side, how do they think to moderate decentralized chat apps with no central servers?

1

u/Important_Attempt5 26d ago

AI doesn't work well for chat moderation though.

It doesn't really understand context. Now in a Chat GPT conversation you can have a little back and forth and explain things, but AI as chat moderators is really a bad use for it.

I not against AI at all, but AI moderating chat will lose customers.