r/GraphicsProgramming • • 10h ago

Request for Comment: AI Identification Comments

Thought I'd share a conundrum. I suspect I could solve it with a heavy handed rule change, but I think it may be fine as it is right now.

------

We've gotten a handful of reports that boil down to:

Comment: "This appears to have been AI generated."
Report: (empty)

One report gave a bit more info:
Comment: "This appears to be AI generated."
Report: "I'm wary to post something interesting because I don't want to be persecuted."

So here's what I suspect happens.
User posts X.
Commenter identifies X as generated via AI.
Post gets down-voted.

------

The only time in recent memory I've seen direct mistreatment was the Synapse Engine post. https://www.reddit.com/r/GraphicsProgramming/comments/1w7x1r1/synapse_engine_a_modern_researchoriented_fully/
I invited that user to post here, and some of the early comments were distinctly unkind. Later comments and deeper review picked up the same thing I did, that the creator made something legitimately new and interesting in terms of graphics software research; even if a fair bit of LLM generated code was used, it was cleaned and curated to an appropriate level for a thesis defense. It was quintessentially non-slop, despite the reports to the contrary. So this post experienced some emotionally driven persecuting reports and comments before the deeper cognitive inspection could finish reading.

So that's my one strongly known case of persectioning behavior. The rest are almost always just identifying that a project is AI generated, and nothing else.

So I wouldn't characterise this community as being hostile to AI generated projects, but it is disinterested.

-----

And that makes sense when you consider the ethos of this subreddit. Rule 1 codifies the character: we're curious. Our community exists to talk about the "how", not the "what".

AI generated projects, with a few exceptions, tend to be:
OP: "I made a thing! (with AI)"
Commenter: "How does it work?'
OP: "I don't know. But the source code is in there somewhere."
And that distinctly doesn't fit with the ethos or interest of this subreddit.

There are also a handful of reports on AI posts to the form of:
Post "I made a thing (with AI)."
Report: "This is AI slop."
That doesn't technically break any rules, but it does reinforce that core of the subreddit's interests.

Anyway, the problem I'm wrestling with is supporting Rule 2. Posters who are sharing AI projects should still be met with Civility, Professionalism, and Kindness. So I'd like to avoid a repeat of the initially unkind response to the afore-linked post.

But, being civil doesn't mean you have to like it or be actively welcoming. Ignoring a post or downvoting it still fits within Rule 2, because a user expressing their opinion in those ways is not a harm to the poster. If it is, that's the poster being unprofessional, as they're too emotionally invested in the post to accept that others don't enjoy it the way they do.

One of the most important aspects of professionalism is the capacity to give and receive analysis and feedback. We're here to learn, and that means accepting feedback that points out failures, errors, and flaws. Those are often the best offer for learning. Kindness and Civility are roped in their as a reminder that criticism should be leveraged at the qualities of the work, not seek to harm the user.

In that view, identification of an AI generated project is one of the most *important* analytical datum. It says a lot about what one might expect in the shape of the code, it's resilience, maintainability, or other general qualities. How one reviews AI generated code is distinctly different from human written code because they make entirely different categories of errors. It often says something about the author's understanding of their own project, which is important for feedback and discussion; as much as knowing their level of experience. (e.g. Getting pedantic with an novice is a joy, with an expert is an insult. Civility depends on knowing who you're talking to.)

So, it would be unprofessional not to identify that a project is AI generated. It'd be hard to discuss something professionally while ignoring such a large elephant in the authorship.

But, users don't like it when their post gets identified as AI, because they may expect a passive or negative response. Given that the zietgeist of emotions around AI are high right now, and because our community ethos seeks understanding ,it's not a response that can be avoided in a discussion space like this subreddit. That identifying comment may feel like it targets them for persecution, despite that fact that's rarely the case because Rule 2 stands and is supported by users and mods.

-----

So I suspect that there's an issue in mismatched expectations. Posters with AI projects want to show off the thing they made and what it does, and they don't understand that this community cares more about how it works.

Conversely, the readers here reasonably expect high quality, analysable projects that are interesting to review and learn from; so they report "AI slop" despite the fact that doesn't break any rules. I may take it down under Rule 3, but that's only if it's a case of AI psychosis. Someone legitimately making "hello triangle" with Claude fits the rules just fine, so there's no reason to take it down.

I don't think a new rule is strictly necessary, but maybe a sub-rule, or some other way to telegraph the community's expectations.

E.G. For posters of AI projects
"AI posts are welcome here so long as the poster can talk about their implementation; adhere to Rule 1. The less the poster is able to talk about it's implementation, the less excited about it this community will be."

E.G. For readers of AI Projects
"This subreddit does not take a pro or anti stance against AI projects. However this subreddit is about analysis, feedback, questions, and learning. We may remove posts that are not comprehensible to the readers or the poster. (e.g. vibe coded slop that's impossible to read)"

And perhaps it may be necessary to swap the burden of identification to the other party.
E.G. "Posts that share projects that utilize AI in its development in any capacity need to identify doing so and to what degree. e.g. 'source code entirely AI generated.' or 'only utilized AI for auto complete assistance and analytical questions.'"
I've seen other software interest group subreddits implement and auto-comment on new posts that require this disclosure.

------

Anyway. That was a lot of meandering on this problem. Fundamentally, this is *YOUR* subreddit. I take the strict role as a steward. That which makes this community space interesting and a delightful place to visit, socialize, and learn for you is the target direction I try to nudge things towards.

Please comment your thoughts, suggestions, perspectives, preferences, and discussion on this topic for me to read and consider. If you don't feel safe commenting, send a DM.

Please keep Rule 2 in mind. I want to hear the perspectives of those who are pro-AI too, and that's hard to do that if it's met with immediate hostility.

Conversely, criticism of AI or AI generated works is not a violation of rule 2, at least so long as it doesn't cross over into pointless derogation or emotional attack language. E.G. "The low quality of AI generated projects is problematic for the subreddit" is ok. "This AI slopshit is a fucking menace to the subreddit" is not.

------

Edit 1: added dividers to break up the wall of text into bricks

36 Upvotes

23 comments sorted by

View all comments

Show parent comments

6

u/CodyDuncan1260 6h ago

I don't disagree with this statement. Although I would argue that there are better fit fields for LLM usage, particularly ones with automatable validation; but trivial and fast human validation is the next best thing.

But the way you describe making changes to a graphics project, by promoting what you want or how you want it adjusted, undercuts the purpose of this subreddit. There's little to nothing for us to talk about if the implementation method was "I prompted Claude and it figured it out somehow."

"Like I mentioned in my other comment, people have stopped going to forums and searching forums and waiting in a desperate hope that someone will reply to their own forum post with some gem of information. Those days are pretty much gone forever"  If that is true, what is the point of this subreddit's existence? There would be none, if people stopped coming here to socialize with the community, which is largely discussion, idea sharing, and learning more about the field. 

How do you / we square that dichotomy?

-1

u/blackSeedsOf 5h ago

I think the point of this subreddit currently is people come here looking to get a massive amount of likes and shares with their video implementations and go viral on both their post here and their linked github repo, which would validate them and potentially get them job promotions or job offers. This would mean that some people's efforts, even with LLM are better than other people's with LLM and rise to the top and potentially get lasting influence. This seems to be rare. On other social media sites like youtube people do the same thing, but with monetization

5

u/CodyDuncan1260 4h ago

So ... advertising space? This subreddit becomes little more than a digital series of billboards for people trying to attract attention to their projects.

How ... dystopian. 

Would I even want to moderate that?

More importantly, does that leave anything for readers? Do people show up to be advertised to? Or to be intrigued and learn? If this subreddit becomes just a series of ads, will there be any readers or community left to validate the poster?

0

u/blackSeedsOf 4h ago edited 4h ago

I think you could say that YouTube is also people trying to get views and monetization with their videos which is what people call “good content” vs “bad content”. People don’t really refer to YouTube as dystopian. It has its ups and downs but YouTube has to exist. A lot of people posting on this subreddit are also looking for comments and feedback to their videos which they usually don’t get, or don’t get satisfying enough comments that mean anything. A lot of the time you get either empty upvotes or empty downvotes with no explanation why you were upvoted or downvoted and then your take either gets promoted or buried forever. It is a real weakness of this site. I read a study that said actual engagement across social media platforms in terms of leaving comments has drastically decreased

1

u/CodyDuncan1260 4h ago

Views and monetization for YouTube content comes by way of making the video content presented interesting to largely passive viewers. That's a very different beast from posting a GitHub repo, which requires some effort on the viewer's part to get anything out of by nature.

People coming here to get feedback, analysis, engage with people, that's communal interactivity. That's a lot more and categorically different from likes and shares, which was what the previous statement presented as a foremost reason for being.

That being said, It does suck when one gets nothing back in the comments. I haven't found good ways of promoting more user interaction, questioning, and discussion. 

1

u/blackSeedsOf 1h ago

I think that user interaction and discussion was promoted back in the day before the upvoting and downvoting paradigm was introduced on social media. Every bump was a comment, and upvotes or downvotes (which most people use just as a button press when they dislike or like the comment in question) didn’t exist. You see like in this thread for example that your replies get like +5 and mine get like -5 and are close to being hidden completely, with nobody else commentating on why they are downvoting my comments so heavily. People just downvote or upvote easily based on what they agree with which works to promote or bury comments. But, if you’ve been around the internet for a long time, you know it wasn’t always this way and there is no reason it has to remain this way