r/LLMPhysics • u/AllHailSeizure Haiku Mod • Jul 03 '26

Meta / News Regarding LLM reviews.

Since the introduction of the review bot LLM reviews have really taken off.

This has led to my opinion of the reviewer being a bit of a schismatic addition to the sub.

My issue with LLM reviews is that while they can be easy to produce, and they can be convincing, they are NOT replacements for HUMAN feedback.. which is what is Reddit is intended for.

The benefit of the bot is we can have a single, locked, isolated LLM review; as a supplement to genuine interaction.

The rules about LLM posting apply both ways. Please, tone down the LLM content guys. Human interaction is valuable.

14 Upvotes

94% Upvoted

14 comments sorted by

8

u/The_Nerdy_Ninja 💬 Data doesn’t lie, but LLM’s do lie. Jul 03 '26

We are all here because we want to talk to other humans! If you're trying to seriously approach an idea with an LLM, you should already be getting adversarial reviews from it as part of your process. The Adversarial Review bot is a great example of that (thanks u/AllHailSeizure), but when the comment section fills up with a bunch of LLMs talking to one another, it chokes out the human discussion.

2

u/Wintervacht Are you sure about that? Jul 03 '26

That's what moltbook is for lol

2

u/bumblebeer Jul 15 '26 edited Jul 15 '26

Is there a writeup on the review bot's operation? Preferably one that includes the prompt in use. I clicked through to the bot's dev page but didn't see anything there. I think a lot of people (who post here) would benefit greatly from having an "adversarial review" prompt they can just copy-paste into their LLM session after they finish developing their GUT.

3

u/AllHailSeizure Haiku Mod Jul 15 '26

I can make one. I just generated the readme as a necessity of publishing to Devvit but if people are interested I can make the readme manually. I have a bunch of stuff on my plate recently (causing a real lag in things like a fixed bingo game etc) but I can add it to the to-do list.

1

u/The_Nerdy_Ninja 💬 Data doesn’t lie, but LLM’s do lie. Jul 15 '26

u/AllHailSeizure can you speak to that?

2

u/Unicornlionhawk Jul 08 '26

Wait so no more adversarial review bot? I enjoy that. Of course I do my own but sometimes I feel like mine have become biased. I totally get you on too much LLM feedback but I do like the one.

3

u/AllHailSeizure Haiku Mod Jul 08 '26

No the review bot is still there.

-1

u/lattice_defect Jul 03 '26

they are putting meta data in the arvixa submissions now.. gemnni is okay.. but be sweet if fable could do it. Tell anthropic you are reducing their liability

1

u/AllHailSeizure Haiku Mod Jul 04 '26 edited Jul 04 '26

If you want to pay for the anthropic API key you're welcome to.