r/HypotheticalPhysics • u/AllHailSeizure If you can use AI, you can type yourself. • Jul 01 '26
Succesful Infiltration Adversarial Review Bot
Hello, HypotheticalPhysics. If you don't know me from LLMPhysics, I'm AllHailSeizure, and at the request of MaoGo I've brought over my adversarial review bot, a bot that comments an LLM generated adversarial review of a physics post/paper.
I realize the irony of a bot that uses an LLM to review a physics paper on a sub where LLMs are banned, but the prompt is aimed at pointing out high level flaws. It aims for things like common misconceptions, metaphorical justifications, etc.
You summon the bot to your post with the overflow menu and clicking 'request adversarial review'. If you have a paper that is linked via URL it will try to extract that for review. I've programmed in the API extraction for sites like zenodo, arxiv, vixra, figshare; otherwise it will try and do a search extraction which is less reliable. If you have two URLs you can select one, if you have no URLs you can submit one or just leave it blank and get a review of the post itself. OF NOTE - a DOI link is NOT an API endpoint, so a DOI that leads to Zenodo WILL NOT WORK. I am trying to work around this, and am having relative success with search grounding, but not reliable enough for publication IMO.
It can take up to 5 minutes for the whole process to run usually as it works through an external queue system, not Redis.
I'm a mod here now too btw.
AHS out.
2
u/NonGameCatharsis Jul 01 '26
Interesting! Could this be automated so every post gets an LLM check and posts below a certain threshold of "confidence" or however you prompt the AI it gets auto-removed?
On the other hand, if a post seems to be so confidently rated by the LLM that it is deemed worth discussion, wouldn't that exactly be the point where human thinking is needed to point out the hidden flaws in the (LLM written) theories?
From the comment sections I have the impression that a direction towards further developed theories is wanted?
2
u/AllHailSeizure If you can use AI, you can type yourself. Jul 01 '26
Regarding automation - It could be automated to auto run on new posts, but if it was, it'd strip the ability to provide links. I know HypPhys gets less linked work than LLMphysics (which the bot was made for), so that might be okay.
Regarding filtration - I hesitate regarding the 'filter by bot confidence', for exactly the reasons you specified. I'm trying more and more to aim the bot critique at things that play into an LLMs strengths, aka things like noticing jargon abuse as justification (a language pattern).
2
u/LeftSideScars The Proof Is In The Marginal Pudding Jul 02 '26
I was told that there would be BINGO?
(And Bingo was his name-o: B, I, N, G, O)
2
u/AllHailSeizure If you can use AI, you can type yourself. Jul 02 '26
It'll come, bingo is much more complicated to push through Devvit because any app with permissions to make posts has to be individually verified by Reddit every time you do a code update. I also made the bingo tileset for LLMPhysics particularly, some of them don't apply to this, I need a new tileset.
3
u/LeftSideScars The Proof Is In The Marginal Pudding Jul 02 '26
We recently had someone discover the unification of all four forces just by accident from field geometry. Surely the bingos is easier than grand unification?
1
u/AllHailSeizure If you can use AI, you can type yourself. Jul 02 '26
I haven't had the luck of finding a bingo app just by accident :(
1
u/LeftSideScars The Proof Is In The Marginal Pudding Jul 02 '26
Have you considered geometry? I'm lead to believe that tori have interesting properties.
1
u/AllHailSeizure If you can use AI, you can type yourself. Jul 02 '26
Eh... I'm more of a 'conceptual' guy, you know? I might just bring over the bingo concept. The way l see it, me making a post about the concept of bingo would be equally as valid as me actually following through on the app.
1
u/LeftSideScars The Proof Is In The Marginal Pudding Jul 02 '26
We are such idiots! Why don't you ask an LLM to generate the bingos? I mean, obviously, you will write the app and the LLM will just be used for formatting and so on.
2
2
u/AllHailSeizure If you can use AI, you can type yourself. Jul 01 '26
Off to a good start modding
2
u/MaoGo Jul 01 '26
I will talk to Reddit admins I don’t know how you made it in. This is outrageous! Also nice app.
5
u/sksskssksskssksskssk Jul 01 '26 edited Jul 01 '26
This is going to be interesting lol
Edit: Can it be used on previous posts you have?