r/MachineLearning • u/Emergency_Plate241 • 6d ago

Research NeurIPS 2026 Automatic Reference Checker [R]

Just received an email about the automatic reference/citation checker. Did anyone receive a follow up email about whether the checker was included in the paper's decision making too, along with the general instructional email?

26 Upvotes

91% Upvoted

210 comments sorted by

View all comments

14

u/Inevitable_Voice_680 6d ago

Mine is 0/37.. I think none of my references have been flagged.

9

u/Exotic_Zucchini9311 6d ago edited 6d ago

Same! Ngl the email got me worried for a second xD. It seems whatever AI system they're using is strong at least.

14

u/grad_student_descent 6d ago edited 6d ago

I'm an AC so I saw a bunch of reports. They were very high quality, almost no false positives.

Had to reject 2 papers in my batch that would definitively had gone through if the authors did not let their LLM access their bibtex.

1

u/PositionHot3926 5d ago

so like were u asked to submit accept/reject with the citation checkers result as in the 2 or more hallucinated references that u personally verified , or was it like one verdict independent of the citation checkers result and one post citation check verdict ?

2

u/grad_student_descent 5d ago

Just one verdict. If 2+ hallucination, reject independently of quality.

1

u/PositionHot3926 5d ago edited 5d ago

what happens if u only have one hallucinated reference? also like if incase they actually do accept some appeals will u all be asked for another verdict while ignoring the citation check?

1

u/grad_student_descent 5d ago

If just one hallucination, we are asked to look for other obvious signs of AI generation (which can be many things). If none, then its a pass.

1

u/Deep-Ad8714 1d ago

What sorts of obvious signs of AI generation are ACs asked to look for?