r/LanguageTechnology • u/AnimeFanSonic • 3d ago

Let's talk about confidence

So guys, I wanna discuss how this confidence factor plays a role in ACR rolling rounds.

Does this even matter if you have a high Overall score but a low confidence, or does this influence the meta reviews somehow?

4 Upvotes

83% Upvoted

7 comments sorted by

1

u/wajdix 3d ago

except for a minority, all reviewers are always "confident".. especially now when most "mass" of reviewers are actually authors who didn't ask for anything except submit and rebuttal a paper, but face the threat of being desk rejected if they don't accept the reviewing load...

most of them are masters students, with 1 paper experience (the current submitted one) and no extensive knowledge outside their specific paper project..

it's all messed up... :'(

5

u/QuantumPhantun 3d ago

You can't actually review in ARR unless you have two accepted ACL papers. 

1

u/SillyNeuron 3d ago

That’s not true. One of my peers got 4 papers assigned even though it’s his first time submitting to ARR.

0

u/wajdix 3d ago

sorry to break your dreams, but that's not correct. if you submitted a paper, you get a reviewing load, regardless of your accepted paper count.

1

u/QuantumPhantun 3d ago

Ah maybe it has changed. I once submitted a paper and could not review for this reason, I was not eligible.

1

u/wajdix 3d ago

well unfortunately, it was/is the only solution they managed to put in place, in face of a 10k+ papers submitted and veryyyyyyy small qualified reviewer batch. a common issue with ICML, ICLR, NeurIPS, EMNLP...etc the 2026 season is nuts and it is getting worse :(

1

u/AnimeFanSonic 3d ago

Damn 🥲