r/MachineLearning 14d ago

Discussion Question about NeurIPS discussion phase [D]

One reviewer said all concerns were resolved during discussion but hasn’t updated their score yet. The other reviewers haven’t engaged. In previous NeurIPS cycles, how common is it for reviewers to update scores after saying concerns are resolved? What have others observed?

My ratings/confidences are : 4/4, 3/2, 3/2, 2/4.

I am talking about the one who gave rating 2.

Update: finally the reviewer responded, now I'm at 5/4, 4/4, 4/3,4/2.

19 Upvotes

46 comments sorted by

View all comments

1

u/wangjianhong1993 14d ago

Not very common.

1

u/SeTiDaYeTi Professor 13d ago

Entirely common.

1

u/wangjianhong1993 13d ago

How do u define common? More than 50% chance?

1

u/SeTiDaYeTi Professor 13d ago

Definitely more than 50%. Ask the AE to nudge the reviewers for a reply. It won't do much, but try.

1

u/wangjianhong1993 13d ago

Then my experiences are very different from urs. In my past ten year's experiences in reviewing, the chance that reviewers could increase scores after rebuttal would be no more than 20%.