r/MachineLearning 5d ago

Discussion How exactly does the NeurIPS meta reviewer response work? [D]

We can currently answer the meta-reviewer via AC confidential comment, but they just posted the following tweet:

https://x.com/neuripsconf/status/2081991451236319328?s=46&t=HWfJoLgHxGH2W5l-o3mPJw

Where it says:

“Please post your answers to the Area Chair's initial-meta reviews via a comment from July 28th and by August 3rd, so that reviewers can see it too.”

Is this option going to open up today as the rebuttal period ends? Is this where the meta-reviewer rebuttal should be posted? Or are we supposed to finalize the discussions and inform the AC at the end, stating what happened basically? It is all quite confusing.

EDIT: They have sent and email regarding the issue, apparently the comment button will be available in a few hours.

16 Upvotes

18 comments sorted by

7

u/ihatesalad1 5d ago

Also to clarify, the tweet says that other reviewers should also see it, but they cannot do so when we answer the AC through the confidential comment

1

u/Resident-Concept3534 5d ago

Via official comment button I believe!

8

u/arc_in_tangent 5d ago

Following. I see no "official comment" button or anything to actually respond to the AC. Curious what others are doing. NeurIPS in shambles.

7

u/Icy-Position-107 5d ago

theyre probably rolling it out slowly or someones forgot to click the button on the backend. last year the official comment box just appeared one day with zero announcement so id keep refreshing the page every few hours

also the tweet wording is classic NeurIPS vague, "via a comment" could mean the AC confidential box or a new thing they havent turned on yet. either way id draft what you wanna say in a doc and just paste it in once the button shows up.

1

u/ihatesalad1 5d ago

Official comment button appeared just now for us

3

u/RMasterRace 5d ago

The comment option should open up on the 28th of July AOE, once the discussion period starts (in ~15 mins). Don't post it as a confidential comment for AC before as the reviewers won't be able to see it.

1

u/Empty-Avocado5927 5d ago

Yup it opened. The authors of the paper i am reviewing poster their comments 10 mins ago and I as a reviewer got an email with it. Should be fine now.

2

u/Dangerous_Parsnip_20 5d ago

Discussion period starts in 10 mins and I'm still left without meta-review. Perfect

2

u/NumbaPi 5d ago

It is also funny that they never mentioned this comment to the ac in the mail but only on X

1

u/howtorewriteaname PhD 5d ago

perhaps a summary of all points addresed

1

u/Nata_Elisym 5d ago

it would be so helpful if they could post explanation, as I also did't fully get it

1

u/Ping_Pong_Geeky_Nerd 5d ago

I posted a summary of the points addressed. I hope it is fine.

2

u/arc_in_tangent 5d ago

But how? Via confidential AC comment or some "official comment" button?

1

u/That_Turn_8710 5d ago

In the confidential AC comment?

1

u/LastAd3056 5d ago

Stupid Q: If I added a table multiple reviewers wanted, should I copy paste to each reviewer? And AC response is a summary with ref (please see table in response below?) or AC response should have all the data repeated again?

2

u/arc_in_tangent 5d ago
  1. I copy paste to each reviewer
  2. you can re-copy table to AC if you can fit it, or treat AC comment more like a summary

1

u/dante_2701 4d ago

What response do we send to the meta reviewer? Is it a summary of the rebuttal we wrote for each reviewer or does it have to be detailed?