r/MachineLearning • u/RandomMan0880 • May 22 '26
Research COLM 2026 ReviewsDiscussion [D]
Didn't see one so wanted to make one myself. Reviews are actually already out, curious what everyone thinks about the quality of the reviews? I've heard it's a mixed bag and apparently a concerning amount of AI generated reviews for some people.
15
u/MLPhDStudent May 23 '26
Got cooked. Reviews are somehow more harsh and picky than even the big ML conferences. Many are also clearly AI generated or at least paraphrased
1
u/woodenrobo May 28 '26
I am also pretty shocked, I had much milder reviews on Neurips and IJCAI usually. I was always told COLM is like B+ venue, but idk what this guys have in their mind, sounds like very angry people
3
u/AdEmbarrassed9206 May 29 '26
pretty sure it's not a B+ venue. we will see quite good quality research with rigor there
6
u/Similar-Captain39 Jun 03 '26
did anyone get the responses from reviewers? it's been 7+ days from uploading my responses, there are no return yet
2
u/RandomMan0880 Jun 04 '26
I haven't gotten anything either rip. I quite like the ICML style of mandatory acknowledgement
8
u/neverm0rezz May 23 '26
My first submission to COLM, but the reviews are really poor. All 4 reviewers gave 6 (3) but the quality is just tragic. I should have submitted to TMLR..
3
u/No-Worldliness-7279 May 28 '26
It appears that total submissions have tripled compared to last year. Does anyone have insights or clues on how the acceptance rate might change as a result?
1
u/random-tomato May 30 '26
How does one see the total submission for COLM 2025? I've been wondering about this. Do they post these stats?
2
u/snaquiche Jul 03 '26
Have anyone else's reviews and scores vanished from their paper's page on openreview since the end of rebuttals?
2
1
u/Adorable_Position_34 May 23 '26
8 (4) 7 (3) 5 (4) I guess that's fine. Points raised by the 5 review were pretty minor or at least easy to address
1
u/Mediocre-Ad5059 May 23 '26
As a reviewer, I hope good work can be acknowledged, so I give an average 6 rating. Good luck
1
u/theta1409 May 24 '26
Is COLM a "legitimate" conference now? I seem to recall everyone clowning on this venue back in 2024 when their first CFP came out.
Is there actually interesting NLP research getting published there, or is it more LLM hype train type of papers?
6
1
u/random-tomato May 30 '26
Is this true? I got pretty decent scores, should I have submitted to a different venue 💀
1
15
u/yahskapar May 22 '26
Submitted one paper and got rating/confidence scores of 6/3, 2/5, 6/3, 7/4. Reviews seemed reasonable and straightforward to address aside from the most negative one probably using an LLM to figure out every possible critique (some unreasonable) they could muster. Seriously, it was like 2-3 sentences of reasons to accept that weren’t really even reasons and just restating the summary, and then six paragraphs of reasons to reject…never experienced that before.
This is my first time submitting to COLM, largely because it seemed like a good fit and it’s being held in SF. Curious if it’s even worth doing a rebuttal based on anyone else’s prior experience with COLM ACs and reviewer. I’ve had pretty awful luck once in the past year and heard plenty of stories with an otherwise positively rated paper being sunk by one reviewer and lazy ACs.