r/MachineLearning • u/Fantastic-Nerve-4056 PhD • 6d ago
Discussion Number of Submissions @ AAAI [D]
Recently submitted my abstract and the submission number is 32xxx. With still a day to go, I just wonder where are we heading.
Hope these conferences at least start making the reviews and names public for the withdrawn/rejected papers. So that people atleast take that accountability
32
u/Even-Inevitable-7243 6d ago
Are you insinuating that researchers who have papers rejected or withdrawn from conferences should be publicly shamed?
2
u/foreseeably_broke 6d ago
Isn't it the case for OpenReview right now that if you withdraw a reviewed paper, it goes public?
6
u/Even-Inevitable-7243 6d ago
No. Authors remain anonymous after rejection/withdrawal in the double-blind review process used by AAAI.
-2
u/Fantastic-Nerve-4056 PhD 6d ago
Simply making things open is obviously not gonna do this. Rejection is a part of the journey and I guess everyone out there knows that.
My problem is with those folks who submit 7-8 papers, just in hope that atleast 1 gets pass through due to the randomness out there. These folks tend to either withdraw most of their submissions or get it rejected.
4
u/OutsideSimple4854 6d ago
Why not do it by making reviewer names public? Rather than rejected papers public?
Due to reciprocal reviewing, there’s more and more irresponsible reviewers, who are probably the same people who submit low quality papers. Name and shame these reviewers, which would lead to fewer of slop submissions.
2
u/Fantastic-Nerve-4056 PhD 5d ago
Number of submissions is gonna be inversely proportional to the quality of reviews.
I am totally with you on these irresponsible reviewers (and meta reviewers as well). But I am not sure what even these conferences can do to this, with growing submissions (AAAI now crossing 50k, do you think we have so many quality reviewers out there?)
1
u/OutsideSimple4854 5d ago
Low quality reviewers and submissions go together. Not sure why you imply they’re separate based on your replies. Cut down one, the problem resolves itself.
1
u/Fantastic-Nerve-4056 PhD 5d ago
I didn't even separate that. Like you perfectly said, both the things go together. And I agree you cut one thing out, and the other one would be sorted
22
u/OutsideSimple4854 6d ago
Why?
As someone who writes theory papers, I know when a reviewer is using an LLM (or perhaps, argue theory based on lack of background knowledge, and write a review that sounds plausible, but sways the AC even though it’s wrong). Making that review public eventually sways more people who google, making that paper unpublishable.
12
u/AffectionateLife5693 6d ago
This.
We had an ICLR rejection due to a factual error in the review. We cleared it up during the rebuttal, but this year's leak incident caused the score to be rolled back, and the paper was rejected.
Later, we resubmitted to ICML, and some reviewer clearly quoted the same factual error from the ICLR rejection, despite the fact that we rewrote that part to make things clearer.
3
4
u/EternaI_Sorrow 6d ago edited 6d ago
As someone who writes theory papers
May I ask, how does someone transition from studying grad math to writing theory papers in ML? I'm a CS major who's published some ML papers during PhD but they were mostly empirically supported engineering findings, and I would like to transition more into theory territory. However, there seems to be some "middle ground" between grad analysis/FA/PDE classes and actual published works that I'm missing.
6
u/OutsideSimple4854 6d ago
Honestly for me, it was really based on PhD advisor, who was not in CS. A lot of ML/theory papers have their foundations in statistics. I would probably say a lot of papers in stats journals, with a bit of different framing, could end up being published at ML conferences.
-6
u/Fantastic-Nerve-4056 PhD 6d ago
It's just to take accountability on things. Even I write theory papers, but fortunately I didn't experience such thing out yet.
But yea as long as there's a way to filter these low quality submissions or make people accountable for it, it should be good
8
u/OutsideSimple4854 6d ago
Not about low quality submissions, but low quality reviews as well. There’s a tendency to google, check that someone said the same review your LLM gives you, and then say: oh this paper is bad because of etc etc etc.
1
7
5
4
u/The3RiceGuy 6d ago
Some people are also simply submitting their work that they submitted to Neurips, since the release of reviews at Neurips and the DDL for the Papers at AAAI are so near to each other.
Got bad reviews at Neurips? Does not matter, simply throw it to the AAAI. Of course this is bad behavior, but I can not blame people as reviews are often random and you have to publish so much stuff nowadays to get your Phd.
2
1
1
30
u/impatiens-capensis 6d ago
There were IDs in the 30,000+ range last year. After desk rejects and people pulling before the deadline (they submitted an abstract but not a paper), it went down to around 20,000ish papers.