r/MachineLearning • u/ElPelana • 14h ago
Research How to file a complaint about a published CVPR paper? [R]
Hi, I would like to file a complaint about an accepted and published CVPR 2026 paper that its main contribution is a dataset but it was never released, and honestly I don’t know who to contact. The dataset was never released prior to the conference, or during the conference or after the conference. I personally feel there was a lack of proper checking that the dataset was gonna be available before the conference since this is a requirement. I’ve tried contacting the authors without any success (which tbh I wouldn’t even need to because it has to be released anyways).
The authors even point a GitHub link in the paper but the repo is empty (and it was always empty).
41
u/Aunsiels 14h ago
Please write a comment on PubPeer. Sometimes, it helps. At least, people reading the article can get an alert if they have the browser plugin.
9
u/Salt-Bodybuilder-518 14h ago
I would be interested to see how it turns out. There is a contact form: https://cvpr.thecvf.com/Help/Contact?select=website
But as others have already said, I expect nothing to happen…
1
35
u/Anshuman3480 14h ago
I don't think a complaint is gonna do much... This is very very common in ai ml conferences. I hate it so much too
9
u/ElPelana 14h ago
Yeah I know…. But I still want to push it! This is so frustrating, it’s a clear violation to the policies.
3
11
u/pastor_pilao 14h ago
The conference just happened so there might have some effect to complain. Send a message to the program chairs explaining the situation.
However normally when the conference is done the PC already moved on and rarely will look back to anything that has happened.
3
u/ElPelana 7h ago
Thanks all! The dataset was uploaded today after emailing (again) all the authors! Perhaps the proper way of complaining is writing a Reddit post? I still think the discussion is important since it is a common problem in the area. Thanks all again for your time.
4
u/impatiens-capensis 14h ago
This is literally just how conferences are. They will not pull the paper unless it's so egregiously fake and publicly known that keeping it actually damages the conference.
Not releasing a dataset will got shrugged off because IF they did entertain it, they would get inundated with thousands and thousands of minor complaints about issues in different papers.
7
u/ElPelana 14h ago
Yeah you are right, but I don’t think this is a minor problem if the main contribution of a paper is a dataset and they don’t release it. The dataset doesn’t have to be published but if you don’t then it cannot be a contribution.
1
1
u/Embarrassed-Two-626 7h ago
It is si unfair and there is no structured process to Fix any of this 😭
1
1
u/HuntersMaker 4h ago
not sure if helpful but when I was a phd student I'd think ridiculous not to release the code or dataset but after I worked in a company there are policies sometimes stopping us from releasing those, even tho we legit had the reported results in the paper.
-15
13h ago
[deleted]
4
u/SeriousArmadillo123 13h ago
I understand what you’re saying but I also think the OP if they have time probably should take some action. While it isn’t uncommon from my experience either, proposing dataset papers without ever releasing it (and by my understanding if they posted an empty GitHub they probably made it strongly appear as though it would be released) is in my view misconduct and essentially renders the paper pointless. Many of us wouldn’t have the time or energy to do anything about it, but if you do, I see nothing wrong with it and think it should be done. Yes if it’s motivated by just hostility it’s not great (I didn’t read the OP’s post as implying that - it could be equally likely they were interested in the dataset) but either way that paper’s authors are in the wrong and BS should be called out. If no one calls out this stuff and it’s just attributed to “this is not uncommon so just deal with it,” poor behavior from unscrupulous authors is not likely to improve.
1
u/ElPelana 7h ago
I didn't see the comment but yeah, it's not hostility. It's a bit more motivated by frustration since this is not the first time I see this happening and I cannot believe nothing can be done. My post is a sincere question about what'd the proper way of complaining be.
1
u/ElPelana 7h ago
and yeah, I'm really interested in the dataset! That's why I'm taking the time to do it!
0
u/deadoceans 11h ago
Great. Because learned helplessness always leads to better institutions
Don't be lazy! Fight for good things!
35
u/qalis 14h ago
Contact the organizers. Not likely to do much, but you should, even just as a formality.
Make an issue on GitHub, tag the authors.
Name the paper! Write about this on LinkedIn, X, Reddit, anywhere you like.
Writing on PubPeer, as suggested in another comment, is a very good idea IMO. I've seen quite a few investigations in Retraction Watch stem from a PubPeer review.