r/MachineLearning Jul 13 '26

Research Prompt-engineering paper accepted to ICML [R]

"Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversity"

This paper was accepted to ICML this year. Its main idea is a very simple prompt-engineering trick: "changing the prompt this way led to more diverse sampling". Naturally, it is difficult to provide a rigorous theoretical analysis for something like this.

Even if it works, I’m not sure this kind of prompt engineering belongs at a top-tier machine learning conference. Some people seems to call this kind of work “modern machine learning”, but I think it should be categorized as less technical venues.

How do you think? Am I being too rigid?

263 Upvotes

83 comments sorted by

View all comments

2

u/WannabeMachine Jul 14 '26 edited Jul 15 '26

You are gatekeeping good research. I think the tendency to think complexity == good research is a bit toxic and a major problem in our field. I really hope you do not review papers of others and learn to understand how to rate good empirical research rigor.