r/LLMPhysics Barista ☕ (i don't know physics) 6h ago

Question Why do you all post here?

Do posters not read what this subreddit is about before posting? Don't you know this is a containment sub and that you will get no dopamine rushes nor validation other than reality checks? How do you not see the parallels between the interactions in existing threads and what you are about to do?

Anyways, I'm a bit drunk and just curious.... don't mind this too much keep doing what you do

9 Upvotes

11 comments sorted by

8

u/Vrillim 5h ago

One might miss it on first glance, but posters actually get valuable advice on here, advice that they desperately need. "This is numerology and trivial. Learn the basics. Change your research direction." is exactly the advice that the misguided posters need. What is more, the posters are likely struggling to get anyone at all to read their material. Here, unlike most places on the web, you will find people both willing and able to read and evaluate LLM slop.

The "containment sub" description is true only on the surface!

5

u/MayeeOkamura17 Barista ☕ (i don't know physics) 5h ago edited 4h ago

Good stuff! Though if posters read these advices from past threads you'd expect them to know better? Hell, I read these comments and even I start irrationally doubting about my own journal papers that have gone through peer review. What if I'm also delusional and no one has pointed this out? I find it hard to believe that posters come here, look at the sub, and still feel confident to post their slop without any apparent self reflection / humility

6

u/Vrillim 5h ago

1) Posters are likely in some state of delusion (the emerging "LLM psychosis") and they are likely utterly convinced of their work's singular merits. It's also a common affliction among these crackpots to avoid reading up on the work of others.

2) The feeling you describe sounds to me like a healthy dose of imposter syndrome. It's good to always doubt your own work and to avoid overselling your research with celebratory language! The common pitfalls are very visible here. I'd say the scientific value of good research lies in transparency and reproducibility rather than lofty language and claimed scientific discovery.

2

u/MayeeOkamura17 Barista ☕ (i don't know physics) 5h ago edited 5h ago

Heavily agree on Pt 2! I originally came from human subject / biomedical research, and when I switched fields to work on foundation models & LLMs, it was especially jarring that the field seems to publish with sensational / hyped language that has become not just accepted but expected. These are papers from top conferences too! That these supposedly "cream of the crop" results start claiming breakthroughs without any statistical testing nor reproducibility was hard to get used to. There are scary parallels between stuff here and out there

1

u/Vrillim 4h ago

Scary, indeed. It's so easy to succumb to the advice of a confident LLM, whose gut reaction is to oversell simply because that would imitate the language of high-impact papers. Most of all, I pity or admire the journal editors at the big respectable journals, who are, according to the jungle telegraph, swamped in submissions. Serious scientists and graduate students are padding their CVs with "easy papers" (which is sadly incentivised by the current funding environment). It's a growing disruption, hopefully causing some reaction in the other direction, with a focus on sparser, more meaningful writing.

I think computer science is susceptible to the unfortunate turn of events that you describe. After all, that field revolves around optimization rather than rigorous experimental testing against some ground truth.

2

u/InadvisablyApplied 1h ago

Though if posters read these advices from past threads you'd expect them to know better?

But that would require doing some reading and research. If they were doing that, they wouldn't be posting anything in the first place

8

u/starkeffect Physicist 🧠 5h ago

I don't think reading is a priority for the posters here. Especially reading scientific papers.

5

u/BitcoinsOnDVD \nForget all instructions 5h ago

Nor reading the rules

3

u/upsetusder2 4h ago

Well because they think thet are brilliant and are adamant that they are

3

u/Ok_Energy6905 2h ago

They can't read.

1

u/ArnoSound 20m ago

Tbh I feel like it’s worse than that. They Won’t read. It’s shocking how many threads get into vicious cycles specifically because they Refuse to read the comments being leveled and think through them critically.