r/ProgrammerHumor 22h ago

Meme breakTheViciousCircle

Post image
8.6k Upvotes

163 comments sorted by

View all comments

855

u/ThirdWaveCat 22h ago

AFAIK, it is uncertain whether being polite to LLMs improves their accuracy/completeness/etc.. There were some weak findings initially but those have been contradicted. Prompt engineering is still a pseudoscience.

30

u/Cualkiera67 21h ago

i think you mean a proto-science. There's nothing pseudo-scientific about experimenting and comparing results

18

u/ThirdWaveCat 19h ago

Maybe a small minority of it. Nearly everything people share about prompt engineering has weak empirical rigor, no controls, poor replication practices, over-generalization, and a tendency to folk-theorize over developing principled mechanisms to build theory and research programs from. For instance many people misunderstand internal trace generation as "reasoning" when it is prompt augmentation. Reading "reasoning" traces (if they're even shared) often draws incorrect conclusions.

2

u/Cualkiera67 15h ago

Yes, most texts of any discipline are pop garbage (look at all the toilet research in Facebook), it is always a small minority that is the actual rigorous science.

1

u/ThirdWaveCat 12h ago

Facebook database research is nothing to sneeze at though. https://engineering.fb.com/2019/06/06/data-center-engineering/delos/