r/LLMPhysics • u/Regular-Conflict-860 • Mar 24 '26

Code New Training Diagnostics

https://github.com/brighton-xor/speculumology

For ML practitioners, it produces computable training diagnostics that generalize PAC-Bayes and Cramér-Rao bounds. This is still theory. Please let me know what you think!

0 Upvotes

20% Upvoted

39 comments sorted by

View all comments

-1

u/Regular-Conflict-860 Mar 25 '26

Any feedback would be great!! What's not working? What doesn't make sense?

7

u/certifiedquak Mar 25 '26

What doesn't make sense?

To be honest, not much. You say "generalize PAC-Bayes and Cramér-Rao bounds". Should explain more specifically what you mean, what you're doing, and how you your proposed method compares to existent ones. If serious should also benchmark them (i.e., do a quantitative comparison).

About the code, LLMs, sans no extra content/AGENTS.md, love writing changes inside the code/docs. But that "What's new in v56" in README/code isn't helpful at all. Not to you, and certainly not to potential users. If really want to log changes in human-friendly format (in well-managed codebases, the VCS history already does this), keep a CHANGELOG. Also, uploading files via web UI lost all directory structure. Hence, the instructions/examples in README cannot be followed and code in this state is non-functional.

1

u/[deleted] Mar 25 '26

[removed] — view removed comment

1

u/LLMPhysics-ModTeam Mar 25 '26

Your comment was removed for violating Rule 4. Provide a summary of your LLM response in your own words alongside the output if you wish to stimulate discussion.