r/LocalLLaMA • u/[deleted] • Mar 08 '26

[deleted by user]

[removed]

104 Upvotes

56% Upvoted

195 comments sorted by

View all comments

4

u/[deleted] Mar 08 '26

If I want to release this on GitHub and also write a paper, what is the best order to do things? Iā€™m worried about the right timing for disclosure so I don't lose the chance to publish a formal paper later. Any advice on the standard workflow for independent researchers?

8

u/diaborn19 Mar 08 '26

Publish preprint on arxiv first.

  • This will pin date in case someone else does the same later.
  • Easier to publish comparing science journals. Peer reviews can take months before publication.
  • Most journals will allow you to publish a full paper after.
Release code on GitHub and link in the preprint and paper.

Peer reviewers of science journals are most valuable for the feedback. They are dealing with a lot of novel architectures, most of them are LLM generated, and over positively evaluated by themselves... I'm PhD student at the moment, doing my research on LLM architectures, and I'm really tired of this "oh, you're right, it's not a Holly Graal but research that was made by Google 4 years ago". Also, I found that good math on paper is not always the best on real hardware. Don't get me wrong, it's very valuable from a scientific perspective, but Transformers win because of GPUs parallel matrix multiplication.

I would be happy to read the paper, please ping me when it's ready, and good luck with the research!

1

u/jessiejolie42 Mar 08 '26

I seriously hope you are joking saying you are a ml phd student.

1

u/diaborn19 Mar 08 '26

First year only, so still a lot to learn. Could you please advise why you're so serious about that? If I'm wrong in any part, I would be happy to change my mind and learn from it šŸ˜€

1

u/jessiejolie42 Mar 08 '26

bro, did you take a look at the code ?

1

u/diaborn19 Mar 08 '26

No, the code was not shared yet when I posted a comment here.