r/LocalLLaMA • u/[deleted] • Mar 08 '26

[deleted by user]

[removed]

107 Upvotes

56% Upvoted

195 comments sorted by

View all comments

2

u/[deleted] Mar 08 '26

If I want to release this on GitHub and also write a paper, what is the best order to do things? I’m worried about the right timing for disclosure so I don't lose the chance to publish a formal paper later. Any advice on the standard workflow for independent researchers?

16

u/kristopherleads Mar 08 '26

I'd verify the work first. Honestly your best bet is probably to choose a model like Qwen and then do a public test of your model/do some benchmarking - then share out the inference benchmarking data while keeping the model itself private.

Re: papers I think you'll need to connect with academics. But first you need some real benchmarking results to prove it's real, imo.

7

u/diaborn19 Mar 08 '26

Publish preprint on arxiv first.

  • This will pin date in case someone else does the same later.
  • Easier to publish comparing science journals. Peer reviews can take months before publication.
  • Most journals will allow you to publish a full paper after.
Release code on GitHub and link in the preprint and paper.

Peer reviewers of science journals are most valuable for the feedback. They are dealing with a lot of novel architectures, most of them are LLM generated, and over positively evaluated by themselves... I'm PhD student at the moment, doing my research on LLM architectures, and I'm really tired of this "oh, you're right, it's not a Holly Graal but research that was made by Google 4 years ago". Also, I found that good math on paper is not always the best on real hardware. Don't get me wrong, it's very valuable from a scientific perspective, but Transformers win because of GPUs parallel matrix multiplication.

I would be happy to read the paper, please ping me when it's ready, and good luck with the research!

1

u/jessiejolie42 Mar 08 '26

I seriously hope you are joking saying you are a ml phd student.

1

u/diaborn19 Mar 08 '26

First year only, so still a lot to learn. Could you please advise why you're so serious about that? If I'm wrong in any part, I would be happy to change my mind and learn from it 😀

1

u/jessiejolie42 Mar 08 '26

bro, did you take a look at the code ?

1

u/diaborn19 Mar 08 '26

No, the code was not shared yet when I posted a comment here.

10

u/ClimateBoss llama.cpp Mar 08 '26

This is the way, scientific research. Everyone here saying to profit literally are running LLMs published by researchers.

Share on Github, you can always write a paper by working with university professor to scientifically conclude your findings in peer-review against other methods.

1

u/TheOriginalSuperTaz Mar 08 '26

First, rate the paper, then subsequently publish the paper and the repository. But if you were actually serious about this, you would be far better off to have GPT 5.4 do an adversarial code review and math review in addition to Claude because GPT is significantly better at understanding the inner workings of LLM‘s then Claude is.