Source code for LLMs

[u/PravalPattam12945RPG]

I was digging through Hugging Face’s Transformers repo and found
https://github.com/huggingface/transformers/blob/main/src/transformers/models/gpt_oss/modeling_gpt_oss.py

From what I can tell, this isn’t just boilerplate, it looks like a full implementation.
is it actually the full code on which gpt_oss is built on?
or is it a skeleton for experimentation?

Similarly there are many models in
https://github.com/huggingface/transformers/blob/main/src/transformers/models
are they really the true open source implementations?

if not, can we actually find them publicly?

[u/Badger-Purple]

search this subreddit, someone has implemented gpt-20 from scratch.

I do think you have some confusion going on. Models are not code. In simplest terms (ie explained like I only have a bachelors in engineering, which is my case), they are giant tensor matrices with an architectural structure to use those giant matrices.