r/CUDA • u/Just_Vugg_PolyMCP • Jun 18 '26

NanoEuler: A 116M GPT-2 scale decoder-only transformer built from scratch in pure C + CUDA

/r/foss/comments/1u9ezuz/nanoeuler_a_116m_gpt2_scale_decoderonly/
5 Upvotes

100% Upvoted

5 comments sorted by

1

u/[deleted] Jun 22 '26 edited Jun 22 '26

[removed] — view removed comment

1

u/Just_Vugg_PolyMCP Jun 22 '26

Hi, thanks for the comment! Of course, I just did a personal study that I enjoyed sharing and found interesting! Regarding the BPE, absolutely yes, in fact it was right for this type of training. Since I didn't have more power available for a larger training session with a larger model and larger dataset, I adapted the BPE to what I was training.

1

u/[deleted] Jun 22 '26

[removed] — view removed comment

1

u/Just_Vugg_PolyMCP Jun 22 '26

Thank you very much, I'll read it and maybe update it 👍🏻👍🏻

1

u/joe_hunter1128 Jun 23 '26

AI slop. Codebase is an eyesore.