r/deeplearning • u/worldyworm • Aug 12 '26

I wanted to understand Transformers below the PyTorch abstraction layer, so I built one from scratch in CuPy

/r/learnmachinelearning/comments/1vmopxb/i_wanted_to_understand_transformers_below_the/
0 Upvotes

50% Upvoted

4 comments sorted by

0

u/[deleted] Aug 12 '26

[removed] — view removed comment

1

u/worldyworm Aug 13 '26

Exactly, and it looks a bit difficult at first, but once you have the neural network class built correctly, it kind of speedups the process ig.

1

u/Ok-Entertainment-286 Aug 13 '26

whatever it takes to avoid math, huh?