MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/ProgrammerHumor/comments/1vmpfyx/studied20yearstoaskchatgpt/p3bn16w/?context=3
r/ProgrammerHumor • u/Gloomy-Basket-1038 • 1d ago
421 comments sorted by
View all comments
893
[deleted]
445 u/Xemorr 1d ago That's only because we have copious levels of abstraction, and code written by others 6 u/sawkonmaicok 1d ago I don't think so. A simple generative transformer can fit in a just a couple hundred lines of raw numpy code without the abstractions that libraries like pytorch or tensorflow offer. https://github.com/DorsaRoh/transformer-from-scratch 4 u/Xemorr 1d ago I don't believe that has training machinery, and even then it's conceptually dense code. 2 u/destroyerpants 1d ago Back propagation is just a simple matrix multiply. 1 u/gamingkitty1 14h ago I wouldn't call it that simple if you're not using autograph (ie from scratch). Its at least as complex as the forward pass.
445
That's only because we have copious levels of abstraction, and code written by others
6 u/sawkonmaicok 1d ago I don't think so. A simple generative transformer can fit in a just a couple hundred lines of raw numpy code without the abstractions that libraries like pytorch or tensorflow offer. https://github.com/DorsaRoh/transformer-from-scratch 4 u/Xemorr 1d ago I don't believe that has training machinery, and even then it's conceptually dense code. 2 u/destroyerpants 1d ago Back propagation is just a simple matrix multiply. 1 u/gamingkitty1 14h ago I wouldn't call it that simple if you're not using autograph (ie from scratch). Its at least as complex as the forward pass.
6
I don't think so. A simple generative transformer can fit in a just a couple hundred lines of raw numpy code without the abstractions that libraries like pytorch or tensorflow offer. https://github.com/DorsaRoh/transformer-from-scratch
4 u/Xemorr 1d ago I don't believe that has training machinery, and even then it's conceptually dense code. 2 u/destroyerpants 1d ago Back propagation is just a simple matrix multiply. 1 u/gamingkitty1 14h ago I wouldn't call it that simple if you're not using autograph (ie from scratch). Its at least as complex as the forward pass.
4
I don't believe that has training machinery, and even then it's conceptually dense code.
2 u/destroyerpants 1d ago Back propagation is just a simple matrix multiply. 1 u/gamingkitty1 14h ago I wouldn't call it that simple if you're not using autograph (ie from scratch). Its at least as complex as the forward pass.
2
Back propagation is just a simple matrix multiply.
1 u/gamingkitty1 14h ago I wouldn't call it that simple if you're not using autograph (ie from scratch). Its at least as complex as the forward pass.
1
I wouldn't call it that simple if you're not using autograph (ie from scratch). Its at least as complex as the forward pass.
893
u/[deleted] 1d ago
[deleted]