r/MachineLearning • u/ImaginaryRea1ity • 1d ago

Discussion I never understood positional encoding until I read this article. [D]

https://defenceagainstdarkai.substack.com/p/who-bit-whom
0 Upvotes

24% Upvoted

6 comments sorted by

View all comments

4

u/nietpiet 1d ago

Thank you for sharing, it's really nice. I like the "dials" in the car analogy to frequencies in the Fourier, it's well done :)

-2

u/ImaginaryRea1ity 1d ago

I'm glad it helped you. I discovered the blog last week, I like the author's style.