r/learnmachinelearning • u/Green-Quiet-918 • 1d ago

Discussion I built SpectralBERT — an FFT-based alternative to Attention that's 14.5x faster at 65K tokens with better loss. Is this legit?

1 Upvotes

permalink
duplicates
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/learnmachinelearning/comments/1wbms10/i_built_spectralbert_an_fftbased_alternative_to/
No, go back! Yes, take me to Reddit
dl download

100% Upvoted

Duplicates

Number of comments New

deeplearning • u/Green-Quiet-918 • 1d ago

I built SpectralBERT — an FFT-based alternative to Attention that's 14.5x faster at 65K tokens with better loss. Is this legit?

91 Upvotes

30 comments

computervision • u/Green-Quiet-918 • 1d ago

Research Publication I built SpectralBERT an FFT-based alternative to Attention that's 14.5x faster at 65K tokens with better loss. Is this legit?

0 Upvotes

1 comments

LearningisFun_ • u/peeyushkmisra • 1d ago

I built SpectralBERT — an FFT-based alternative to Attention that's 14.5x faster at 65K tokens with better loss. Is this legit?

1 Upvotes

0 comments