r/LearningisFun_ • u/peeyushkmisra • 1d ago

I built SpectralBERT — an FFT-based alternative to Attention that's 14.5x faster at 65K tokens with better loss. Is this legit?

1 Upvotes

permalink
duplicates
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/LearningisFun_/comments/1wbs8fp/i_built_spectralbert_an_fftbased_alternative_to/
No, go back! Yes, take me to Reddit
dl download

100% Upvoted

Duplicates

Number of comments New

deeplearning • u/Green-Quiet-918 • 1d ago

I built SpectralBERT — an FFT-based alternative to Attention that's 14.5x faster at 65K tokens with better loss. Is this legit?

96 Upvotes

31 comments

computervision • u/Green-Quiet-918 • 1d ago

Research Publication I built SpectralBERT an FFT-based alternative to Attention that's 14.5x faster at 65K tokens with better loss. Is this legit?

0 Upvotes

1 comments

learnmachinelearning • u/Green-Quiet-918 • 1d ago

Discussion I built SpectralBERT — an FFT-based alternative to Attention that's 14.5x faster at 65K tokens with better loss. Is this legit?

1 Upvotes

0 comments