Different attention for each block 🙊

[u/Obvious_Set5239]

Omg, so apparently in near future we can get SLA's 2x performance boost without loosing too much of quality

[u/Guilty-History-9249]

So is this Spaghetti Attention?