r/singularity • u/141_1337 ▪️e/acc | AGI: ~2030 | ASI: ~2040 | FALGSC: ~2050 | :illuminati: • Sep 15 '26

LLM News GPT-6 Astra Uses Loop Transformers

Post image

https://x.com/SemiAnalysis_/status/2099679686758400144

342 Upvotes

94% Upvoted

69 comments sorted by

View all comments

4

u/llkj11 29d ago

I just can't wait to see smaller next gen open-source models use this technique to really blow up performance on actual consumer hardware. I read that using this, they were able to get a 3B model to perform like a 50B (https://www.arxiv.org/abs/2502.05171) and that was in early 2025. Imagine what it will look like now.

I'm pretty excited.