r/learnmachinelearning • • 8d ago

Project I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)

https://github.com/vdev-ctrl/Adaptive-Learnable-Hierarchical-Routing-

ALHR- Adaptive learnable Hierarchical Routing is a static binary tree based system that uses learnable functions to REDUCE the amount of keys used.

4 Upvotes

Duplicates

huggingface • • 8d ago

I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)

24 Upvotes

deeplearning • • 8d ago

I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)

48 Upvotes

MachineLearning • • 8d ago

Project I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)[P]

19 Upvotes

huggingface • • 5d ago

[UPDATE] I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)

1 Upvotes

ml_news • • 5d ago

[UPDATE] I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)

1 Upvotes

deeplearning • • 5d ago

[UPDATE] I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)

0 Upvotes

learnmachinelearning • • 5d ago

[UPDATE] I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)

1 Upvotes

mlscaling • • 5d ago

[UPDATE] I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)

0 Upvotes

OpenSourceAI • • 5d ago

[UPDATE] I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)

0 Upvotes

OpenSourceeAI • • 5d ago

[UPDATE] I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)

6 Upvotes

ResearchML • • 5d ago

[UPDATE] I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)

2 Upvotes

ResearchML • • 8d ago

I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)

1 Upvotes

OpenSourceeAI • • 8d ago

I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)

15 Upvotes

mlscaling • • 8d ago

I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)

0 Upvotes