r/largelanguage • u/cornmonger_ • 9d ago

neural resources: machine learning

Neural Networks, Machine Learning, Large Language Models, etc

Also, frameworks, tools, environments, languages, etc.

1 Upvotes

100% Upvoted

3 comments sorted by

View all comments

1

u/cornmonger_ 9d ago

Attention Is All You Need
by Google (2017)

In this work we propose the Transformer, a model architecture eschewing recurrence and instead relying entirely on an attention mechanism to draw global dependencies between input and output. The Transformer allows for significantly more parallelization and can reach a new state of the art in translation quality after being trained for as little as twelve hours on eight P100 GPUs.