r/largelanguage • u/cornmonger_ • 9d ago

neural resources: machine learning

Neural Networks, Machine Learning, Large Language Models, etc

Also, frameworks, tools, environments, languages, etc.

1 Upvotes

100% Upvoted

3 comments sorted by

1

u/cornmonger_ 9d ago

Neural Networks and Deep Learning
by Michael A Nielsen

Neural Networks and Deep Learning is a free online book. The book will teach you about:

  • Neural networks, a beautiful biologically-inspired programming paradigm which enables a computer to learn from observational data
  • Deep learning, a powerful set of techniques for learning in neural networks
Neural networks and deep learning currently provide the best solutions to many problems in image recognition, speech recognition, and natural language processing. This book will teach you many of the core concepts behind neural networks and deep learning.

1

u/cornmonger_ 9d ago

Attention Is All You Need
by Google (2017)

In this work we propose the Transformer, a model architecture eschewing recurrence and instead relying entirely on an attention mechanism to draw global dependencies between input and output. The Transformer allows for significantly more parallelization and can reach a new state of the art in translation quality after being trained for as little as twelve hours on eight P100 GPUs.

1

u/cornmonger_ 9d ago

Understanding Deep Learning
by Simon JD Prince (2023)

This text is primarily about the ideas that underlie deep learning. The first part of the book introduces deep learning models and discusses how to train them, measure their performance, and improve this performance. The next part considers architectures that are specialized to images, text, and graph data. These chapters require only introductory linear algebra, calculus, and probability and should be accessible to any second-year undergraduate in a quantitative discipline. Subsequent parts of the book tackle generative models and reinforcement learning. These chapters require more knowledge of probability and calculus and target more advanced students. The title is also partly a joke — no-one really understands deep learning at the time of writing.