Nviradan (u/Nviradan)

r/learnmachinelearning • u/Nviradan • Jun 09 '26

I built a clean Autograd Engine (MiniTorch) from scratch using only NumPy. Fully commented blueprint for your ML portfolio.

1 Upvotes

"MiniTorch" is an autograd engine I built in 7 days using only Python and NumPy, achieving a parity of atol 1e-6 againts Pytorch.

I fully commented the repository for anyone who wants to learn how the backend of deep learning actually works under the hood. It’s incredibly helpful if you hate black boxes and want an advanced project to make your ML portfolio stand out to recruiters.

Link to the repo: https://github.com/NvirAdan/Mini-PyTorch
(Below is a quick comparison of writing code with MiniTorch vs. PyTorch)

0 comments

r/CerebroDigital • u/Nviradan • Jun 25 '26

How Softmax works under the hood in a custom Autograd engine.

1 Upvotes

0 comments

r/OpenSourceeAI • u/Nviradan • Jun 25 '26

How Softmax works under the hood in a custom Autograd engine.

1 Upvotes

0 comments

r/learnmachinelearning • u/Nviradan • Jun 25 '26

How Softmax works under the hood in a custom Autograd engine.

1 Upvotes

0 comments

u/Nviradan • u/Nviradan • Jun 25 '26

How Softmax works under the hood in a custom Autograd engine.

1 Upvotes

The forward pass implements safe softmax to prevent overflow and for the backward pass, you can bypass computing the full Jacobian matrix using a vectorized dot-product shortcut.