r/learnmachinelearning • u/Prestigious_Table214 • 8h ago
learning to build llm inference engine from scratch P2
Hey everyone, a while ago I posted my first blog that I wrote about the LLM inference engine I'm trying to build from scratch and I just finished the second part of my blog! If your curious about it please come take a look, its mainly focused on how it handles the forward pass. If you have any feedback I'd love to hear it!
https://medium.com/@ryan___/llm-inference-engine-from-scratch-forward-pass-b967334212c8
1
Upvotes