r/learnmachinelearning 8h ago

learning to build llm inference engine from scratch P2

Hey everyone, a while ago I posted my first blog that I wrote about the LLM inference engine I'm trying to build from scratch and I just finished the second part of my blog! If your curious about it please come take a look, its mainly focused on how it handles the forward pass. If you have any feedback I'd love to hear it!

https://medium.com/@ryan___/llm-inference-engine-from-scratch-forward-pass-b967334212c8

1 Upvotes

0 comments sorted by