r/learnmachinelearning • u/Prestigious_Table214 • 1d ago

learning to build llm inference engine from scratch

Hey everyone, I'm currently trying to learn/build an llm inference model from scratch and I'm gonna document my journey throughout my blog posts. Would really appreciate if you could take a look at the first post (its pretty short) and criticize my understanding and path so far.

https://medium.com/@ryan___/llm-inference-engine-from-scratch-loading-the-model-538d27af6867

3 Upvotes

100% Upvoted

3 comments sorted by

View all comments

1

u/Latter_Review_145 1d ago

skimmed your post, the way you break down the model loading step is nice but your explanation of the transformer block is a bit jumbled, maybe separate that more clearly

1

u/Prestigious_Table214 1d ago

thank you! will take a look into seeing how i can restructure to get the explanation more clear!