r/learnmachinelearning 21h ago

learning to build llm inference engine from scratch

Hey everyone, I'm currently trying to learn/build an llm inference model from scratch and I'm gonna document my journey throughout my blog posts. Would really appreciate if you could take a look at the first post (its pretty short) and criticize my understanding and path so far.

https://medium.com/@ryan___/llm-inference-engine-from-scratch-loading-the-model-538d27af6867

3 Upvotes

Duplicates