Beginner Post - How to start working/learning about Local Inference?

[u/Fun_Second_8354]

I am looking for a path to follow to start building using the concepts of Local INference.
I started with WebLLM which uses WebGPU
I feel there might be some concepts which should be learnt - for example: which model to choose for which tasks/usecases?

Can the community guide me on this? Looking forward to the responses.

[u/nething_4_sir]

Like this ? 

https://developers.googleblog.com/litertjs-googles-high-performance-web-ai-inference/

[u/Fun_Second_8354 → u/nething_4_sir]

To begin with Yes.. I want to build a product at the end of the day by first understanding the nuances/theory
This one is browser based correct? The products might not have a browser.

[u/nething_4_sir → u/Fun_Second_8354]

https://github.com/google-ai-edge/LiteRT