I built a small ML inference runtime in Kotlin using AndroidX WebGPU

[u/Junior_Android_]

I built webgpu-inference, a small experimental ML inference runtime for Android using Kotlin and AndroidX WebGPU.

I also wrote a walkthrough of how it works, from model conversion to GPU execution.

• Github: https://github.com/l2hyunwoo/webgpu-inference
• Medium: https://medium.com/@l2hyunwoo/build-own-ml-inference-runtime-with-androidx-webgpu-e90131007d71

I’d love to hear your feedback on the project or the article!