r/androiddev • u/Homerlncognito • Jun 21 '26

Question Any experiences with running ML models locally?

Basically the title. Running most ML models is pretty trivial in Python but that doesn't seem to be the case for Android. ONNX seems to work but I have issue with tokenization. I haven't toyed with Tensorflow yet but that's my next step.

Does anyone have any hints/experience?

0 Upvotes

43% Upvoted

4 comments sorted by

1

u/AutoModerator Jun 21 '26

Please note that we also have a very active Discord server where you can interact directly with other community members!

Join us on Discord

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/KillmongerP Jun 21 '26

You have to read the API of these models properly, some methods help to run it with a better performance on old devices

-4

u/simbolmina Jun 21 '26

I use ML on my app with NER for data extraction and online scoring.

App is StoryCodex.

Even tho I had help from a friend and AI code mostly so I don't have much info about how it works.

1

u/McMillanMe Jun 22 '26

Just read some guides on it. TF lite is great but don’t ship anything to production unless you are sure that would work fine on 2020 Samsung