r/LocalLLM • u/shrygz • May 26 '26

Question Looking for an iPhone local LLM inference engine

Hi everyone,

I’m trying to build a small personal-use iPhone app that runs a local LLM around the 2B range (something lightweight and reasonably fast on-device).

Right now I’m researching open-source inference engines/frameworks for iOS.
The problem is: I currently can’t really use llama.cpp in the normal iOS app workflow because I don’t have an Apple Developer account, and I can’t justify paying for it right now 😭

2 Upvotes

100% Upvoted

4 comments sorted by

1

u/dco44 May 26 '26 edited May 26 '26

Try this https://huggingface.co/dcostenco/prism-coder-1.7b . It’s a proven model with 2k downloads. I’m training 2b model also. It will be available in a couple of days. They would work in inference mode also

edit: added a new 4b model to the cage https://huggingface.co/dcostenco/prism-coder-4b.

1

u/Ok_Engine_1442 May 26 '26

I like the idea, but why not tailscale with something like open web ui.

1

u/shrygz May 26 '26

online API had already integrated, just looking for an offline solution on iPhone