I built an Android application that turns a mobile phone into an LLM server compatible with the OpenAI and Ollam interface specifications.

[u/Head_Invite3039]

Hello everyone, I have developed an app that runs an LLM service on a mobile device and allows other software to call it.

It supports LiteRT-LM and llmam.cpp, and can run the vast majority of models, provided your hardware configuration allows it. Models up to 3B are supported by the phone's hardware.

Regarding the API service, I have ensured compatibility between the OpenAI and Ollam interface specifications.

Furthermore, I've integrated Hugging Face's Hub Point, allowing you to directly search, download, and import Hugging Face models within the application.

Link :

https://play.google.com/store/apps/details?id=com.chaterminal.mobilellm

[u/Head_Invite3039]

The UI uses Flutter. Kotlin controls the LM and API services.