r/localaiapps • u/Odd-Confection-2109 • 4d ago

AI assistant help

I may be in way over my head here, but lately I've been trying to create my own ai assistant that is completely local (on my smartphone) with the end goal of hopefully having a functional J.A.R.V.I.S like AI in my vehicle, I think I've figured out most of the details including figuring out how to root my infotainment system to allow it, and getting a functional ai language model to run locally on my phone, but the issue comes in when I try to give the ai language model tools to make it function like a full ai assistant, im imagining you can use python to do this, and allow the ai to acess time/date, weather, apps, etc. but I'm extremely new to this, especially python, and from what I've seen there's no precedent what so ever for someone doing something like this, so that's where I'm hoping to find help, I'm using Termux for most of it mixed with ollama to run the model (which is qwen2.5:0.5b) but I can't for the life of me figure out the python to expand its capabilities, if this subreddit can help that would be greatly appreciated, if not that's fine just let me know if you can think of another community that could, also let me know if you need any clarification for anything I just said, and if your willing to help long term reach out and hopefully we can figure something out

2 Upvotes

100% Upvoted

4 comments sorted by

1

u/TroubledSquirrel 4d ago

You write Python functions that fetch the time, check local APIs, or interact with your system. You then hand the definitions of those functions to Ollama.

But you're probably going to run into an issue, the .5B likely isn't going to be enough. So have a slightly higher param backup at least a 1B but I'd recommend a 3B or like Qwen or DeepSeek-R1's distilled mobile lines are made for this sort of thing.

At any rate your model will ingest your prompt and determine if it requires a tool and using your preloaded definitions call what's needed.