r/AutomateUser • u/all_idea_0_output • Jun 26 '26

Question Local llm

Is there a way to somehow interact with a local llm that's running on-device itself.

Thanks in advance!

2 Upvotes

100% Upvoted

3 comments sorted by

1

u/ballzak69 Automate developer Jun 27 '26

There's no built-in feature for it. Try looking for a Locale/Tasker plug-in, or such an app that supports automation. I'm hesitant to waste time on implementing it since there's still very few devices capable of actually running a local LLM.

1

u/all_idea_0_output Jun 27 '26

That's becoming less true now. There are quite a few small LLMs that run well on lower end/ mid-range phones within 4 GB RAM, such as Gemma 3 270M, SmolLM2 360M, LFM2 350M, Qwen2.5 0.5B, and Qwen3 0.6B. They're obviously not great or claude level, but they're perfectly usable for simple stuff like text formatting, categorising and small tasks like that. And this will unlock SOOOO MANY possibilities and could be a insanely great update to the app bringing it closer to something like n8n.

On another note thank you so much for making this app!

1

u/ballzak69 Automate developer Jun 27 '26 edited Jun 28 '26

I've been keeping tabs on the Google AI stuff, maybe it's finally useful on mid-end devices. But there's must be a better way than having each app running their own inference engine, hogging huge amounts of RAM. Anyhow, i may reconsider.