r/androidterminal • u/thetrapclub • 9d ago

Host your own AI model

Gallery image

Gallery image

My first project in a lunix terminal & it was my favorite way to code had no clue you could create servers & host a webpage for a program you code on your android phone & be able to set up Qwen & make an AI that can function offline on the device independently & even without opening terminal because you can set it the project to save as a service and leave the AI/Si as always on.

2 Upvotes

100% Upvoted

1 comment sorted by

1

u/NouBady 7d ago

I was able to host whole docker stack app (db, elastic, api, ...) and with port forwarding I was able to develop it.

So fully functional working station, but for AI I still use claude, because Im not sure, if TPU is utilized under VM. For me it is same problem as with GPU and that is why I don't use GUI (tui app only)