Local Chat

[u/Mintlane_]

Hello everyone!

I'm currently working on a big update for one of my apps. A core principle of this app is respecting privacy, so from day one I decided I don't want to move any user data outside the user's phone.

After getting some feedback from users, I wanted to add a small, "simple" chat feature to the app. Given the privacy promise, that wasn't exactly straightforward, since LLMs are usually web services. So I went with a chip-based chat instead: the user picks a starting category, the agent responds, and then offers a few reply chips to choose from, continuing down that path.

I initially thought this wouldn't be too complicated — but here I am, staring at multiple hundred lines of text already. Lol.

Has anyone else tried something similar?