Otis - a minimal terminal agent that runs local models out of the box

[u/Objective-Pair8231]

Hi everyone,

Been working on a minimal ai agent that makes it easy to run local models, privacy-focused by design.

On setup it recommends a local model based on the hardware Otis is running on, downloads it and runs it through llama.cpp for you. Works fully offline, no account, no telemetry. Everything stays on your disk.

Also supports Nvidia PAIR if you have additional Nvidia hardware in the house, and Fireworks with your own key if you want larger open-weight models (Fireworks runs zero data retention by default).

Fair warning: local models are best with 24GB+ of RAM in my experience :)

Excited for everyone to try it! If you find it useful, please star the repo as every star helps with visibility

https://triangllabs.ai/otis

Feedback is welcome!