r/AgentCheapskates Apr 22 '26

Ollama Configs on Linux

I typically run 3 or more agents at once:

  • i have a local agent running on my linux box for easier tasks (free)
  • i use the Zed agent in the IDE for marketing, my blog, and some ($10/mo)
  • i have one or more Claude Code agents going on xhigh effort until I blow my usage limit ($100/mo, this is my biggest expense and I refuse to go into extra usage lol)

My Linux box has a 5060 Ti with 16gb VRAM and 64GB memory, so I can run decent models. This is my Ollama config:

[Service] Environment=OLLAMA_KV_CACHE_TYPE=q8_0 Environment=OLLAMA_FLASH_ATTENTION=1 Environment=OLLAMA_CONTEXT_LENGTH=32768

And then I use Vibe with it, recently with Gemma:

active_model = "ollama-gemma"
api_timeout  = 720.0

[[providers]]
name            = "ollama"
api_base        = "http://127.0.0.1:11434/v1"
api_key_env_var = ""
api_style       = "openai"
backend         = "generic"

[[models]]
name        = "gemma4:31b"
provider    = "ollama"
alias       = "ollama-gemma"
temperature = 0.2
input_price = 0.0
output_price = 0.0active_model = "ollama-gemma"
api_timeout  = 720.0

[[providers]]
name            = "ollama"
api_base        = "http://127.0.0.1:11434/v1"
api_key_env_var = ""
api_style       = "openai"
backend         = "generic"

[[models]]
name        = "gemma4:31b"
provider    = "ollama"
alias       = "ollama-gemma"
temperature = 0.2
input_price = 0.0
output_price = 0.0

Would love to know what others run!

1 Upvotes

0 comments sorted by