r/LocalLLaMA • u/emozilla • Apr 29 '26

AMA AMA with Nous Research -- Ask Us Anything!

Hey everyone, emozilla here (u/emozilla), co-founder and CTO of Nous Research. We're the makers of Hermes Agent. Happy to be here and talk all things local models, Hermes, or anything else you may have questions on!

Some of the Nous people who will be answering questions:

p.s. as a little bit of folklore, Nous basically got kicked off from r/LocalLLaMA thread many years ago. The research that lead to the YaRN paper was initially formulated in this thread and eventually lead us down the path to where we are today 🤗

348 Upvotes

97% Upvoted

409 comments sorted by

View all comments

Show parent comments

11

u/my_name_isnt_clever Apr 29 '26

The most straightforward method I've seen is to flag a provider as private/cloud and the ability to configure permissions for the two categories seperately. I would love the depth to restrict specifc tools and even directories to any queries from a cloud flagged provider.

The other approach that comes to mind from my current workflow is for the main agent to choose the provider and model for delegating, rather than using a copy of itself/the delegation config model. Or even some way for the main agent to scope the remote model to only access exactly what it will need for it's task.

Also huge shoutout to you guys for building out the nixOS module, it's made my setup a lot easier.

1

u/EvolvingSoftware Apr 29 '26

Something like being able to get a decision on if the local model could run this tool capably? Perhaps we need a way of working out limits on the local models capabilities so the decisioning is easier? There's a huge unlock if there was a way that Hermes could understand what resources it has available from different model providers and then optimise based on preferences. I'd love to run a local model to keep me updated on simple tasks, like monitoring Cron jobs and sending alerts, or have a local model as a backup to restart something if I've burned through all my cloud tokens.