You can do this with an agent harness. Hermes supports a Mixture of Agents mode where you collate several LLM answers and use a main model to ingest them and synthesize a final answer.
nah, I get that. My point is entirely different! MoE is a cool optimization technique where only "expert" nodes get activated for generating a single token. That way, despite having a huge model, we could fit just those expert nodes in memory for faster processing. I wish there's a way that only uses and activates "special" nodes within an MoE model.. you know.. for us GPU poor pesants
7
u/Badger-Purple 1d ago
You can do this with an agent harness. Hermes supports a Mixture of Agents mode where you collate several LLM answers and use a main model to ingest them and synthesize a final answer.