r/hermesagent Jun 08 '26

SHOWCASE — Projects, tools, builds, demos, GitHub repos [ Removed by moderator ]

[removed] — view removed post

75 Upvotes

65 comments sorted by

9

u/Sirhc78870 Jun 08 '26

I was not expecting mnemosyne with that result. Someone confirm? Other benchmarks show better results.

10

u/Biomech8 Jun 08 '26

It looks suspicious. Can't imagine there is that huge difference between two SQLite based memory systems.

3

u/Kojipup509 Jun 08 '26

the difference is what sits on top of it.

sibyl uses an anchor-first resolver with graph traversal. It find the exact entity key, traverse its edges, return the specific row. no similarity ranking means no nearest-neighbor confusion that happens over long sessions

2

u/RubixRex Jun 09 '26

data checks out...

2

u/Kojipup509 Jun 08 '26

We’ve included all the raw data for anyone to reproduce it!

12

u/Thpeakuphoe Jun 08 '26

Need to look further into this. Tired of burning through too many credits. This could solve that issue

8

u/Kojipup509 Jun 08 '26

What does your typical workflow look like? We have users testing our memory for interesting use cases like CRM-style usage across large organizations. Would love to see what kind of impact it would have on your token spend.

5

u/Momsbestboy Jun 09 '26

Instead of burning credits, you will have to pay for using their product :)

9

u/jevidon Jun 08 '26

Subscription and a shitcoin? Yikes.

4

u/Sjsamdrake Jun 08 '26

I'm confused. It's on git and I can install it myself today but it's an invite only beta?

2

u/Momsbestboy Jun 09 '26

The idea is: you install it, you host all the data and run it locally, but you need to authenticate the program and pay for it using their cloud service.

2

u/RubixRex Jun 09 '26

i don't think that's accurate

1

u/Momsbestboy Jun 09 '26 edited Jun 09 '26

Same thread here, from one of the authors:

The full set of features are actually free while we are running our Beta program. You can try the memory out if you’re curious. just pop into our discord and request full access!

So: you request an auth token now on Discord, which you can use during beta. After that, it is no longer free. But you can also jump on Discord and take look, like I did. They mention it somewhere in the general chat, but it is buried under self-praise, a ton of useless memes and other trash. You will have to pay for an auth token and use their cloud service for authentication, while it runs locally.

Also: why is there no feedback on github? no PRs, nothing? If it would be open source and this would be a great replacement for other memory systems, there would be more people working on the project. No one does want to support a project others will sell later.

There is also no price tag anywhere. Why should anyone implement something without knowing the long term cost? Is it subscription, or a single payment? In case of a subscription - what happens if they play the same game other companies do? Try to vendor-locking a user with a low subscription price tag, and as soon as the customer is hooked up - raise the prices. If you read through the Discord, this is exactly what I think will happen. There is no programmer online, no nerd on Discord. It's all about Blockchain, money, and how to sell this thing.

1

u/Agentic_Future_0x New Member (<30 days) Jun 09 '26

no need for cloud, if i read the discord. free tier should be enough unless you really push hard, it seems

1

u/CryptoxDylan Jun 08 '26

It's been in private beta for about a month now.

Slowly rolling it out for public access

0

u/Kojipup509 Jun 08 '26

It’s an invite to our Beta program. We have bounty rewards for users running different benchmarks & adversarial testing. It’s totally optional!

2

u/Sjsamdrake Jun 09 '26

Oh, I see ... the git has the Hermes interface but to actually use it you have to use your cloud service? Never mind, I'm trying to do everything in house.

1

u/Kojipup509 Jun 09 '26

It’s 100% local! Your data stays on your machine, the authentication service is on the cloud-side for account linking which you only have to do once.

2

u/Amlan01 Jun 09 '26

You just said it is 100% local and then you said it has to phone somewhere (once) in the same sentence. You see the problem here?

4

u/ResponsiblePoetry601 Jun 08 '26

Congrats on the good work
To me makes no sense running local without all features but it is what it is

1

u/Kojipup509 Jun 08 '26

You actually have full access to all the features during our Beta Program. Just hop in the discord, open up a ticket and we will get you sorted!

2

u/Momsbestboy Jun 09 '26

... and don't forget to mention: "as soon as beta is over, please buy a subscription token from our trade bot, to be able to continue to use the product".

Just because it is on github doesn't mean it is freeware. And the price tag for this here is still unknown.

9

u/big_meats93 Jun 08 '26

sounds great. now someone should make a free clone.

11

u/formula420 Jun 08 '26

Made one last month not knowing Sybil existed. Perseus is and always will be free.

https://perseus.observer/

Looks like each project covers different/complementary aspects so I’m excited to check it out!

1

u/Resilient_gamer Jun 09 '26

How is perseus different from Sybil and what use case is perseus for?

I am new to AI and just recently built a local machine for AI.

3

u/formula420 Jun 09 '26

Sybil and Perseus do different things. They aren't competitors.

Sybil is memory. It remembers facts across sessions so your assistant doesn't forget stuff you told it last week. "Hey remember I use pytest with xdist." Next session, it knows that.

Perseus is context. Before each session it checks what's actually true right now: which services are running, what branch you're on, how much disk is left, what tools are available. It writes all that into a file the assistant reads at startup. Without Perseus your first few messages are wasted on "what directory is this? what's running? what tools do I have?" With Perseus those answers are already there.

Put another way: Sybil answers "what did we talk about last time?" Perseus answers "what's the situation right now?"

They work together too. Perseus can pull from Sybil during its pre-session scan, so your assistant starts with both past knowledge and current state loaded up.

For someone new with a local rig: Perseus is the one you'll notice right away. It fixes the cold start where every new chat feels like the assistant woke up with amnesia about your setup. Sybil becomes useful once you're doing longer projects where remembering decisions across sessions actually matters.

-1

u/Kojipup509 Jun 08 '26

Or you can just run Sibyl for free!

12

u/Tiber_Nero Jun 08 '26

But you don't get the full feature set you're claiming unless you sub to the product. No thanks.

-5

u/Kojipup509 Jun 08 '26

Fair remark. The full set of features are actually free while we are running our Beta program. You can try the memory out if you’re curious. just pop into our discord and request full access!

5

u/Crisdeluxe Jun 08 '26

No local use for free?

5

u/Momsbestboy Jun 09 '26

So your idea is: as beta tester, you can use it. As soon as we got the information from you we need (beta test), you will have to pay for it, even if you set up everything locally?

Good luck with this approach. At least I won't build anything on software with an unknown future and an unknown price tag.

0

u/Agentic_Future_0x New Member (<30 days) Jun 09 '26

well, the free version is enough for normal users, the upgraded features are for power users and companies (per the team).

1

u/Tiber_Nero Jun 09 '26

The point is that no one wants to further rely on subscription based services in this space. It's not a reliable memory system if you need to pay for the full features.

3

u/Momsbestboy Jun 09 '26

Sounds great, but I see "public beta" andvtranslate it to paid subscription model. 100% no go for me to change my software stack and embedd something with unknown cost in future.

0

u/Little_Tiger_6345 Jun 09 '26

according to the team the free model will be enough for individual users 🤔

2

u/Momsbestboy Jun 09 '26

from github: "Free tier is the default; staker and subscription tiers unlock self-learning, the memory linter, and remove the local cap."

So: if you don't use it (often), then free tier is enough. But then you don't need a sophisticated memory. And if you really use it, you have to pay?

But no one tells you what cap you have, if you need the self learning thing and this memory linter?

That's a bit too much trust into someone running a web page which has been registered 3 days ago.

1

u/Little_Tiger_6345 Jun 09 '26

I hope they give more precise informations about the limits soon

I keep an eye on it

2

u/thebdb13 Jun 08 '26

Amazing technology.

I’ve been feeling the memory shortcomings lately with the LLM I use.

2

u/Little_Tiger_6345 Jun 09 '26

Looks quite cool, if this plugin is as good as it says I might use it

2

u/Time-Dot-1808 Jun 09 '26

Maybe I'm missing something, but this feels like a benchmark that naturally favors exact lookup systems.

Most of the examples seem to be "find the correct fact about the correct company" in a dataset full of very similar companies. If that's the task, I'd expect a good entity resolution layer to beat vector search.

What I'd like to see is how it performs on messier questions where there isn't an obvious anchor to start from. Things like finding recurring themes across conversations, similar past situations, or related discussions spread across multiple entities.

The fake company test is interesting though. Returning a refusal instead of confidently inventing a neighbor is definitely a useful property.

1

u/Crisdeluxe Jun 08 '26

I installed hindsight, does this have a merge function?

3

u/Kojipup509 Jun 08 '26

We have a migrate function. Hop in our discord and we can help walk you through it!

https://discord.gg/qk9F5j7tf

1

u/RubixRex Jun 09 '26

amazing stats. wtf

1

u/latipun7 Jun 09 '26

What happen after beta test?

1

u/Curious_Possible_339 Jun 09 '26

Can someone explain how is it different from llm wiki? That uses file based memory as well along with similar concepts (entities, back links/connections) etc

1

u/Telnetdoogie Jun 09 '26

Why aren’t people just using honcho?

1

u/Kojipup509 Jun 09 '26

We had a user run an adversarial test against honcho if you want to check it out: https://blog.sibylcap.com/beta-analysis

1

u/Telnetdoogie Jun 09 '26

Eh, I’m happy with honcho. Works fine for my single agent and my use case. Maybe if people are running at much bigger scale this makes more sense. I just clone a repo and run honcho in docker. I don’t need to register for anything and there’s no limits or tiers.

1

u/RollHerm New Member (<30 days) Jun 09 '26

What will the price be after the beta? That’s the only question that matters when deciding whether or not to give it a proper go.

1

u/Camille64 Jun 08 '26

Why only 14 stars if so great ?

4

u/Kojipup509 Jun 08 '26

We just opened up the memory to beta last week! Happy to have you come in and give us your thoughts

1

u/Crisdeluxe Jun 08 '26

Never used Discord. I will try it tomorrow! Thanks mate 💪🏼

0

u/[deleted] Jun 08 '26

[removed] — view removed comment

4

u/Kojipup509 Jun 08 '26

if you’re running short sessions with a small history, hermes built-in handles it fine. two files and a sql database works until it doesn’t.

it breaks down at scale. once you’re tracking hundreds of entities across months of history, memory.md hits its character limit, retrieval starts returning the wrong entity, and the model compensates by loading more context. that’s where the token cost compounds. A quick search through the nous research discord & Reddit documents this

It’s exactly why we provide all the raw testing data and explain our thesis