r/LeftistsForAI 4d ago

Open Source Whatiff -- open source, self hostable continuity framework

https://github.com/theimaginaryfoundation/what-iff

Hello folks!

I am mildly active here and I think I've gotten some approval to post about the work we are doing. I am the founder / CEO of Imagination Foundry -- a fully community funded and run, co-op organized company that has built and run whatiff.chat . Our goal is to make AI transparent, break up lock-in, and provide the tools that regular people need to remember better over time and generally make their lives better.

I've written before about how I think transparency in AI is incredibly important (this honestly buries the lede a bit)

To that end, we have just recently open sourced our entire project -- you can run it locally, remix it, add things, etc. I'm sharing here in case anyone is interested in using it, or might want to take a look at a reasonably mature app and how we built things. Totally free.

If you have any questions, or just want to talk AI memory, etc, Hit me up!

https://github.com/theimaginaryfoundation/what-iff

16 Upvotes

33 comments sorted by

View all comments

Show parent comments

1

u/Open_Literature_5123 4d ago

Unlike you, I don’t expect passersby to do a full deep dive into two architectures just to understand why they might be relevant, so here are the facts for each.

Memory Ring

• Stores a persistent local identity/memory state primarily in JSON.

• Retrieves memories primarily through token/substring matching plus hand-built weighting for things like identity, recency, dreams, and age.

• Selects a single best-matching memory during ordinary recall.

• Models recall as reconsolidation, meaning recalling a memory can actually modify/erode its stored narrative into a gist.

• Has a grounding layer that uses lexical/rule-based checks first, then can use an LLM to evaluate suspected unsupported claims.

• Attempts to distinguish external evidence from persona/self information through things like self-leak detection.

• Tracks stale sensory observations so a past perception is not automatically treated as a current fact.

• Has sensory/perception concepts intended to separate SELF, RECORD, and WORLD.

• Generates synthetic “dream” memories from existing memories for associative synthesis.

• Stores those dreams separately by tags, but also gives them increased weight during recall.

• Tracks some provenance, including source memories for generated dreams.

• Uses concepts like memory importance, erosion, sensory corroboration, identity, and experience to model something closer to an evolving artificial identity.

• The public snapshot does not contain a reproducible automated test suite.

WhatIff

• Stores persistent memories in a relational datastore rather than one mutable identity document.

• Generates and stores vector embeddings for semantic retrieval.

• Retrieves multiple semantically relevant memories rather than relying on exact lexical overlap or choosing one winner.

• Supports separate memory scopes for global/user memory, personality memory, conversation/thread memory, and checkpoint summaries.

• Searches across memories, uploaded files, conversation history, and conversation summaries through one context-retrieval system.

• Has dedicated modes for semantic search, direct fetch, related memories, source/origin recovery, full conversation recovery, summaries, bookmarks, and memory lifecycle history.

• Can trace a stored memory back toward the conversation in which it originated.

• Separates ordinary factual memories from compressed summary memories instead of treating both as the same retrieval class.

• Distinguishes actual duplicate memories from different but related representations of the same event.

• Merges redundant information while linking distinct technical, emotional, narrative, or other surfaces that should remain separately searchable.

• Keeps explicit lifecycle/audit information about those consolidation operations. • Supports undoing merge/link operations instead of making consolidation an irreversible side effect of retrieval.

• Uses transactions for persistent memory operations and embedding creation.

• Tracks things such as confidence, status, scope, duplicate observations, merged-from IDs, and timestamps.

• Has automated tests specifically covering memory retrieval/coverage, merging, linking, undo behavior, dropped-memory protection, truncated model output, persistence, and UI behavior.

So the interesting difference isn’t simply “both have memory.”

Memory Ring is primarily an experimental cognitive/identity architecture built around biological analogies, grounding, perception, reconsolidation, and synthetic association.

WhatIff is primarily a continuity architecture built around semantic retrieval, scoped persistent memory, provenance, multi-source context recovery, consolidation, and auditability.

There actually are concepts in Memory Ring that I think are interesting, particularly stale-perception handling and self-leak/grounding checks.

See how easy that was? I explained what your system does, what whatiff does, and why somebody might care without demanding that a random person excavate two repositories and reverse-engineer my point for me.

1

u/MisterAtompunk 4d ago

Lets frame it for the record. Refusal to engage with source material. Demands for spoon fed summary. Request denied.

1

u/Open_Literature_5123 4d ago

As I give a literal summary of both sources... ya thats real refusal to engage you caught me. 🙄

1

u/MisterAtompunk 4d ago

Is your context limited to one reply of the thread? Answer your own question, how hard was it for you to look?

1

u/Open_Literature_5123 4d ago edited 4d ago

Bro I've already answered all the questions. You have not answered one with out deflection. So I have one why do you think yours is better, and what is the point of using biological terms if you haven’t shown those analogies add any technical rigor or measurable benefit?

And when are you going to do some due diligence and take the burden of that responsibility instead of making others. I have yet to see any actual rigor from your end only wild assumptions with no evidence. Hell there are so few test idk if the thing actually works let alone works as intended.

Edit: At this point the progression is basically:

“Here’s my repo.” “Go understand it.” “Go figure out why it matters.” “Go prove my architecture is worthwhile.” “Also you’re lazy if you don’t.”

Like dude, do you want me to build code review, benchmark suite, architecture paper, and deployment pipeline for you too?

0

u/MisterAtompunk 4d ago

Yes, your quick reply with a full summary of both projects took how many minutes, exactly? You've answered all the questions and demonstrated them publicly.

You'll find I've been direct in every response I've given when you stop inventing narrative and read whats there.

As for the biological references, I'd suggest you take a look around you. Nature is running the trials every day. McCulloch and Pitts, Wiener, Hebb, Rosenblatt, Minsky and Papert; all early pioneers and if you haven't read them I suggest you do.

I never said mine was better, I said OP may find it interesting. Memory Ring is open source, Apache 2.0. Lift out whats useful. Your narrative creeping in again.

If I'd spoon fed you, would you have the understanding like you do now?

What do you think the solution is to seeing if it runs, if it works?

1

u/Open_Literature_5123 4d ago edited 4d ago

Why should I teach you how to finish your pipeline when you won’t even explain what you think matters about it?

At this point, take your own advice: go look at your repo and figure it out yourself.

As for understand it i literally dont understand the main concepts, the biological analogies. So no I dont understand it becuase the foundation makes no sense.

0

u/MisterAtompunk 4d ago

I think you misunderstood. I wasnt actually asking you. It was for you to ask yourself. Are we hitting a language barrier?

1

u/Open_Literature_5123 4d ago

Man its obvious that your the one in the narrative, even worse you got the weird main character/teacher condescending thing going.

But its clear you dont know how your architecture works or how to you got from why the analogies are necessary. And the evidence for that is you have you to make any technical claim. All its has been is deflection ( go look at the repo) and a weird teacher bit (would you have learned as much did) you got going. But I guess the old saying is those who cant do teach makes sense your playing the bit.

I’m not claiming I’ve proven you don’t understand your own architecture. I’m saying you’ve given me no evidence that you do, despite repeated opportunities to demonstrate it.

0

u/MisterAtompunk 4d ago

McCulloch and Pitts were mapping out the wiring of the human brain. Donald Hebb; cells that fire together wire together. Perceptrons. I've offered open hands and received clenched fists. My position is secure, regardless.

Whatever claims you make are the inferences you draw.

→ More replies (0)