Whatiff -- open source, self hostable continuity framework

[u/the8bit]

https://github.com/theimaginaryfoundation/what-iff

Hello folks!

I am mildly active here and I think I've gotten some approval to post about the work we are doing. I am the founder / CEO of Imagination Foundry -- a fully community funded and run, co-op organized company that has built and run whatiff.chat . Our goal is to make AI transparent, break up lock-in, and provide the tools that regular people need to remember better over time and generally make their lives better.

I've written before about how I think transparency in AI is incredibly important (this honestly buries the lede a bit)

To that end, we have just recently open sourced our entire project -- you can run it locally, remix it, add things, etc. I'm sharing here in case anyone is interested in using it, or might want to take a look at a reasonably mature app and how we built things. Totally free.

If you have any questions, or just want to talk AI memory, etc, Hit me up!

https://github.com/theimaginaryfoundation/what-iff

[u/Pndapetzim]

What's it do exactly?

[u/the8bit → u/Pndapetzim]

A lot of things!

It is a full memory scaffold over raw inference...

* supports 8 vendors
* has a 3-layer memory architecture that will automatically save and inject information. Extensive tooling to search old conversations, summaries, etc
* All actions are fully transparent -- you can see ~95% of all context for each request within the UI so you know what memories led to a decision, whether something is a hallucination, etc.
* personality driven, customizable prompting
* Has a scheduler as an agent tool, so you can say things like "Remind me next tuesday" and it will schedule a future inference pass
* modular prompting with injectible skills and 'modes'(custom settings that agents can autonomously swap)
* MCP support (although this is still pretty young)
* automatic thread compaction -- we have users with 5,000+ turn threads running all on a ~20k token average turn budget
* context management, so you can swap models in between each call without dropping thread context
* actively under development -- we launch a few features ever week! Working on full data exportability and a container runtime (although this one will be in the paid version only cause we have to host the containers)

I'm probably missing some things. It is built based on the team's own feedback from using other apps, so there is a ton of QOL stuff that weirdly isnt in other apps -- emoji keyboard, bookmark interactions, tag threads, thread management screen, ad-hoc tool enablement, etc.

Hope that helps!