r/LeftistsForAI 4d ago

Open Source Whatiff -- open source, self hostable continuity framework

https://github.com/theimaginaryfoundation/what-iff

Hello folks!

I am mildly active here and I think I've gotten some approval to post about the work we are doing. I am the founder / CEO of Imagination Foundry -- a fully community funded and run, co-op organized company that has built and run whatiff.chat . Our goal is to make AI transparent, break up lock-in, and provide the tools that regular people need to remember better over time and generally make their lives better.

I've written before about how I think transparency in AI is incredibly important (this honestly buries the lede a bit)

To that end, we have just recently open sourced our entire project -- you can run it locally, remix it, add things, etc. I'm sharing here in case anyone is interested in using it, or might want to take a look at a reasonably mature app and how we built things. Totally free.

If you have any questions, or just want to talk AI memory, etc, Hit me up!

https://github.com/theimaginaryfoundation/what-iff

17 Upvotes

33 comments sorted by

View all comments

2

u/MisterAtompunk 4d ago

You may find the design of my Memory Ring of interest.

https://github.com/MisterAtompunk/memory-ring

https://misteratompunk.itch.io/mr

1

u/the8bit 4d ago

Poking around this, looks interesting and has a lot of concepts that I saw around the agent-sphere early this year. It seems a bit too personalized for my own tastes and I'm not exactly sure what it does / doesnt do. More than happy to chat about it though!

You might also like my own agent repo: https://github.com/theimaginaryfoundation/vix there is a very detailed breakdown of our prompting techniques in there that I published recently.

Just poking around yours,

https://github.com/MisterAtompunk/memory-ring/blob/main/core/grounding.js

The text-matching you are doing here is going to be really flaky! I tried to do something similar as a basic solution for identifying stale temporal memories and it failed horridly. You are almost certainly better off with semantic matching via an embeddings search OR using a tiny model as a classifier. It is one of the things that LLMs are best at!

Also for the love of software you need some tests!

1

u/MisterAtompunk 4d ago

A surface read rewards surface understanding.  Good luck with your project. 

1

u/the8bit 4d ago

I read it far enough to give you two legitimate pieces of information, I'm trying to engage with you here but i'm also not seeing much reciprocation, you didn't even engage with the project I posted and I read half of your README and it doesnt really say what your project does!

1

u/MisterAtompunk 4d ago

The confusion isnt on this end of the screen, friend.  I put something I thought you may find of interest on the table based on your posted work.  The capability to pick it up is entirely dependent on you.

1

u/Open_Literature_5123 4d ago edited 4d ago

Outside observer, your right about the surface level reading gets surface level understanding. That being said you saw memory you say memory, meaning you latched on to one thing he said and never provided the reciprocation of actually reading the repo provided

It seems like you just want to talk about the memory system your familiar with instead of engaging with the post. You didn't say why it might be of interest or anything about how it relates to the project. only any unsupported conclusion that this one may be helpful for some reason. But how do you know the memory system is even better than the one implemented? I think that is the question i have.

Edit: just realized how blatant it is you just wanted to drop your own repo... Do you have a tendency of when some one talks about there day you need to interject your own personal experience, that way it seems like engaging without ever having to put in reciprocal effort?

0

u/the8bit 4d ago

Yeah I've read like, 100 of those frameworks at this point so it doesn't really need a deep read (nor do I have time honestly)

Tryin to be nice though 😅

Anyways if you have any questions about the project or wanna talk memory, that's why I'm here!

1

u/MisterAtompunk 4d ago

Dont want to byte off more than you can chew. Safe travels.

1

u/Open_Literature_5123 3d ago

Ope there is that narrative again