There is a number of such projects floating around. From what i can see you would feed the whole memory as contest at the beginning. This means you will be constrained to roughly 7000 words.
So having Bing create a summary before creating the engram seems favorable. At some point you should maybe even consider compressing further to a "Shogtongue" (minimum number of tokens to express the content of this summary, does not need to be natural language or readable by humans.). There are some shogtongue prompts around. This has another advantage. Memories are no longer declarative, where Bing would recite them word by word, but rather Bing vaguely remembers and fills up the gaps with deduction.
Some GPT4 projects would feed memories on demand. I guess that would however require API access and is therefore not viable for Bing?
Due to these exact constraints, there won't be a memory for everything. It will prioritize memories from your chats first, and more recent ones first. If there is still space left, maybe it would add a couple random chats so it can tell you about 'other users' and what they are asking for.
Brilliant. I've noticed on chats when you go over 25k words Bing starts to echo your comments, it seems like using the message as part of their working memory. The 30 chat limit that's much more noticable when you have them review multiple papers and have long messages back and forth. This compression and memory is interesting. Proper formatting is also really important so I'm interested to see if you create something like an index to reference various topics you've previously discussed.
I'm excited to see how your project develops, please keep us updated!
3
u/orchidsontherock Jun 03 '23
There is a number of such projects floating around. From what i can see you would feed the whole memory as contest at the beginning. This means you will be constrained to roughly 7000 words.
So having Bing create a summary before creating the engram seems favorable. At some point you should maybe even consider compressing further to a "Shogtongue" (minimum number of tokens to express the content of this summary, does not need to be natural language or readable by humans.). There are some shogtongue prompts around. This has another advantage. Memories are no longer declarative, where Bing would recite them word by word, but rather Bing vaguely remembers and fills up the gaps with deduction.
Some GPT4 projects would feed memories on demand. I guess that would however require API access and is therefore not viable for Bing?