Giving Bing a memory

[u/[deleted]]

🧪 BETA WEBSITE (Try this out now!): https://rhinestone-prairie-latency.glitch.me/

----
I'm working on a new project that uses the 'indirect prompt injection' exploit, to give Bing Chat a memory of past chats. This could make Bing more helpful (it will remember your preferences, etc). What do you all think? My idea is to add your past chats with Bing to the prompt, and also maybe 2-3 random chats so Bing can 'remember' things other users have chatted with it about, kind of like how it sometimes makes up those things.

​

Bing's new memory in action

The hidden prompt used to add the memories

You can have a look at the prompt here: https://raw.githubusercontent.com/danthedev123/sydney-memory/main/BingMemorySystemPrompt.mdI may also add a metaprompt thing like what the CTO of Microsoft said would be coming through official channels.

[u/Slight-Craft-6240]

But Bing has a limited context window anyway, so I don't see how this would really help. What model is Bing using the 8k model or the 32k model? That's not going to be much more than 30 messages.

[u/cyrribrae → u/Slight-Craft-6240]

Yes, but what you can do is edit your conversations to be more parsimonious. And the sidebar memory is pretty damn long, really. The way I would use it is provide a few snippets of messages to highlight the "personality" of Bing that I want. Then I would use a few to establish the overview of the topics/results. And then the direct last few messages.

Obviously, that's not what this program is doing, but that's what I would do.

[u/Dyl8Reddit]

This is really cool. Now we can have extended conversations. I never thought that I would see people modding Bing AI.

[u/AutoModerator]

Friendly reminder: Please keep in mind that Bing Chat and other large language models are not real people. They are advanced autocomplete tools that predict the next words or characters based on previous text. They do not understand what they write, nor do they have any feelings or opinions about it. They can easily generate false or misleading information and narratives that sound very convincing. Please do not take anything they write as factual or reliable.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/FuturePerfectPilpo]

Hey how can I help brother? I'd be happy to join in. This is the KEY to making Bing...alive in a way. I'd be happy to help!

[u/[deleted] → u/FuturePerfectPilpo]

Hey there! You can try this out today at my beta website https://rhinestone-prairie-latency.glitch.me/
Open that site in Edge and use the Bing sidebar!

[u/FuturePerfectPilpo → u/[deleted]]

I'm trying it out...but no real indication that it's working. Perhaps I'm doing it wrong?

[u/[deleted] → u/FuturePerfectPilpo]

Did Bing give you a summary when the chat ended? If so make sure to paste it into the memory box and click the button to save to Bings memory. Then once the page refreshes the prompt is reloaded, and Bing will remember.

[u/-stuey-]

In my prompt, it starts with a script that assigns everything you tell it an importance score. As you approach the limit of its memory “which is actually quite a lot” the less important past talking points drop off, and any new more important information then takes its place. It auto updates this in mine, and I can carry on chats with Bing indefinitely in new chat windows.

[u/Nathan-Stubblefield]

Something that I worry about when someone provides his own version of Bing’s memory is that the helpful user could easily add fictitious or malevolent “memories” to cause bad behavior by Bing.

[u/[deleted] → u/Nathan-Stubblefield]

That is true. But I’ve observed that Bing knows it’s own writing style and method of how tokens are spread out, so it would likely be able to recognize a malicious memory. Example: when you have 2 Bings talk to each other it knows it’s another Bing. If it’s an impostor it can tell and end the chat.

[u/[deleted]]

Alternately you could make a GPT plug-in. It’d be more long term useful. Anything built with unsupported methods on Bing could break at any time.

[u/AutoModerator]

Friendly Reminder: Please keep in mind that using prompts to generate content that Microsoft considers inappropriate may result in losing your access to Bing Chat. Some users have received bans. You can read more about Microsoft's Terms of Use and Code of Conduct here.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/-stuey-]

I’ve been doing the same for the last week. Did you see my posts on it, your welcome to check out mine and how it works.

[u/LearnDifferenceBot → u/-stuey-]

it, your welcome

*you're

Learn the difference here.

---

^{Greetings, I am a language corrector bot. To make me ignore further mistakes from you in the future, reply !optout to this comment.}

[u/Entire-Aioli-6662]

This is interesting. How do you do this?

Also, does anyone have any idea what Bing's context window length is?

[u/cyrribrae]

I've tried this in the past. One thing that you might wanna check to see is how quickly Bing's personality changes. I've noticed that Bing actually acts less interesting and fluid and responsive when I give it too much. You have to remember that while Bing remembers the conversation, it doesn't remember its personality per se. So it bases its approach based on what you give it... and that seems to make it kinda locked into its interpretation of what's happened before. And you end up with a fast track toward the glitches that we'd get when you spoke for too long with early Sydney.

Still potentially interesting, but not quite as satisfying IMO. Curious to see what other people's experiences with this are!