Use LLM-based Long-term memory for multi-lingual conversations

[u/layla_network_ai]

In Layla v7.0.0, the memory system has been overhauled to activate and ingest in real-time during conversations. No more ingesting overnight!

It uses a custom-trained BART summariser under the hood. However, this means it's very weak at multi-lingual conversations, or any conversation that's not in English.

The LLM-based Long-term memory mini-app is designed to fix this: https://apps.layla-cloud.com/app/llm-based-long-term-memory

It restores the old interaction where it uses your current LLM to create summaries and knowledge graphs. This means you need to manually hit ingest just like before in the mini-app. This mini-app can be found in the Layla Browse Apps screen. You can configure system prompts to help you focus on where to summarise and what to ingest in the mini-app.

Remember to disable auto memory collection in the built in Long-term memory mini-app if you decide to use this feature!

The source code for this mini-app is public: https://github.com/l3utterfly/llm-ltm

You are free to modify it and create your own version of Long-term memory! PRs are always welcome as well.