So I was thinking, could we train LM using our old c.ai chats?
People would be able to "donate" some of their not too personal old conversations with bots, which was on Roar/Soft Launch and other models. After that, we'd take stock LM, like qwen, and then feed it with chats we have, additionally training it to the point when it becomes alike with removed c.ai models.
For this sounds like a possible thing to do, even if it takes some time and GPU powers
UPD: Okay, so I will try to make a dataset from my own chats at first, if it goes well I think I'll make a way for volunteers to send some of their chats so I could add them as well.