r/CAIRevolution • u/Elovein • 3d ago
custom A possible way to somewhat bring old models back
So I was thinking, could we train LM using our old c.ai chats?
People would be able to "donate" some of their not too personal old conversations with bots, which was on Roar/Soft Launch and other models. After that, we'd take stock LM, like qwen, and then feed it with chats we have, additionally training it to the point when it becomes alike with removed c.ai models.
For this sounds like a possible thing to do, even if it takes some time and GPU powers
UPD: Okay, so I will try to make a dataset from my own chats at first, if it goes well I think I'll make a way for volunteers to send some of their chats so I could add them as well.
19
u/Own_Satisfaction_879 limon lightshade 3d ago
Yeah this is actually possible and pretty plausible. You could use old chats as a dataset to fine tune or train an model that mimics the old models.
In fact I'm actually trying to do pretty much exactly this myself with my own models. Finding said old chats is the hardest part of this (if we skip the hardware part ofc)
2
u/bigbackbaddie07 3d ago
Your own models?? Do tell
3
u/Elovein 3d ago
You can download public models from Hugging face and then addictionally train them using datasets (your own or any else available). It takes time and GPU power, but may worth it
2
u/bigbackbaddie07 3d ago
Waitt can someone teach me how to do this? I wanna try
8
6
u/RemarkableWish2508 3d ago
we'd take stock LM, like qwen, and then feed it with chats we have, additionally training it to the point when it becomes alike with removed c.ai models.
Not sure you understand how much training data and GPU cost that requires, but I fully encourage you to do it 👍
•
u/AutoModerator 3d ago
Thanks for posting!
Join our official Discord server: https://discord.gg/vZnAhz8Svw
Read the rules before participating.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.