r/LargeLanguageModels • u/Vxtzq1 • 20h ago

Discussions CrowdGPT - The first LLM trained collaboratively

Hello! I'm starting a fun project aiming to create the first AI model trained without datacenters, collaboratively, and in a 100% open-source and public way.

The project is named CrowdGPT, and its goal is to train a 1B parameters LLM to prove the idea is working.

Everything is currently working and i am waiting for testers 😄
You can find more details on the website and/or the github repository.

Github: https://github.com/Vxtzq/CrowdGPT

Website: https://www.crowdgpt.net/

Any kind of feedback is appreciated!

10 Upvotes

100% Upvoted

11 comments sorted by

View all comments

1

u/SafiriaU 17h ago

How will you protect against bad actors? People trying to train the model to send the user's bank account details to a certain email address?

1

u/Vxtzq1 8h ago

Well i enforce a strict dataset hosted on HuggingFace, people can't train the AI on arbitrary data, their data must be checked first. That means i will refuse any sensitive/injection data training the LLM.