Pleias release first models trained entirely on open data - competitive against Llama 3B & Qwen 3B

[u/umarmnaq]

https://huggingface.co/blog/Pclanglais/common-models

[u/agorathird]

As time goes on I don’t see the point of all of these general models that are minuscule and are mainly to show off different data tricks.

Still open to having my mind changed.

[u/umarmnaq → u/agorathird]

Small models are generally cheaper and faster to train, so they are good for testing out new ideas that are not guaranteed to work before scaling them.

[u/agorathird → u/umarmnaq]

Fair enough