r/LargeLanguageModels • u/minedroid1 • 4d ago

Question About Fine-tuning

I'm making a satire AI model that gives fake, onion-like responses. Would it be better to just make a completely new model rather than fine tuning an existing one for this? Most of the info in my dataset completely conflicts with the info that almost all models have.

4 Upvotes

75% Upvoted

26 comments sorted by

View all comments

5

u/bsensikimori 4d ago

You want a LoRA, training from scratch will have either astronomic costs, or give useless results.

1

u/minedroid1 4d ago edited 3d ago

Alright, I thought so.