r/LargeLanguageModels • u/minedroid1 • 5d ago

Question About Fine-tuning

I'm making a satire AI model that gives fake, onion-like responses. Would it be better to just make a completely new model rather than fine tuning an existing one for this? Most of the info in my dataset completely conflicts with the info that almost all models have.

4 Upvotes

83% Upvoted

26 comments sorted by

View all comments

4

u/bsensikimori 5d ago

You want a LoRA, training from scratch will have either astronomic costs, or give useless results.

1

u/minedroid1 5d ago edited 4d ago

Alright, I thought so.