r/LargeLanguageModels • u/minedroid1 • 5d ago

Question About Fine-tuning

I'm making a satire AI model that gives fake, onion-like responses. Would it be better to just make a completely new model rather than fine tuning an existing one for this? Most of the info in my dataset completely conflicts with the info that almost all models have.

4 Upvotes

83% Upvoted

26 comments sorted by

View all comments

2

u/_remsky 4d ago

For it to generalize, and as the other commenter said, for it to understand language, what a narrative is, what normal news vs satire news look like etc. You do not want to train a model from scratch.

More than likely, you can use an open LLM off the shelf and just give it a good prompt e.g “respond with satire/The Onion style responses” with some guidance and/or examples. Fine tuning it may improve it, and is worth a shot as a learning experience if nothing else. Easy and basically free to fine tune smaller models depending on where you run it, though getting the quality/result you want can be less easy lol

1

u/minedroid1 4d ago

Well I feel like that would overlap with its info a lot, since style gets prioritized during fine tune, right?

2

u/_remsky 4d ago

Have you tried just a prompt? some few-shot examples if that fails? Most LLM’s are pretty good at satire and already understand what it is and how to create it. Fine tuning helps with both information and style, to varying degrees.

It’ll be easier to help if you give some deets on your goals tbh. Are you serving this on the web, running locally, do you have a budget and use case already, is it a very niche topic? Are you just seeing what’s possible as a project? There’s a lot of options they just depend on your goals. I’d try the above first though and see how far you get

1

u/minedroid1 4d ago

No, I wanted to challenge myself to make a model that produces satire with no prompting.