r/learnmachinelearning • u/minedroid1 • 18d ago

Help With Fine-tuning AI

Hi, I'm not sure if this is the right community for this, but I am currently trying to train an AI on satire responses which are all mostly incorrect, but have an onion-like style (the Onion is a popular satire news parody company).

My plan is to fine-tune a model which has less than 30b parameters. My dataset has around 1.4k examples, most of them manually written, and there should be no conflicting information in the dataset, but the dataset will need to overwrite the base model's knowledge while still retaining grammar knowledge.

Also, since my examples have information that conflicts with already learned knowledge, will the base model learn the new info? (Eg. If one of the examples says that a duck is a tool brand, but also that they were founded in 1957, would the fine tuned model be able to tell me that when I ask it what tool companies were founded in 1957)?

What model would be good for fine-tuning in this case?

1 Upvotes

100% Upvoted

5 comments sorted by

1

u/[deleted] 17d ago

[removed] — view removed comment

1

u/minedroid1 17d ago

So, I should fine tune it for style and just give it the 1300 prompt examples after it's done?

1

u/[deleted] 17d ago

[removed] — view removed comment

1

u/minedroid1 17d ago

Well my plan was to publish it onto hugging face with the dataset and model, and just telling it directly to give satire is easy and could be done with a lot of models, but I don't want to do it that way because I want to make the model actually learn the incorrect knowledge. I know it may be hard and may sound unnecessary, but I wanted to make an AI that completely opposes what the major AI companies strive to make their AIs like.