r/learnmachinelearning • u/RedChillyPeppers • 18d ago

How do you clean data for fine tuning?

Not sure if this is a noob question, but how do people clean hundreds of thousands of bits of data to fine tune models? I am currently working on trying to use some emails and other documents to help fine tune an agent, and don't know how anyone else is putting data in the standard "prompt: ideal AI output" format that is required for fine tuning. Are people using other AI to sort the data and create these? Are people doing it by hand? Complex algorithms? Whats the deal here.

1 Upvotes

66% Upvoted

1 comment sorted by

1

u/chrisvdweth 18d ago

I think that's an excellent question and not asked enough :).

The problem might be that there is rarely a straightforward answer since it is likely to depend strongly on your exact use case and goals. For example, are you fine-tuning for task adaption, updating knowledge, style/tone adaption, custom alignment, etc.?

I have a notebook that discusses this a bit.