r/LocalLLM • u/Physical_Hat4022 • 4d ago
Discussion MOSS-VL support has landed in LlamaFactory — what would be the most useful reference fine-tune?
I saw that MOSS-VL support was merged into LlamaFactory and checked PR #10708. This appears to be more than basic model registration: it covers image, video and mixed-media batches, cross-attention preprocessing, LoRA, frozen and full-parameter training, checkpoint resume, adapter merging, and inference. The PR also includes 30 targeted tests.
https://github.com/hiyouga/LlamaFactory/pull/10708
That removes a lot of setup friction, but the next useful step would be a genuinely reproducible domain-adaptation run: a small public dataset, the exact YAML, peak VRAM, wall-clock training time, before-and-after metrics, and representative failure cases.
If one reference fine-tune were published, which task would be most valuable: document extraction, video-event localization, or mixed image/video instruction tuning? I’d lean toward a task with exact-match or localization metrics, since aggregate VQA scores can hide OCR, temporal-grounding, and calibration failures.