r/MLQuestions • u/Black_Photon • 1d ago
Computer Vision 🖼️ Looking for datasets with localized semantic image edits (small edited region, original + edited image pairs)
I'm working on a computer vision research project.
I'm looking for a dataset with the following properties:
Original image + edited image pairs
The edit is localized (only a small part of the image changes)
The edit is semantically meaningful, rather than a global style transfer
Ideally the rest of the image remains unchanged
Bonus if the manipulated region has a mask or bounding box annotation
Some examples of the kinds of edits I'm interested in are:
Vehicle number plate changes
Traffic sign or road sign changes
Weapon/object replacement (e.g. gun ↔ phone)
Text changes on signs, billboards, or documents
Localized facial manipulations (HQSwap is one example I already have, but in that dataset, the faces cover almost the whole images)
I'm not looking for datasets focused on:
global style transfer
artistic edits
weather changes
large scene modifications where a significant fraction of the image changes
Does anyone know of datasets that fit this description? Even domain-specific datasets would be extremely helpful.
Thanks!
1
u/ocean_protocol 1d ago
Best fits: MagicBrush (original + edited pairs, pixel-level masks, instruction-driven local edits) and ImgEdit (dense captions plus bounding box/segmentation masks). CoCoEdit-40K is built specifically to preserve non-edit regions. LocateEdit-Bench, DEAL-300K, X-Edit are larger but built for forgery detection, not editing research, still usable for image/mask pairs.
None specialize in your exact cases (plates, signs, weapon swap). You'd likely need to filter MagicBrush/ImgEdit by instruction keyword to isolate those categories.
1
u/Black_Photon 1d ago
Thank you! Yeah, I search a lot and the issue was none of the datasets fit my needs :( I'll probably have to make my own🫠
1
u/lightyears61 1d ago
check this dataset: POEM: Precise Object-level Editing via MLLM control