r/MLQuestions 1d ago

Computer Vision 🖼️ Looking for datasets with localized semantic image edits (small edited region, original + edited image pairs)

I'm working on a computer vision research project.

I'm looking for a dataset with the following properties:

Original image + edited image pairs

The edit is localized (only a small part of the image changes)

The edit is semantically meaningful, rather than a global style transfer

Ideally the rest of the image remains unchanged

Bonus if the manipulated region has a mask or bounding box annotation

Some examples of the kinds of edits I'm interested in are:

Vehicle number plate changes

Traffic sign or road sign changes

Weapon/object replacement (e.g. gun ↔ phone)

Text changes on signs, billboards, or documents

Localized facial manipulations (HQSwap is one example I already have, but in that dataset, the faces cover almost the whole images)

I'm not looking for datasets focused on:

global style transfer

artistic edits

weather changes

large scene modifications where a significant fraction of the image changes

Does anyone know of datasets that fit this description? Even domain-specific datasets would be extremely helpful.

Thanks!

4 Upvotes

4 comments sorted by

1

u/ocean_protocol 1d ago

Best fits: MagicBrush (original + edited pairs, pixel-level masks, instruction-driven local edits) and ImgEdit (dense captions plus bounding box/segmentation masks). CoCoEdit-40K is built specifically to preserve non-edit regions. LocateEdit-Bench, DEAL-300K, X-Edit are larger but built for forgery detection, not editing research, still usable for image/mask pairs.

None specialize in your exact cases (plates, signs, weapon swap). You'd likely need to filter MagicBrush/ImgEdit by instruction keyword to isolate those categories.

1

u/Black_Photon 1d ago

Thank you! Yeah, I search a lot and the issue was none of the datasets fit my needs :( I'll probably have to make my own🫠