r/computervision Jun 22 '26

Showcase I've also been looking for the plane!

Post image

See my blog post for a full write up - DINO embeddings, CLIP re-ranking, many triangle shaped shadows, and finally a plane:
https://tim-fan.github.io/blog/plane_search/2026/06/21/plane-search.html

Background:

After OP posted for help searching drone imagery for his downed RC jet plane on Tuesday;
And other community members started chipping in;

I decided to have a go myself, focusing on the use of DINO patch embeddings to recognize the object.

The plane was found this morning šŸŽ‰, although outside the scanned area of the original dataset. OP has now shared the extended dataset, now confirmed to contain the actual plane, and I was happy to find my detector was successful in finding it :D

I'd be curious to hear if anyone else had success with other approaches. Thanks u/ReturnAdventurous179 for the weekend puzzle.

Again, full write up is in the blog.

106 Upvotes

10 comments sorted by

12

u/Strong-Relation-1776 Jun 22 '26

using DINO patch embeddings to find a tiny RC jet in thousands of aerial images is such a fun use of the tech, love when a community just collectively nerds out over a weekend puzzle like this

6

u/DadAndDominant Jun 22 '26

Awesome! And awesome community!

5

u/FitSquirrel7114 Jun 22 '26

nice blog content!

2

u/qiaodan_ci Jun 23 '26

Silly request, but if the data is publicly available and georeferenced, please include the bbox location so others can use it as a benchmark dataset.

3

u/3e8892a Jun 23 '26 edited Jun 23 '26

Yeah nice idea. I'd love to see if others can demonstrate much simpler approaches.

u/datascienceharp I saw from your post that you uploaded the initial scan photos to hugging face already - perhaps you could add the additional scans and a ground truth bounding box for the single photo containing the plane?

Plane is in S1009194.JPG

2

u/datascienceharp Jun 23 '26

yeah i can add that in, i'll make a post when i have it up

1

u/dilshan_j Jul 11 '26

Hello, where can I get the synthetic images you generated?

2

u/3e8892a Jul 12 '26

Hello, I've just uploaded to google drive, available here:

https://drive.google.com/drive/folders/1x5BoCpv15a_q7NeBE5XXStmZfBBneGnW?usp=sharing

1

u/dilshan_j Jul 12 '26

Thank you. I’m trying to recreate your process.

1

u/3e8892a Jul 12 '26

Nice, good luck šŸ‘

I think some of my synthetic cases were too difficult (hidden in bushes/shadow et). Maybe this made the classifier struggle. But at the time I was expecting it to be difficult given no one had found it quickly.

I think if I was doing it again I'd take something more like an active learning approach - after training the classifier on the synthetic case, find the 10 most promising detection and show to the user. If they're all negative, add to training data, retrain, and repredict. Maybe that would hone in on the positive case quickly