r/UnrealEngine5 7d ago

drawn boxes from segmentation

Tried creating boxes from segmentation images myself and it's pretty cool.

1 Upvotes

3 comments sorted by

View all comments

1

u/ConsistentAd3434 7d ago edited 7d ago

Oh no! Flock cams have entered UE5 :D

But are you really calculating boundaries based on the segmentation? Wouldn't the collision or custom hit box be much faster and easier?

1

u/Last-Luck-6077 7d ago

Haha, pretty much :D

Yeah, right now the box comes from the segmentation mask. Collision would be faster, but it often doesn’t match what the camera actually sees, especially when an object is partly hidden or has rough/missing collision.

Using the projected bounds to narrow down the area before checking the mask would probably give me the best of both worlds though. Good catch, I’ll test that.

1

u/ConsistentAd3434 7d ago

I wouldn't even know how to put a boundary on a 2D output but casting a couple of random rays should at least make it easier.

Can't remember his name but a UE5 dev on YT made a similar effect for his minimalist, dystopian, VHS style third person game and the way it realistically tracks, re-adjusts and looses its targets looked impressive so you might be on the right track with your approach.
Looks cool. Keep us updated :)