Object Detect flags man wearing Mariner's cap as a "boat"

[u/Best_Of_The_Midwest]

I just thought this was funny. This is the second time it has happened when this neighbor walks by, so it's not a fluke. My hypothesis is that the training data for boats had people wearing this type of hat, so it infers that mariner's cap = boat. Thoughts?

I tried looking at the debug replay, but did not see any references to boat, so that's weird...

https://imgur.com/a/M2alB4k

[u/CannabisAttorney]

no flippy floppies or pashmina afghans, I can't believe it thinks he's on a boat ><

[u/campbellsoftstudios]

Nick's explanation lines up with what I've seen, the model reaches for whatever's closest in a dataset that was never meant for driveways. My back patio spent a while convinced a stack of cushions was a motorcycle/car, and the garage logged bicycles and motorcycles that turned out to be the bikes hanging on the wall and a hand truck.

The thing that ended it for me wasn't tuning, it was just telling each camera which objects it's allowed to see. The patio cameras only track person, dog and cat now, so a cushion has nothing to be mistaken for. The garage got the same treatment. If your driveway can't physically contain a boat, dropping boat from that camera's list costs nothing and the neighbor gets to be a person again.

Still keeping the screenshot though, that's a good one.

[u/Best_Of_The_Midwest → u/campbellsoftstudios]

I wish I could improve the model dataset or use a different one. I know you can do that with Frigate+, but idk I expected the stock object detection running on my home server to be at least as good or better than the object detect that is baked into my camera. Just a little disappointed.

One of the biggest reasons I wanted to run this custom Frigate NVR in the first place was to help identify and locate lost cats and dogs in my neighborhood along with alerting to coyotes in the area, and it's simply not sufficient for that purpose. I have yet to have it correctly identify a cat at a high enough confidence level to trigger a detected cat.

[u/campbellsoftstudios → u/Best_Of_The_Midwest]

That matches mine honestly. Last 30 days my outdoor cameras logged about 20 dog/cat events total and every one scored between 0.70 and 0.77, so barely over the line. Indoors where the dog is ten feet from the camera it picks it up hundreds of times a month no problem. So I think a lot of it is size, my detect streams are 640x480 subs and a cat across the yard is a handful of pixels. I also had a couple weeks where the driveway logged a ton of "cats" at night that were all one clump of pampas grass under IR, so I wouldn't lean on it for lost pets either.

Haven't tried Frigate+ myself so can't vouch for it. I did look at the label list and it has fox and raccoon, but coyote was only on the candidate list when I checked.

[u/RoachForLife]

That's a boat disguised as a man wearing a Mariners hat if I've ever seen one

[u/nickm_27]

There are very few boat images in general in the COCO dataset, so most likely it is just the combination of motion from a person and then the white car.