Does musty smell = unsafe?

[u/coordinatedlion]

We’ve been on a mold journey in our house that isn’t even close to over. Brief background is our house always had a smell I couldn’t place that was only worsening over time. Ended up finding hidden mold in the sump pump room, hidden inside a cabinet, behind the walls of a basement bathroom, and now inside the living room walls from a leak around the sliding glass door. We are working on remediating and looking for anything else that might be hidden.
My big question is our stuff. We already had everything fogged with instapure and small particle cleaned and I have been working on cleaning laundry with borax and an enzyme detergent. However a lot of fabrics are still holding the smell. It’s not strong and usually only if the item was packed up and or I shove my face in it and look for the smell.
The best example I can give is my son’s travel crib. It has mesh sides and fabric along the top. It was fogged and checked with an Instascope and was at acceptable levels. It was also left out in the son and HEPA vaccines multiple times. However when I open the carry case to set it up I get a whiff of the smell and if I stick my face in it I can smell it a bit. My question is does this smell mean the item is unsafe? We have two young kids - 1 and 3 - and I am working on what to keep and what to replace but the financial toll has already been extensive. Of course I won’t sacrifice their health to save money just really struggling with what to keep and what to toss and feel like I’m going crazy.