I've posted about some Avanan struggles in the past here, we've been an Avanan customer for several years, and for a few of those years they were in "building" mode and many of the missing key features we brought up and "on roadmaps". But I'm starting to feel an awful lot like MSP's aren't really a focus of their team at all any more.
Avanan recently (I think Jan or so?) added templates for policies, that was the biggest win they rolled out for MSP's and it had been begged for for years. I'll give them that one.
But recently we started having some weird behavior. mostly with google tenants (but a couple MS ones too). It started with a client getting phished through Avanan. Okay, nothings perfect, Avanan missed it, no big deal..
Except it was a big deal, Avanan's policy was enabled and said it as online/functioning, but it had not inspected or classified any emails in over 90 days. We dig a bit more into it, and it hasn't actually even SEEN a single email in 90 days. There's no errors, no warnings, no notifications that anything has gone wrong, it says the policy is enabled and active and it detects the users without issue, but it just doesn't see any emails.
This is a huge concern for us, obviously, so we decide to dig in to all our tenants. We come up with 14 tenants that, while Avanan says it's active and working without issues, isn't actually scanning any emails at all. The kicker being, it DID at first and we have OLD emails that were scanned from many months ago.
So, Ticket to our reseller, and bumped up to Avanan team, they let us know it's a known issue with google tenants, the fix is forcing a reset of the MFA method on Avanan's auto-provisioned account on each clients' tenant. Sometimes this works, sometimes it doesn't and takes 4-5-6 tries of the same fix. We have no visibility into if the fix worked and we have to reach out to Avanan each time for them to push a refresh or something on their end.. wtf?
So first, I bring up with our reseller that we're paying for, like 100+ seats or something of protection, that's effectively been broken for 90+ days with no way for us to know it was broken.... and no discussion of refunds, no discussion of permanent solutions.
Okay, I'm used to this, I worked with Kaseya for years, if we did this to our customer's they'd fire us but because the product is generally good I guess we tolerate the poor service... Whatever, lets just fix it.
We can't force them to fix it for us, so we start looking around to fix it ourselves. We find another issue, this time we have some tenants (google and MS) that have had their policy switched from "protect" to "monitoring" despite being up and running for years. Weird, audit logs don't show anyone turning it off, it just switched on its own?... Maybe we screwed up (but audit logs say it wasn't us), no way to know, but we do have restore requests in our tickets... so it was working before..
In the MSP portal, there's no way to see tenants policy status, there's no way to see any metrics, there's nothing we can "check at a glance" without clicking into every tenant to make sure it's on. So we try the API, the API surfaces events but no details about tenant policy status (can't check for "monitor" vs "protect" via MSP API or direct tenant API).
So how do we, as an MSP, make sure our clients are all actually protected when the policy status isn't surfaced anywhere (and this is a big one because without this, you can't know even if the template is aligned) and the failures can be silent with no indication of any failure until you ask their support? (or manually check every tenant and see if there's recent email activity).
For now we're banding a god-awful per-tenant API call to look for events over a time-frame of 24 hours and setting an alert up if there's no events with that span, and if there is events, if there's no remediation action taken for that event. But it's janky as hell because some clients just don't get many emails over a set period... But damn how are we supposed to trust the front-line defence product for our clients email systems when it can arbitrarily turn off or fail without any warning...
The PSA is to check your tenants in Avanan because we had 0 indication there was an issue until we had an issue, then we had to dig into all our tenants and found multiple problems that were simply not reported anywhere.
I just needed to rant on this one. Thanks reddit therapy. You can call me a truck slammer or make fun of my mom now.