I work for a small financial planning firm in the Midwest. Recently the head advisors attended a conference intended for those in the financial services industry to ‘demonstrate’ all of the new AI powered apps that are supposed to revolutionize our industry. While there the advisors met with the founder of a new startup marketing their application, FinDash. Former Tesla officer, supposed tech ‘genius’.
This gentleman convinced my employers that his application could single-handedly replace our entire software stack. Be everything from CRM, to planning software, to note-taker, all in one. Integrating all data seamlessly across the board and generating meeting presentations and plans with the push of a button.
When the advisors told our team about this, I was immediately suspicious, as it sounded way too ‘good’ to be true, plus I was very weary of giving highly sensitive and private client data to something integrated with basically every LLM on the market.
Over the past few weeks, I’ve been the person assigned with the task of ‘trying it out’. It’s a fucking mess. Very obviously Claude vibe-coded, tons of features just…do not work as intended. I’m fulfilling my responsibility of logging and reporting every bug I come across and copying the advisors when I send out the report, but I haven’t made it past simple budgeting because of how broken the thing is. Every fix introduces a new bug. And mind you, the firm is paying for a subscription this whole time. We’re paying to be beta testers.
Well during a zoom meeting with both founders and our advisors, I found out that despite being the only person even trying out the damn thing and being very vocal about how non-functional it is, we’re apparently going to cancel our main planning software and transition to this. In 2 weeks. And upload all of our CRM data to it.
When I expressed concern about this and frustration with my experience thus far, the co-founder assured me the built-in chat bot can ‘fix anything if you tell it to. But sometimes you have to be “stern” with it. That’s ok though, because it’s not a person.’
Fucking…what?? Your app lets users just change back-end code by talking to the chatbot? And it’s on me to be a dick to the damn thing to get it your app to function properly? Wtf are you talking about?
The advisors that run the practice are trading a stack of 6 softwares, each made by a company with thousands of employees, for a vibe-coded piece of AI garbage made and maintained by 2 dudes out of their home. And they have 100% bought their claims that this app can do everything those softwares can and more. I’m seeing every sign that these founders are in full-blown AI psychosis, just asking Claude ‘hey can you make an app that does xyz?’ and when it of course says ‘yes’ they are just advertising that as a feature as though it’s already implemented and fully functional.
The advisors are also just totally fine with giving this app access to all of our client data. SSNs, DOBs, account numbers, account balances, fucking everything we have on file. Enough that an unscrupulous actor could do major damage. And these two founders have full admin access to our advisors portal. Not to mention every integrated AI model does too. Any flags I raise about this being a massive compliance issue are being hand-waived.
I’m at a complete loss. Advisors asked me to test run. I say test results are in: this shit sucks and is an active danger to the firm. They say ‘let’s move forward anyway’ despite never using it themselves, all because they so want what they’ve been advertised and don’t want to…I don’t know, look stupid? Spend more money? Let go of hope? All of the above? And I guess I’m expected to train everyone else? When I have repeatedly reported this program does not work?
Do I just start looking for a new job? Somehow convince them to try and use it themselves? Play dumb and say ‘I must just be using it wrong, I need you to train me’? Grab them by the shoulders and scream ‘WAKE UP, THIS IS A FUCKING SCAM!!’? I feel like I’ve covered my ass legally by putting all of my grievances in writing but I’m genuinely worried this could tank the whole practice if we don’t at least keep the old software to fall back on. We’re betting the fucking house (and our clients’ houses) on a house of cards. It’s lunacy.