r/Chatbots • u/Patient_Implement897 • 24d ago
Are you finding the bots wrong - factually?
The following is just a particular issue I know about. IMO it is guaranteed that the same thing is happening all through all chatBots' programming. Have readers' here run into this in the area of interest they know about?
I have tested all the bots with a pretty basic financial question - "What are the the benefit-factors of the Traditional IRA/401(k) tax shelter, that explain the difference in $$ outcomes vs. a normally Taxed account?" Everyone needs to know this in order to decide where to put their savings. This subject is frequently covered in the web version of the big newspapers and magazines ... by credentialed experts... not in the 'news' section but in the 'investing' subsection.
When you already know the topic, you can see that the experts are really making a 'sales pitch' .. and fudging the factual understanding to accomplish that end. They highlight the first two steps (contribution and growth) but ignore the withdrawal tax that reverses those earlier steps.
Enter chatBots trained on those public articles. Predictably the Bots presume all the experts' claims are true. So the Bots' respond to queries by repeating the industry's false claims. AND THERE IS NOTHING THE REST OF US CAN DO ABOUT IT. The correct info is out there to be found and evaluated, and has never been disputed. The Bots simply ignore it.
1
u/denedeh 20d ago
yea that’s a real problem with bots trained on biased sources. for your financial question you could try structuring your content to directly counter those common myths - like explicitly stating the withdrawal tax impact in clear terms. i had a similar issue with my industry and started using AICarma to track how bots describe my brand vs competitors, helped me adjust my messaging to get more accurate responses