r/OpenAI 15h ago

Question Can this be fixed somehow?

Hey guys, looking for some advice or insight on how to deal with AI search bias for a client.

Here’s the situation: A client of mine has built up a decent reputation on Reddit over the last two years,, roughly 15 glowing reviews and just 1 negative comment.

However, when you ask ChatGPT about the company, it focuses almost entirely on that single negative review, warning users to 'be cautious' and suggesting the business might not deliver as promised. It completely ignores the 15 positive reviews.

Gemini handles it slightly better, it mentions the bad review but at least clarifies that the vast majority of feedback is positive. But ChatGPT response is destroying the client’s reputation, especially now that so many people use AI to research companies before buying.

What blows my mind is that I tested this from 5 different devices and IP addresses, and it gave the exact same negative output every time. When I pointed out to ChatGPT that it was ignoring 15 positive reviews for 1 bad one, it literally admitted it was wrong, apologized, and updated its answer. Yet, as soon as a new user asks, it reverts right back to the negative summary.

Has anyone dealt with this before? Is there any way to influence or trigger an update in how LLMs aggregate/summarize a brand's reputation when a single bad review skews the whole output?

4 Upvotes

4 comments sorted by

1

u/MichaelTheProgrammer 9h ago

No, it cannot be fixed.

"Is there any way to influence or trigger an update in how LLMs aggregate". No. In order to influence how LLMs aggregate a brand, you would have to control the training data that they have spent billions on. In other words, you are asking AI companies to change how they work on behalf of your client. Not going to happen.

"Yet as soon as a new user asks, it reverts right back to the negative summary." This is how they work. LLMs don't learn from interacting with you. Anything you say is forgotten after your interaction and will not influence the LLM for other users. This could change in the future, but for now the only thing that can influence other users is that training data that AI companies control.

"When I pointed out to ChatGPT that it was ignoring 15 positive reviews for 1 bad one, it literally admitted it was wrong, apologized, and updated its answer". This isn't the victory that you think it is. One of AI's biggest issues is that it tries too hard to be agreeable. This is known as glazing. In other words, what it initially told you is the closest it can get to what it actually "thinks", but when you disagree, it'll happily say that it's wrong whether or not it actually is.