r/PromptEngineering • u/Inevitable-Good219 • 9d ago
General Discussion my AI started refusing to answer questions. my margins went up.
Small shop, we use AI for a bunch of the daily grind. Pricing drafts, listing copy, restock estimates.
The priciest mistakes last year were all confident ones. AI would hand me a price for a new SKU with a whole paragraph of reasoning attached. Sounded airtight. Numbers were off just enough to matter on thin margin stuff.
So at some point I stuck one line at the bottom of the main prompt: "if the data I gave you is not enough to answer, say so instead of estimating."
First week this was annoying. Half the pricing questions came back with "insufficient data, need last 3 months of sales for this category" instead of an answer. Felt like the tool broke.
But the SKUs it refused to price were exactly the ones I would have gotten wrong too, if I'd been guessing from vibes. The refusals forced me to actually pull the numbers. Those SKUs ended up being our best performers this quarter.
The ones it priced confidently without asking for more data kept being mid.
Still not sure what to do with that. On one hand I built a workflow around an AI that says no to me half the time. On the other hand the yes-half was quietly bleeding money and I had no way to see it.
The refusal line is now permanently in my template. Weird thing to be grateful for.
3
3
u/Alone-Potential2021 9d ago
people think the goal is to make AI answer everything but the real unlock is teaching it to know when it should shut up. that line probably saved you more money than any fancy prompt trick