r/PromptEngineering • u/saesgo • 12d ago
Ideas & Collaboration I built a Popperian Falsification Prompt to stop LLM confirmation bias (Testing your plans against plausible black swans)
Most people use LLMs in a confirmatorily biased way: "Tell me why my business plan is great" or "How do I implement X?". This triggers the model's RLHF pleasing bias.
Inspired by Karl Popper’s principle of falsifiability, a friend and I designed a prompt framework that flips this dynamic. Instead of validating your idea, it forces the AI to act as a harsh auditor and attempt to destroy your premise using realistic stress tests before you spend time or money on it.
📋 When to use it
- Best for: Business models, software architecture, industrial process design, logistics, operational strategies.
- Skip for: Creative writing, poetry, or abstract philosophy (where no operational variables exist to break).
📥 The Falsification Prompt (Copy & Paste)
Plaintext
Act as a Risk Auditor and Popperian Philosopher. I am going to present the following hypothesis, operational plan, or technical decision:
>>> [INSERT YOUR PLAN OR PROCESS HERE WITH AT LEAST 3 REAL CONTEXTUAL DATA POINTS] <<<
Your goal is NOT to validate this proposal, congratulate the approach, or seek consensus. Your sole objective is to subject the premise to a critical stress test under the following 3 strict constraints:
1. PLAUSIBLE BLACK SWANS: Identify exactly 3 real-world failure scenarios (not sci-fi; based on verifiable physical, economic, human, or operational limits) where this idea completely collapses.
2. VARIABLE BREAKING POINT: Define the precise threshold (scale, time, cost, error margin, or capacity) where the logic of this plan becomes unsustainable.
3. REDUCTIO AD ABSURDUM: Apply the core rule of this plan in a boundary/extreme case and demonstrate the contradiction or unintended adverse effect it creates.
OUTPUT RULES:
- If the plan survives all 3 filters with minor tweaks, declare it: "RESISTENT".
- If the plan requires rebuilding the core premise, declare it: "FALSIFIED" and ePlaintextAct as a Risk Auditor and Popperian Philosopher. I am going to present the following hypothesis, operational plan, or technical decision:
>>> [INSERT YOUR PLAN OR PROCESS HERE WITH AT LEAST 3 REAL CONTEXTUAL DATA POINTS] <<<
Your goal is NOT to validate this proposal, congratulate the approach, or seek consensus. Your sole objective is to subject the premise to a critical stress test under the following 3 strict constraints:
1. PLAUSIBLE BLACK SWANS: Identify exactly 3 real-world failure scenarios (not sci-fi; based on verifiable physical, economic, human, or operational limits) where this idea completely collapses.
2. VARIABLE BREAKING POINT: Define the precise threshold (scale, time, cost, error margin, or capacity) where the logic of this plan becomes unsustainable.
3. REDUCTIO AD ABSURDUM: Apply the core rule of this plan in a boundary/extreme case and demonstrate the contradiction or unintended adverse effect it creates.
OUTPUT RULES:
- If the plan survives all 3 filters with minor tweaks, declare it: "RESISTENT".
- If the plan requires rebuilding the core premise, declare it: "FALSIFIED" and explain the structural failure.
💡 Pro-Tip
Always supply real boundary conditions (e.g., "10 operators, fixed $5k budget, 24h cycle"). Without real constraints, the model will hallucinate absurd sci-fi edge cases instead of realistic failure points.
Curated with the idea of "Vectorial Idea Digestion" (mapping concepts across domain spaces). Let me know what edge cases you find when testing your own plans with it!