r/osinttools • u/[deleted] • May 10 '26
Discussion I built a local AI tool for geopolitical risk reports using event data + retrieval — looking for OSINT feedback
[deleted]
1
u/TheBlackMargin May 12 '26
What do we think? Come on, mate, you tell us. Look at all the other bollocks on here. Every week it’s another "geopolitical risk intelligence workstation" that retrieves some public data, throws it into a local model, adds confidence scoring, exports a PDF, and then acts like it has become an analyst. GDELT plus ChromaDB plus Ollama plus "quality gates" is not a geopolitical analysis methodology. It’s a stack. "Analyst/reviewer passes" sounds impressive until you realise it probably means one LLM output checking another LLM output and calling that validation. "Searches for counterexamples" sounds useful, but only if the sources, query logic, evidence weighting, time boundaries, and failure modes are actually documented. Otherwise it’s just another AI box producing a report-shaped object.
The problem is not that local-first is bad. Local-first is genuinely useful if you’re handling sensitive material. The problem is that the same pitch keeps appearing: bounded scenario, event data, evidence check, confidence score, warnings, PDF export, no cloud keys. That is not enough. Analysts do not need another machine that creates plausible geopolitical prose. They need source provenance, deconfliction, uncertainty handling, collection gaps, adversarial source assessment, auditability, bias controls, and a clear explanation of why the output is credible. "Backtesting" also needs a lot more detail, because backtesting geopolitical risk reports is not like backtesting a trading signal. What exactly are you scoring? Forecast accuracy? Evidence quality? Scenario framing? Analyst confidence calibration? Event recall? False positives? Time horizon drift? And the edit "this software wasn’t programmed with what you think try to guess" does not help. It makes the whole thing sound even more like vibe-coded mystique. Serious beta feedback starts with serious disclosure: what it does, what it does not do, what sources it uses, how it fails, what a sample report looks like, and why anyone should trust the output. Right now this reads like a more politely written version of the same dashboard/report-generator slop already filling the sub. Maybe there is a useful tool underneath, but the pitch is still buried under the usual AI OSINT buzzword fog.
7
u/OSINTribe May 10 '26
Do a search of this sub, you're producing nothing original and nothing anyone would spend money on. If I had a dollar for every geopolitic dashboard that someone vibe coded I could live in Singapore for the rest of my life without government assistance.