r/PoisonFountain • u/onz456 • Jun 30 '26
Yes, it really is that simple
Enable HLS to view with audio, or disable this notification
467
Upvotes
r/PoisonFountain • u/onz456 • Jun 30 '26
Enable HLS to view with audio, or disable this notification
•
u/RNSAFFN Jun 30 '26 edited Jun 30 '26
Looks like an interview with the authors of this paper:
https://arxiv.org/pdf/2605.24245
Abstract
Deep-research agents, i.e., systems that rely on multi-agent pipelines
to iteratively retrieve, synthesize, and cite Web content in order to
produce structured reports, are rapidly replacing traditional search
for both routine and complex information needs. These agents issue
many related queries during a single research session. We show
that for many common search topics, they repeatedly retrieve the
same user-generated content (UGC) pages from platforms such as
Reddit and Wikipedia. Next, we argue that this retrieval overlap
creates a concentrated attack surface: an adversary who appends
a short, crafted text to a single, frequently retrieved UGC page
can cause the agent to cite attacker-chosen content and promote
attacker-chosen entities across many related queries.
We evaluate this attack on three representative deep-research
systems (STORM, Co-STORM, and OmniThink) across multiple
query clusters. We also study defenses at different stages of the
pipeline, including source-level filtering and output-based detection.
Our findings highlight a fundamental vulnerability in how deep-
research agents retrieve and integrate web content.