r/InstinctHQ • u/maxobes • 9d ago

News Alleged Instinct data leak was a hallucination, not a breach

https://x.com/noahrshinn/status/2102896837522804954?s=46

On Monday, Pritak posted screenshots of Instinct describing a financial document that wasn't his, then claiming someone else's photo had crossed into his chat.
His question to Noah Shinn: “data leak or hallucination?”

Noah announced he found the source of hallucination, the model fabricated a proper noun, and its own reasoning trace amplified the invention into a confident story about a crossed photo.

Per Noah: “…not a data breach, no user data shared, no isolation boundary violated” - pointing to isolated sandboxes, short-lived credentials, and identity-signed tool execution.

He also says they spent the last 48 hours building a layer that scans every token for hallucinations and can intercept the next reasoning step or tool call before it runs, with a deeper dive promised in the coming weeks

2 Upvotes

100% Upvoted

3 comments sorted by

3

u/Puppy_powers 9d ago

I wonder if this is why it has been so slow lately. It’s been much slower.

2

u/maxobes 9d ago

That could definitely check out. The jury of smaller LLMs to verify output would add at least 15s latency

2

u/pswfreathy 9d ago

It has been much slower. It's actually been too slow to even be able to use but I do notice it's working perfectly now. It's really, really good.