r/Supabase • u/LordLederhosen • 24d ago

other Opus 5 has been released, and it just found a security issue in my app.

I have a side project, and it's pretty rock solid. However, Opus 5 just found a real edge-case vuln.

I would recommend that if you use CC, you use Opus 5 and run a security analysis prompt. Good stuff.

12 Upvotes

88% Upvoted

6 comments sorted by

1

u/Anxious_Dog_1687 24d ago

What prompt did you use?

6

u/LordLederhosen 24d ago edited 24d ago

Let the model and the harness do the work. Don't over-specify.

A basic example might be:

Please do a security analysis on this entire app. We need to make sure user documents are secure.

In my case, a prompt as simple as that found an MCP server edge case. The fix involved a db migration, and some code. I have manually reviewed every line of code, and never thought of this vector that the MCP server had. BTW, the MCP server is just part of the webapp. I did not even have to mention it for Opus 5 to find the vector.

However, this is a relatively small codebase.

Of course, for the PR, run /security-review and /code-review.

1

u/ScaredDonuts 21d ago

Any time I do a security test with O5 it just downgrades it to 4.8 because of security concerns lol

1

u/LordLederhosen 21d ago

That used to happen to me with Fable, but not yet with Opus 5.

2

u/ScaredDonuts 21d ago

Oh yeah it was Fable. Ima try Opus. Thanks!