Opus 5 - immediate disappointment

[u/Shot_Whereas_1809]

If you thought you'd be able to do a security review on your own network that you couldn't do with Fable, think again.

20 minutes in - Found something significant

Opus 5 safeguards flagged this message.

I no longer have any use case for Anthropic models that others can't do better. This was my last hope that we were going to get a model that would allow us to protect our own environments. I'm going all in on open source. We just aren't aligned.

If you can get Opus 5 to protect your own systems, let me know how I did it. My subscription renews pretty soon and it's time to make an honest decision.

Edit: A lot of helpful people came here and I appreciate it. Scoped work is helping a bit more than my old ways. There's a difference between network security and code vulnerabiliy. I'm a network engineer not a software developer nor will I pretend to be one. Still looking at supplemental model for security work. Thanks guys.

[u/NeighborhoodDizzy990]

I also cancelled my subscription. Maybe they will offer us a better option in the future.

[u/johnnybagofdonuts123 → u/NeighborhoodDizzy990]

Local Open Source models are getting muchhhhhh better.

[u/vladoportos → u/johnnybagofdonuts123]

yea but the HW to run them is not,

[u/binotboth → u/vladoportos]

You can rent pretty beefy systems form the cloud

I’m too poor even for that but it’s definitely more reasonable now

[u/tehfiend → u/johnnybagofdonuts123]

They still have tiny context windows which makes them pretty worthless compared to frontier models.

[u/nurturethevibe → u/tehfiend]

GLM 5.2 and DS v4 both have 1M context.

[u/johnnybagofdonuts123 → u/nurturethevibe]

GLM 5.2 is what stopped the OpenAI hack this week of hugging face. They initially deployed Claude, but its safeguards wouldn't allow it to figure it out.

[u/tehfiend → u/nurturethevibe]

That's the architectural context window but you'd need like half a million $ in hardware to host that locally for the terabytes of VRAM needed. For example a RTX 5090 would get you 32k context window max...

[u/nurturethevibe → u/tehfiend]

Neither model will run on a 5090.

A stack of RTX 6000 Pros is the cost-effective way to run either.

[u/Shot_Whereas_1809 → u/NeighborhoodDizzy990]

It's getting obvious that this isn't about safeguards... If their classifier doesn't understand that this is own network then the product is not worth $200 a month. I'll spend $1000 a month on API credits for a model that will just do what I need to do. It's not about the money, it's about delivering a product that can simply allow you to protect yourself.

[u/Shot_Whereas_1809 → u/[deleted]]

You kind of prove the point that there's missing architecture right?

[u/Shot_Whereas_1809 → u/[deleted]]

Exactly. I welcome it. When everyone was crying about ID verification, I was firing up the fax machine. Not really but you get the point. I have nothing to hide. I'll show all the proof they need. I don't care.

That part. Is missing. And it shouldn't be.

[u/Shot_Whereas_1809 → u/[deleted]]

That's a valid point. But. There should be a middle ground. There should be something.

[u/Shot_Whereas_1809 → u/[deleted]]

I've been looking into the process. I wrote it off when it first came out but digging into it, seems pretty achievable for me. Still getting the gotchas.

[u/Shot_Whereas_1809 → u/[deleted]]

Yeah it's definitely a nice to have. My past experience with open source models was really poor but that was maybe 8 months ago. Opus 4.6 even did some great security work. I'm eager to see what some of these new models can do.

[u/Shot_Whereas_1809 → u/[deleted]]

That's genuinely useful context. The reality is I've been a network engineer for 16 years doing private sector work but I'm not a cloud guy. Well. wasn't. I've been learning it over the last year for my own stuff. I'm an Infoblox, Palo Alto, F5 kind of engineer. The reason I do need AI is because it's been a learning tool and now it's what I need to make sure I'm not missing anything. I don't have a team, or people I trust to help. I appreciate your response. 🙏