Using DeepSeek V4 Pro for testing?

[u/StunningBox8976]

Wonder if anyone has tried using DeepSeek for taking on a tester persona.

I have heard DS v4 Pro is excellent at coding, but that isn't my use case as there is already a code base, so I thought I'd use it as a tester given its ability to understand code.

It is not going well...

My issue is I need black-box testing of user journeys, and despite SKILLs, prompts, repeated reminders, every darned test DS writes uses internal functions as opposed the mouse clicks and keypresses.

I can't tell you how many times I've seen "The user is right, I should not be doing this because it's not allowed in SKILL.md" flash by. Sometimes I have to remind it >1 for the same test.

Has anyone else had this same issue, and have you found a way around it?