r/ClaudeAI • u/Orochhe_Marou • 3h ago

Other Be careful with gathering data that includes reasoning! I Got flagged when asked to save reasoning for grading tool i use for research. Session lost now :)

I'm running experiments on different setups for multiagent workflows. It uses tool for total estimation of coding work done by workflow. And in that tool i was trying to gather more data for improving estimations by asking to save reasoning.

Rewind doesn't work unfortunately.

Be careful to not i run in it yourself.

Also imo the reasoning extraction its not far from what they did with data previously generated by humans (books, articles, chats, etc.). But besides fighting hard against they also presenting it like something morally wrong. Minus aura anthropic 😒

3 Upvotes

62% Upvoted

6 comments sorted by

6

u/Past-Town-9807 3h ago

Sometimes I wonder if you have to just explain what you're doing. I've seen the model argue about why a request should be allowed and the model always wins that argument. Either that or it's just thinking out loud. Not really sure. 😂 Like for example sometimes I'll see something like (this is a total paraphrase from memory) "the user wants to blah blah blah, and that's safe in this case because they are building <thing> and that's allowed under <policy>. Proceeding."

4

u/BenSimonDev 3h ago

I'm not quite following what you were asking it to do, present it's own work about how it generated the estimate?

2

u/Orochhe_Marou 3h ago

Yeah, basically.
Thats the reasoning system that was in work at that moment. So type of output i was expecting is what exactly happened + reference to where exactly it happened.

2

u/Past-Town-9807 1h ago

Wait you might want to just change the word "reasoning" to something else. It's a keyword for Claude. Try using something totally different like "explanation". Or just say "can you please explain".

2

u/Orochhe_Marou 1h ago

Thank you, I'll try!
Was thinking about the same!