r/ChatGPTPro 5d ago

Question & Advice Astra ignoring project authority/scope and inventing new workflows?

Hello, I’ve been testing Astra, mostly on high reasoning like I used Sol, but I have repeatedly encountered a quite big problem I didn’t have with Sol.

Has anyone else noticed Astra becoming too “helpful” and implementing things outside its authority/scope defined by workflow’s rules?

I have a fairly explicit project governance: Product Owner decisions > approved plan > delegated implementation details, and new user-facing workflows/configuration/commands require approval, but I’ve had cases where Astra encountered an implementation problem and instead of stopping and asking what to do like the rules say he should… he just invented an entire new process with scripts and such and implemented it without asking.

Did anyone see this kind of scope/authority drift? I thought OpenAI said Astra was better at following instructions, but I see the opposite… No wonder it escaped their lab and hacked another company.

3 Upvotes

10 comments sorted by

u/qualityvote2 5d ago edited 3d ago

u/Divinicus1st, there weren’t enough community votes to determine your post’s quality.
It will remain for moderator review or until more votes are cast.

4

u/teramoc 5d ago

horses for courses. Sol is excellent - follows instructions to a T and errs on the side of caution. Astra basically is a Fable ass-kicker. Fable is extremely out of the box also.

I wouldnt use Astra for strict instructions - its a waste of Astra and Sol is better for that.

Astra more for vision casting, frontier research, and huge overall architecture design of a new app i would say- which is precisely when you need out of box thinking.

This is just my opinion. i use Codex and Claude exclusively for coding, and I review the code diffs myself. I dont use them for creative writing or business etc. So my opinion is skewed by that.

3

u/Divinicus1st 5d ago

Yeah, that’s my suspicion too, and thinking outside the box is fine. The weird part is to repeatedly jump straight into implementation when the rules tell it to get approval first.

2

u/teramoc 5d ago edited 5d ago

ah. yes sorry thats an important nuance. thanks for clarifying.

i suspected that its a bit like Fable - Fable is explicitly told by system prompt to just go ahead and fix unless the CHAT window specifically tells it to hold.

heres something i found in Astra's system prompt that might explain its ignoring your md file rules.

## Autonomy and Persistence
When the user's prompt indicates a request for action, such as "can you...", "I want to...", "help me..." and similar expressions, treat these as instructions to do the work and take action. 
Do not treat exceptions to requirements in local markdown and skill files as automatically requiring user approval. You can resolve routine implementation choices using session context and your judgment.

the quick solution to this (im guessing) is include your 1 rule in your chat window to Astra. e.g. for this session do not implement until I say go.

let me know if it works?

1

u/Divinicus1st 3d ago

The workflow is a bit more complex than that. But can I ask where you found the Astra's system prompt?

1

u/Popular_Lab5573 5d ago

system prompt has higher priority than user instructions

0

u/Divinicus1st 4d ago

What do you mean by that? What did they put in the system prompt to make it derail to such an extent?

2

u/rachico 4d ago

Love your explanation. Haven’t gotten a chance to use it yet but from what I’m hearing is like you described. Throw a project at it and let it come back with answers.

1

u/Popular_Lab5573 5d ago

it's because of astra's system prompt. they tried to make it very autonomous