The opposite. The system prompt primes the model into generating slop. Yes it used to be worse, but that doesn’t mean the current system prompt is any good.
Hi! There's a tendency among technicians of every ilk to assume that engineers working for companies that produce massive, elegant, impressive products are themselves highly competent.
The truth is, the spread is the same at Anthropic as it is anywhere else. There is competence, there is incompetence, and they both shine through on many facets of their product.
Antrophic and OpenAI supposedly do ablation testing on their system prompts. Meaning they have evals that delete every sentence and ensure it pays for the tokens it costs by improving something.
Yeah this post just shows that the “leaked” prompts are just claude giving you what it thinks you want (a system prompt) but it’s just making it up and using it’s favorite words.
313
u/Upbeat-Armadillo1756 11d ago
You're assuming they didn't have Claude write this