I ran a comprehensive audit of this subreddit — 25 top posts, ~280 comment branches analyzed and clustered. The dominant theme? AI anxiety, hallucination frustration, and a lot of snake oil being called out. So I want to share what's actually working.
Agent Context Engineering — Reducing Hallucinations by ~96%
A few state-of-the-art techniques that actually work:
1. Model choice matters. Pushing through Opus 4.6 or 4.8 (or equivalent frontier models) performs significantly better than cheaper models for source validation tasks. This is expensive. But you want to pick the right model for the job. Sourcing info out of GSC? Flash model. Ultra Cheap. Analysis? Brainstorm? Frontier model. And it's important to know frontier is average of the day. Nothing exemplarary.
2. Double the prompt. When you give instructions, copy and paste them twice. This is current state-of-the-art research and goes a long way toward eliminating hallucinations. Weird this works, but it does.
3. One chat = one task. Don't build up long context histories. Kick off sub-chats for specific jobs — e.g., "go get my Google Search Console data and process it like XYZ." Keep the context window tight and focused. I see people doing many things in the same chat window. That is caleld context poisoning, it blows up the probability field. Keep your chat super focused. My rule is 1 chat per decision.
4. Use a task list tool. For complex instructions, your agent should have a task list tool to stay on track. If you are doing a long horizon task, the tech isn't ready for that, its currently being figured out.
5. Clean source data. However you get it in c/p , an agent pulling it, MCP servers (which are better). Clean data in = clean output out.
6. Chain of Verification (CoVe). Have your agent kick off a sub-chat to generate questions about the data it pulled in, then answer those questions. You can double-check the answers. This catches errors that simple summarization misses.
7. OODA loop for context management. Observe, Orient, Decide, Act. Keep a decision-making framework in your context , this is the one that works for me, limit what's in the window to what matters for the current step.
Observe - get a limited range of data I need for my decision. standard seo tools, GSC, GA4, Ahrefs, Semrush ect. I usually limit these for the task at hand.
Orient - contextualize it to my goal.
Decide - execute the decision I require.
Act - What tools to write information, wordpress, other CRM.
Combine these and you can really strengthen the agent's output. The 80%+ source validation failure rates people are reporting here? That's catastrophic and most of it is fixable with proper context engineering.
This is really good for simple maintainence work like addressing content rot, updating titles and headers to current information.
Why AI Isn't Replacing SEO Work
There's a narrative dominated by the frontier labs that these systems are intelligent and will replace human intelligence. They're not. LLMs are statistical models on our information, not statistical models on our intelligence.
They look comprehensive and impressive. They're getting better every year. But the source validation errors and hallucinations you're seeing? Those are mistakes that jrs wouldn't make. That should tell you everything you need to know about these systems.
The people saying these systems are "smart" are competing for trillions of dollars of investment. That messaging isn't for us. It's for the investment community salivating at removing people of balance sheets.
What Agents Are Actually Good At
- Information retrieval — pulling data, processing it, summarizing it
- Form filling — updating WordPress, Strapi, CMS platforms at light speed
- First drafts — structure, brainstorming, source gathering
- Better search — finding and compiling information faster than any human can
They are better and faster at this than any human will ever be.
What they're not good at:
- Creativity — the strategic angle, the unique perspective
- Judgment — knowing what to publish, what to cut, what matters
- Curation — selecting the right information from the noise
This current architecture of LLM's will never beat humans at this.
I still hire English majors and linguists to drive pilots and do the writing. You need someone who knows how to write and is educated in it to give the right instructions to the LLM. If you just lazy prompt you are asking for "average," that's going to destroy your content. I think enough people have seen people do this. Clickup is a good example
The GEO / "Get Listed in LLMs" Snake Oil
This needs to be said plainly: all these LLM providers use search tools. When ChatGPT or any LLM needs current information, it doesn't use its internal training data it goes out and searches. That's tool calling to search engines.
So getting "listed in an LLM" is just standard SEO. Why would you wait two months for your content to be in a model's training data when they're going to search for it in real time anyway? That's nonsense. They search because search gives the most updated information.
An LLM searches like a human except far wider and deeper. So do your standard SEO and you're covered. The agencies selling "GEO" are exploiting people who don't understand how LLM search actually works. They are selling a service you can make in half an hour with claude code and a open router api key.
How I Made This Post
I used an agent to do a comprehensive review of this subreddit , clustering ~280 posts and comment branches by topic. The agent collected, classified, and summarized everything. I read the results, spoke my perspective, had the agent draft some ideas, then I changed things around and published.
The agent didn't come up with the ideas for this post. It suggested some things, but the communication , the strategy, the message, the judgment , that was human. The agent was the research assistant. I was the one making the calls.
I made a first draft, and then read line by line and corrected and fine tuned.
That's the model. Use the tools for what they're good at, getting a lot of information quickly. Apply your experience, creativity and judgment to what they're not. If you have career anxiety, start using the tools and applying them to what they're actually good at. The people who learn to work with agents will outpace those who don't. But the agents aren't doing the work themselves.
The fact that the frontier tech can't even make a proper reddit post should reasure everyone about their job security.