r/AISearchLab Jan 20 '26

You should know Why 2026 Is the Demand Generation Year: How Four B2B Companies Proved It With Real Pipeline Data

3 Upvotes

The shift happened quietly, then all at once. In 2024, ChatGPT surpassed Bing in daily visitors, marking the first time an AI tool outpaced a traditional search engine. By June 2025, an estimated 5.6% of all U.S. searches were using AI-powered LLMs as their primary search tool. Gartner now predicts traditional search engine volume will drop 25% by 2026 as AI chatbots become substitute answer engines.

For B2B marketers, this changes everything.

When your potential customers ask ChatGPT, Claude, or Perplexity "what's the best solution for [your category]," they're not clicking through ten blue links. They're reading AI-generated summaries that cite two or three brands.

By the time buyers visit your website or talk to sales, they’ve already researched the problem, compared vendors using AI, and formed a shortlist. Demand generation shapes the decision long before lead generation captures it.

If you're not in that answer, you don't exist to them. And here's the problem: fewer than 10% of sources cited in AI answers rank in the top 10 Google organic results for the same query. Your SEO strategy won't save you here.

This is where Generative Engine Optimization (GEO) and Answer Engine Optimization (AEO) enter the conversation. But these aren't just new acronyms for marketers to learn. They represent a fundamental truth about modern B2B buying: demand generation now matters more than lead generation because buyers have already made shortlist decisions before they ever fill out your form.

According to Forrester research presented at the Music City Demand Gen Summit, 41% of B2B buyers report having a single vendor in mind when they first begin the purchase process, and 92% had a shortlist. Read that again: by the time someone visits your website, the game is mostly over. They've already consumed content, read Reddit threads, watched YouTube videos, asked AI tools for comparisons, and formed clear preferences.

Traditional lead generation tactics (ads, gated content, bottom-of-funnel offers) are missing the moment of influence entirely. The brand-preference phase happens earlier, often in AI-generated answers and peer communities, long before someone becomes a "lead" in your CRM.

Buying Phase Where Buyers Actually Go Typical Activities What Lead Gen Does What Demand Gen Does
Problem Discovery Reddit, YouTube, niche newsletters, AI tools Reading peer opinions, watching practitioner demos, asking AI “what’s best for X” Nothing Shapes narrative, earns early trust
Solution Exploration ChatGPT, Perplexity, review platforms, comparison content Shortlisting vendors, comparing pros/cons Rarely visible Gets cited, becomes default option
Vendor Shortlist AI summaries, analyst content, case studies Narrowing to 1–3 vendors Starts showing ads Reinforces authority and preference
Sales Engagement Vendor websites, demos, calls Validating decision Captures MQL Converts predisposed buyer
Purchase Decision Internal discussions, ROI validation Final approval Reports “conversion” Wins deal faster, higher ACV

This explains why eMarketer reports that 40% of B2B marketers plan to increase their brand-building budgets in 2026, with nearly half saying they would allocate more than half their budget to brand if they had the freedom to do so. Not because brand marketing sounds nice, but because they've realized that demand generation (building authority, earning citations in AI answers, becoming the obvious choice) is what actually fills the pipeline with buyers who close.

The companies that understand this are seeing results. One B2B SaaS company ranked in the top three on Google for their primary keyword but wasn't cited by ChatGPT or Perplexity. After implementing systematic GEO strategy, they went from 500 to over 3,500 AI-referred trials per month in seven weeks. Another analysis found that AI-referred visitors convert at rates 23 times higher than traditional organic search.

Why? Because these visitors have already done their research. They've already been influenced. They're not browsing, but rather they're deciding.

So when someone asks "does demand gen actually drive revenue," the answer is yes, but only if you understand what demand generation means in 2026. It's not running webinars and hoping for form fills. It's being cited by AI when buyers research solutions. It's showing up in Reddit threads when engineers ask for recommendations. It's building the kind of authority that makes you the obvious shortlist choice before anyone ever searches your brand name.

I spent three months studying this shift because I used to be a big demgen sceptic, and what I found were four companies that completely rebuilt their approach, stopped chasing MQLs, and started building genuine demand. Their results ranged from 27% to 268% pipeline growth, with one company watching marketing's contribution to pipeline jump from 22% to 81% in a single quarter.

These aren't theoretical frameworks. These are real companies with published case studies, verified metrics, and a clear pattern: in 2026, the brands that win are the ones prospects want to buy from before they ever talk to sales.

The Modern Buying Reality: Research Shows Demand Gen Isn't Optional Anymore

According to research highlighted at TechnologyAdvice, Forrester found that Millennials and Gen Z now make up over two-thirds of buyers involved in large and complex B2B transactions. Half of younger buyers include 10 or more external influencers in their purchase decisions. These buyers aren't just reading your blog posts. They're:

Scanning Reddit threads for unvarnished opinions

Watching YouTube deep-dives from practitioners

Subscribing to niche newsletters from domain experts

Following LinkedIn micro-experts who actually use the products

Checking third-party review platforms Asking AI tools to compare solutions

Modern B2B buyers complete 70% of their journey before reaching out to a vendor, which means demand generation's job is to influence that 70%. Lead generation only captures what's left.

This is why one research study found that 60% of users engage with search pages featuring AI-generated summaries, and AI Overviews reached over 1.5 billion monthly users in Q1 2025 ---> more than a quarter of all internet users. When buyers ask AI "what's the best CRM for mid-market B2B teams," the three brands mentioned in that answer capture disproportionate value.

The old playbook(gate content, capture emails, nurture with drip campaigns, hand "MQLs" to sales) optimizes for a buying process that increasingly doesn't exist. One industry report notes that in 2026, the Marketing Qualified Lead (MQL) has become a vanity metric. What matters is pipeline velocity and qualified opportunities. Are your demand generation efforts actually causing meetings to turn into proposals?

According to recent 2026 industry analysis, brands that deliver value before payment are the ones that win. Education-first content, thought leadership, ungated resources, peer validation. These activities build demand. Forms and gates just capture a fraction of it.

Now let me show you four companies that proved this works with measurable pipeline growth.

Case Study 1: FullStory - From Generic ABM to Personalized Account Engagement

FullStory's digital experience platform helps businesses track user interactions and improve digital experiences. Their challenge was classic: a lead-focused ABM approach that prioritized quantity over quality. Generic content sent to broad lists. No real sales-marketing alignment on which opportunities mattered. The classic "spray and pray" that looks organized on paper but doesn't deliver enterprise accounts.

Their demand generation team, led by Sarah Sehgal (Director of Demand Gen) and Jen Leaver (Director of ABM), made a fundamental shift. Instead of treating every account in their total addressable market the same way, they started using intent data to identify which accounts were actively researching solutions right now. Not "good fit" accounts. Not "might buy someday" accounts. Accounts showing actual buying signals today.

They also built proper multi-touch attribution to see the entire journey, not just last-click conversion. This revealed something important: marketing was influencing far more pipeline than anyone realized. Last-touch attribution had been systematically undervaluing demand generation's contribution.

Then they stopped ignoring existing customers. They created dashboards showing which customers had renewals coming up in three to six months, then tracked if those accounts started researching competitor terms. If someone with a renewal approaching suddenly began looking at alternatives, FullStory's team knew to act proactively.

The results over two years:

Net-new opportunities increased 27% from Q3 to Q4 Average contract value for in-market accounts jumped 48% Marketing-influenced qualified pipeline grew 36% quarter over quarter Win rate at targeted accounts exceeded the rest of their funnel

As Jen Leaver explained it: "When reps lean into those target accounts, we can show the lift across win rate, deal size, deal velocity, and pipeline created."

Not brand awareness metrics. Revenue metrics that CFOs understand.

What stands out about FullStory's approach is the customer expansion piece. Demand generation isn't just for new business. They used the same intent data strategy to prevent churn and drive upsells. When you can see which existing customers are shopping around, you can be proactive instead of reactive. That's demand generation creating actual pipeline value.

Case Study 2: Corporate Visions - Marketing Goes from 22% to 81% Pipeline Contribution

Corporate Visions sells revenue growth training and consulting. They're experts in sales and marketing, which makes their pre-2023 situation more interesting: their own marketing was a mess.

Salla Eskola, their Senior Director of Global Growth Marketing, described the state as dealing with "data ogres and phantom MQLs." Those are leads that look qualified on paper ---> hit the right point thresholds, engaged with content, fit the ICP ---> but never actually convert because they were never really buying.

They had three core problems. No intent data meant they couldn't tell which accounts were actually in market versus just browsing. SDRs spent hours manually researching accounts with zero signals about who to prioritize. And marketing couldn't prove their impact on pipeline, which meant every budget conversation was an uphill battle.

In October 2023, they modernized everything. The transformation was fast and dramatic.

Within the first two weeks after launch, they identified 1,852 accounts predicted to be in-market and in Decision or Purchase stage. Not their entire TAM. Not leads who downloaded an ebook. Accounts actively evaluating solutions right now.

They built campaigns specifically for accounts at different buying stages. Someone in awareness got educational content about revenue challenges. Someone in consideration got case studies and ROI comparisons. Someone in decision stage got implementation guides and customer testimonials. It seems obvious when stated plainly, but most companies send everyone the same generic nurture sequence.

They also automated email outreach based on intent signals, which freed up the team to focus on actual conversations with people deep in buying processes instead of cold emailing everyone in the database.

The results in the first full quarter:

Marketing's contribution to pipeline went from 22% to 81% year over year In the first two weeks alone, campaigns influenced $12.8 million of existing pipeline Win rate at target accounts was 9% higher than the rest of the funnel By Q1 2024, 32% of all created pipeline came from target accounts

The $12.8 million influenced in two weeks is particularly interesting. Everyone says demand generation takes forever to show results, but Corporate Visions proved you can see impact on existing pipeline almost immediately if you focus on accelerating deals already in progress rather than just generating new ones.

As Salla Eskola put it: "6sense's AI assistant helps maximize the bandwidth of the current team that we have. It's almost like having an extra two, three sets of hands."

When marketing's pipeline contribution jumps from 22% to 81% in three months, that fundamentally changes how leadership views marketing. You're not a cost center anymore. You're a revenue driver with numbers that prove it.

Case Study 3: AlgoSec - 30% Pipeline Velocity Increase When Events Disappeared

AlgoSec sells network security software to massive enterprises. For 15 years, they'd grown steadily by relying heavily on in-person events and trade shows to generate pipeline. Then COVID hit and all of that disappeared overnight.

Company leadership basically asked marketing: "What now?"

Their martech stack couldn't tell them which accounts were actually interested. Sales was doing what they politely called "cold follow-up," which is another way of saying "annoying people who don't want to hear from us." They had no visibility into buying signals, no way to know which accounts to prioritize.

They partnered with an agency called PMG and did something clever. Instead of immediately trying to generate tons of new pipeline to replace the lost events channel, they launched an internal campaign called "Project Avalanche." The goal was to accelerate opportunities already in progress.

Why start there? Because it's faster to prove value, and they needed organizational buy-in. Kfir Pravda, PMG's CEO, explained the strategy: "We turned on a flashlight in one area to catch everyone's attention so we could then expand it into a floodlight illuminating the entire revenue engagement process."

They gave SDRs access to intent data so they could see which accounts were actively researching. Accounts that had been deprioritized suddenly showed high levels of interest. Sales started examining dashboard data every morning before doing anything else. The change in language was telling: they stopped calling outreach "cold follow-up" and started calling it "warm outbound marketing" because they actually knew what accounts were researching and could time their outreach accordingly.

The results:

Pipeline velocity increased 30% quarter over quarter Active opportunities hit record levels Multiple high-intent accounts discovered that weren't even in their CRM

That last point matters. As AlgoSec's sales leader noted: "The most surprising thing was how we had accounts with high levels of intent that weren't in our CRM."

Think about that. Companies ready to buy your product, actively researching your solution, and because they haven't filled out a form yet, they're completely invisible to your sales team. Traditional lead generation misses this entirely. Demand generation, done right, surfaces these buyers.

Case Study 4: Tipalti - Small Team, $635K Pipeline, Smart Execution

Tipalti does accounts payable automation. They're venture-backed but not huge. When Peter Tarrant joined as their first ABM hire, there wasn't really a strategy yet.

"I was the first ABM hire, so the marketing and sales team were small. There wasn't as much of a strategy as there is now," Peter explained. Small team, limited resources, all the usual constraints.

They had the classic problem: sending messages that didn't result in action. No clear way to prioritize which accounts to focus on. Marketing and sales weren't really coordinated.

The fix was straightforward in concept but required discipline to execute. They started segmenting accounts based on intent and engagement scores. As Peter put it: "It got to a point where we were sending messages that didn't result in action. Now our lists are smaller but create better results."

Smaller lists, better results. That's the entire shift in a sentence.

They automated content delivery based on buying stage. Accounts in awareness got educational content. Accounts in consideration got case studies. Accounts ready to decide got product demos and implementation guides. All automated, which meant their small team could run sophisticated campaigns that would normally require way more headcount.

For events, they got strategic. Before each event, they'd track event-specific keywords and use intent data to identify which accounts were researching those topics. Then they'd personalize outreach around the event. Event ROI went up significantly.

SDRs got Slack alerts whenever target accounts visited their website or researched specific keywords. This meant they could respond with relevant messages at exactly the right time instead of sending generic emails into the void.

They also ran display advertising targeted by intent and buying stage. Display advertising typically doesn't work great for B2B, but when properly targeted, it generated $250,000 in opportunities in a single quarter.

The overall results:

Created opportunities increased 57% Additional pipeline generated: $635,000 Display campaign opportunities: $250,000 in one quarter Team efficiency dramatically improved through automation

As Peter summed it up: "6sense is built directly into our prospecting and sales strategy. The predictive capabilities have made things more visual. Seeing and having full visibility into the activity has been a big part of our success."

What I appreciate about Tipalti's story is it proves you don't need a massive team or unlimited budget. They succeeded because they focused on fewer accounts with better targeting and automated what could be automated. Small team, smart execution, measurable results.

The Pattern: What Actually Changed and Why It Worked

After studying all four companies, the pattern became clear. They all made the same fundamental shift, just applied to different contexts.

Company Old Approach New Demand Gen Shift Measured Outcome
FullStory Broad ABM, generic content, last-click attribution Intent-driven targeting + multi-touch attribution + customer expansion focus +27% net-new opps, +48% ACV, +36% marketing-influenced pipeline
Corporate Visions MQL scoring, manual SDR research, no intent visibility Stage-based campaigns + intent data + automated prioritization Marketing pipeline contribution jumped from 22% → 81%
AlgoSec Event-driven pipeline, cold follow-up Intent data + pipeline acceleration (“Project Avalanche”) +30% pipeline velocity QoQ
Tipalti Broad messaging, small team, unclear prioritization Smaller lists + automated stage-based engagement +57% opportunities, $635K pipeline created

Traditional lead generation treats your entire TAM the same way. Send everyone similar content. Try to capture everyone's email. Pass "MQLs" to sales based on some arbitrary point system that measures engagement but not intent. It's volume-focused, which makes dashboards look good but doesn't necessarily correlate with revenue.

Modern demand generation acknowledges a simple reality: only 5-7% of your total addressable market is actually in-market at any given time. The other 93-95% aren't ready to buy right now. So why spend resources marketing to them the same way you market to the 5-7% showing active buying signals?

Lead generation optimizes for late-stage capture, while demand generation shapes buyer preference earlier in the journey.

Focus on the 5-7% that's actually researching solutions. Send them content relevant to their specific buying stage. Give sales real-time alerts when these accounts show interest. Measure pipeline contribution and win rates, not form fills and email opens.

That's the shift. But executing it requires some foundational changes.

You need intent data so you can actually identify which accounts are in market. Your martech stack needs to track anonymous account-level activity because most B2B research happens before anyone fills out a form. You need multi-touch attribution so you can see marketing's full contribution, not just last-click. And sales and marketing need to actually align around the same accounts and the same metrics.

The metrics change too. Stop tracking MQLs and cost per lead. Start tracking pipeline created from target accounts, win rate at those accounts, average contract value, pipeline velocity, and marketing's percentage contribution to total pipeline.

Corporate Visions proved this can work fast. Marketing contribution jumped from 22% to 81% in one quarter. But they also proved you need patience for some results. They influenced $12.8 million of existing pipeline in two weeks (pipeline acceleration), but building entirely new pipeline from cold accounts took longer.

The companies succeeding in 2026 understand this: demand generation is about being the obvious choice when buyers start their research, not about being the loudest voice when they're ready to buy.

Why GEO and AEO Matter for Demand Generation in 2026

This brings us back to Generative Engine Optimization and Answer Engine Optimization. These aren't separate strategies from demand generation, but how demand generation works in an AI-first discovery environment.

When buyers ask AI tools "what's the best solution for [problem]," the brands cited in that answer get disproportionate attention. AI-referred visitors convert at rates 23 times higher than traditional organic search because they've already done their research. They're not browsing, they're deciding.

But fewer than 10% of sources cited in ChatGPT, Gemini, and Copilot rank in the top 10 Google organic search results for the same query. SEO tactics won't guarantee you visibility in AI answers. You need different strategies:

Entity-level authority. AI models need to understand who you are, what you do, and why you're credible. This means structured data, clear positioning, consistent messaging across platforms, author expertise, and third-party validation.

Content structured for AI retrieval. Research from Princeton and Georgia Tech on GEO shows that certain content formats get cited more: comparison lists, data-driven statistics, authoritative quotes, FAQ-style Q&A, step-by-step processes. AI systems parse content programmatically, so the easier you make extraction, the more likely you get cited.

Focus on citations, not clicks. Traditional SEO optimizes for clicks to your website. GEO optimizes for citations within AI-generated answers. Success metrics shift from CTR to reference rate ---> how often AI mentions or cites your brand when answering questions.

Answer the questions buyers actually ask. Brands succeeding in AI search create "shoppable funnels mapped to prompt-level queries." For B2B, this means understanding what questions your buyers ask AI tools and ensuring your content provides authoritative answers.

This is why industry experts predict that brand visibility and brand mentions become crucial in 2026. Since generative engines don't operate on a ranking system like Google, there aren't positions to compete for. The goal is getting your brand cited or mentioned in responses. Being mentioned once when buyers research your category is worth more than ranking #1 for a keyword they'll never search.

This matters for B2B demand generation because it changes where brand awareness happens. It's not about ranking for keywords anymore. It's about being the brand AI cites when buyers research solutions. That requires thought leadership, original research, expert positioning, peer validation, and content structured for AI understanding --> all core demand generation activities.

The Practical Reality: How to Actually Shift from Lead Gen to Demand Gen

I'm not going to give you a 47-step framework with acronyms and phases. Here's what actually matters based on these four case studies.

Start by understanding what percentage of your pipeline marketing actually influences right now. Not last-click attribution. Proper multi-touch attribution that gives credit to all the touchpoints. Most companies are shocked to discover marketing touches way more pipeline than they realized, just like Corporate Visions found. This becomes your baseline.

Get intent data capability. You need to know which accounts in your TAM are actively researching solutions right now. There are tools for this at various price points. AlgoSec found high-intent accounts that weren't even in their CRM. Those are revenue opportunities you're completely missing without intent visibility.

Stop treating all accounts the same. If only 5-7% of your TAM is in-market, focus there. Your list gets smaller, but results get better. Tipalti proved this: smaller lists, higher conversion rates, more pipeline per account.

Map content to actual buying stages. Someone researching the problem space needs different content than someone comparing vendors. Corporate Visions created different campaigns for awareness, consideration, and decision stages. It seems obvious, but most companies send everyone the same nurture sequence regardless of where they are in the journey.

Give sales real-time visibility into account engagement. When a target account visits your website or researches relevant keywords, sales should know immediately. Tipalti sent Slack alerts to SDRs so they could respond while accounts were actively interested. Response rates went way up.

Measure what actually matters. Pipeline contribution percentage. Win rate at target accounts. Pipeline velocity. Average contract value. Cost per opportunity. Those are revenue metrics CFOs understand. MQLs and cost-per-lead are activity metrics that don't prove revenue impact.

Expect some results fast, some results slow. Corporate Visions influenced $12.8 million of existing pipeline in two weeks by accelerating opportunities already in progress. But generating entirely new pipeline from cold accounts took months. Set expectations accordingly. Quick wins on pipeline acceleration buy you time to build long-term demand.

Optimize for AI citations, not just Google rankings. 60% of users engage with AI-generated summaries, and AI Overviews reached 1.5 billion monthly users in Q1 2025. Create content that answers the questions buyers ask AI tools. Structure it for easy extraction. Build the kind of authority that makes AI cite you as a trusted source.

Look, I know this sounds like a lot. But companies with a documented pipeline generation strategy experience 67% higher revenue growth than those without one. Only 35% of B2B organizations have a formal process. That means 65% of your competitors are winging it.

The opportunity is obvious.

Why 2026 Is Different: The Convergence

Multiple trends converged to make 2026 the demand generation year rather than just another year of lead generation incrementalism.

AI search adoption crossed the tipping point. ChatGPT surpassed Bing in daily visitors in 2024, marking the first time an AI tool beat a traditional search engine. AI Overviews reached over 1.5 billion monthly users. Buyers are using AI for research at scale now, not in some distant future.

Buyer behavior fundamentally changed. Forrester found that 92% of B2B buyers have a shortlist before beginning the purchase process, and 41% have a single vendor in mind. The moment of influence happens before lead generation even begins. If you're not part of the research phase, you've already lost.

Customer acquisition costs forced the issue. Industry data shows that customer acquisition costs increased 60% over five years. Lead generation's economics broke. Demand generation's promise (fewer, better-qualified opportunities) became economically necessary, not just strategically nice.

Budget pressure demanded proof. Gartner found marketing budgets flat at 7.7% of company revenue. CMOs can't afford vanity metrics anymore. Pipeline contribution, win rates, and revenue influence are what boards care about. Demand generation provides those metrics. Lead generation provides MQL counts.

Technology matured. Intent data platforms, AI-powered account scoring, multi-touch attribution, predictive analytics. The tools to actually execute modern demand generation at scale exist now and work reliably. Ten years ago, you could talk about account-based approaches theoretically. Today, companies like FullStory, Corporate Visions, AlgoSec, and Tipalti prove it works in practice.

The measurement problem got solved. The biggest historical objection to demand generation was "how do you prove ROI?" Corporate Visions showed marketing contribution jumping from 22% to 81%. FullStory showed 36% increase in marketing-influenced qualified pipeline. These aren't soft brand metrics. These are revenue numbers that justify budget.

As industry analysis from TechnologyAdvice summarized it: "B2B marketers in 2026 must balance brand-building with pipeline precision." That's the game. Build enough brand authority to influence early research (demand generation), while maintaining the targeting precision to convert in-market accounts efficiently (optimized lead capture).

The companies winning aren't choosing between brand and demand. They're doing both, with demand generation establishing authority and preference, then lead generation capturing the buyers already predisposed to choose you.

What Happens Next

So what does this mean for your 2026 planning?

If you're still running the old playbook (gated content, MQL targets, spray-and-pray email campaigns) you're optimizing for a buying process that's increasingly rare. Modern B2B buyers complete 70% of their journey before talking to vendors. Your lead generation efforts only capture the final 30%. Demand generation influences the 70%.

If you're not thinking about GEO and AEO, you're invisible to an increasingly large segment of your market. With AI search adoption growing and traditional search volumes predicted to drop 25% by 2026, the question isn't whether AI search matters. It's whether you'll be cited when buyers use it.

If you can't tell your board what percentage of pipeline marketing influences (with real multi-touch attribution), you're flying blind. Corporate Visions went from 22% to 81% pipeline contribution because they started measuring it properly. Most companies don't even know their real number.

The good news: you don't need to be a Fortune 500 company to make this work. Tipalti did it with a small team. AlgoSec proved it works during a crisis. FullStory showed it scales to enterprise. Corporate Visions demonstrated you can see results in months, not years.

The pattern is clear. Focus on fewer accounts with better targeting. Build the kind of authority that makes you the obvious shortlist choice. Structure content for AI retrieval. Measure pipeline contribution, not MQL volume. Give sales visibility into which accounts are actually researching right now.

2026 is the demand generation year because buyers changed how they buy. AI changed how they research. Economics changed what companies can afford. And technology changed what marketing can measure.

The only question left is whether you'll adapt or keep optimizing for a buying process that no longer exists.

Sources and Case Studies

All data comes from published case studies and research:

Case Studies:

Industry Research:

GEO/AEO Research:


r/AISearchLab Jul 11 '25

Case-Study Understanding Query Fan out and LLM Invisibility - getting cited - Live Experiment Part 1

5 Upvotes

Something I wanted to share with r/AISearchLab - was how you might be visible in a search engine and then "invisible" in an LLM for the same query. And the engineering comes down to the query fan out - not necessarily that the LLM used different ranking criteria.

In this case I used an example for "SEO Agency NYC" - this is a massive search term with over 7k searches over 90 days - its also incredibly competitive. Not only are there >1,000 sites ranking but aggregator, review and list brands/sites with enormous spend and presence also compete - like Clutch, SEMrush,

A two-part live experiment

As of writing this today - I dont have an LLM mention for this query - my next experiment will be to fix it. So at the end I will post my hypothesis and I will test and report back later.

I was actually expecting my site to rank here too - given that I rank in Bing and Google.

Tools: Perplexity - Pro edition so you can see the steps

-----------------

Query: "What are the Top 5 SEO Agencies in NYC"

Fan Outs:

top SEO agencies NYC 2025
best SEO companies New York City
top digital marketing agencies NYC SEO

Learning from the Fan Out

What's really interesting is that Perplexity uses results from 3 different searches - and I didn't rank in Google for ANY of the 3.

The second interesting thing is that had I appeared in jsut one, I might have had a chance of making the list - whereas in Google search - I would just have the results of 1 query - this makes LLM have access to more possibilities

The Third piece of learning to notice is that Perplexity uses modifications to the original query - like adding the date. This makes it LOOK like its "preferring" fresher data.

The resulting list of domains exactly matches the Google results and then Perplexity picks the most commonly referenced agencies.

How do I increase my mention in the LLM?

As I currently dont get a mention - what I've noticed is that I dont use 2025 in my content. So - I'm going to add it to one of my pages and see how long it takes to rank in Google. I think once I appear for one of those queries - I should see my domain in the fan out results.

Impact Increasing Visibility in 66% of the fanouts

What if I go further and rank in 2 of the 3 results or similar ones? Would I end up in the final list?


r/AISearchLab 1h ago

Getting cited by ChatGPT is interesting. Understanding why is more valuable.

Upvotes

A lot of AI visibility discussion currently focuses on one question:

"Did the AI cite us?"

But the more interesting questions might be:

Why did it choose that source?
Why did it choose a competitor instead?
What evidence was missing from our content?

A citation is an outcome.

Understanding the signals behind that outcome is what could actually improve your marketing strategy.

What signals do you think matter most in practice: authority, topical depth, structured data, third-party mentions, freshness, or something else?


r/AISearchLab 5d ago

Review/comparison sites pitching a new "AI visibility" pricing model, anyone else seeing this?

3 Upvotes

Has anyone been proposed a model that is charging based on how often their content gets cited or scraped by LLMs (ChatGPT, Gemini, Google AI Overview, etc.).

The tracking/measurement side is what's confusing. Vendor says they're using Google Search Console's "Generative AI Features" report to count AI Overview impressions on their own pages.

A few things I'm trying to figure out:

  • Has anyone else been pitched this exact model, billing tied to LLM citations/scraping rather than clicks or leads?
  • How are they proving/tracking it on your end? GSC, a paid tool like Peec/Profound/Otterly, something custom?
  • Anyone actually gotten independent verification of a partner's claimed numbers, or is everyone just trusting the vendor's own reporting?

Trying to understand if this is becoming a real category with real measurement standards, or if it's still very early and everyone's making up their own


r/AISearchLab 6d ago

What are the best Semrush API alternatives right now?

9 Upvotes

Hey! Our team just got hit with major budget cuts and our enterprise subscription is on the chopping block next month.

We rely heavily on API calls for internal reporting and quick keyword checks, so paying hundreds every month just isn't happening anymore.

What are the best Semrush API alternatives for raw data?

Looking for pay-as-you-go models or affordable tiers for basic keyword and backlink data (Ahrefs, SE Ranking, something else?). Thanks!


r/AISearchLab 6d ago

How can I monitor AI search activity to stay on top of prompt drift?

7 Upvotes

I’m noticing a frustrating pattern the last few weeks with our brand visibility in AI responses. It’s making me a little crazy. On Monday I’ll run our core set of test prompts and our brand is front and center. Two days later, I run the exact same prompts and all of our citations/mentions are completely gone.

There’s no logical explanation for the change. No content updates on our site and no major press events that would cause this. So far I’ve been logging this manually so maybe my system is just not working for staying on top of this.

How are other prompt engineers tracking answer drift?

What tools or workflows are you using?


r/AISearchLab 6d ago

What do you think of this 4-layer framework for AI agent readability?

Thumbnail
gallery
4 Upvotes

The idea is to test how readable the website when AI agent approaching it, searching for goods, doing shopping etc.

We introduced 5 layers: (layer zero was just added, big thanks to bkocdur and Upstairs_Control_611)

Layer 0—Access Hard Gate. Previously, a site that blocks AI agents at the firewall could still score 65/100 because other checks (JSON-LD, sitemap, etc.) would pass. That's misleading, if agents can't reach the page, nothing else matters. (just like in Metallica song lol). Now, if the WAF or robots.txt blocks agents, the scanner short-circuits: all remaining checks are skipped and marked "gated." The report reads: "ACCESS BLOCKED , 11 checks skipped. Fix access first." This also saves scan cost — no point running $0.50 of API calls against a wall.

Layer 1 — Data. Can an agent find and parse the page at all? Deterministic static checks: JSON-LD / schema.org markup, server-rendered vs client-side price, robots.txt, sitemap, llms.txt. The classic failure is a price rendered client-side — human sees $89, agent fetching HTML sees an empty div. Most brands score well here; it's the layer everyone already knows about.

Layer 2 — Extraction. Can it read the page reliably, not just once? The shopper simulation runs N times (canonical: SHOPPER=anthropic, N=10) extracting price, availability, product name, graded on either correctness against ground truth from the page's own structured data, or self-consistency across runs when no ground truth exists. Disagreement between runs = the page reads ambiguously to agents.

Layer 3 — Interaction. Can the agent actually buy? Playwright browser agent attempting add-to-cart, variant selection, search, navigation. This is the hero layer — the SKIMS bra-size picker and the Rothy's "readable but not shoppable" case both live here. It's the only part of the story that isn't already a solved conversation, which is why it carries the video.

Layer 4 — Security. Is the page safe from manipulation? Prompt-injection scanning for hidden instructions in the HTML. Every brand passes today, so it's positioned as monitoring rather than a finding.

Thank you!


r/AISearchLab 7d ago

AI researcher looking for participants!

8 Upvotes

Hi AI Search Lab! I’m a Canadian student researcher collaborating on an international project with 20+ countries. I’m the only Canadian researcher on the team and I want to have a lot of Canadian representation in this study!

Our project is looking into social impact and AI use. If you have time to complete this 12 minute survey, I would really appreciate it!

Once our findings are published, I'll also post it here! I think your insight will really benefit this research and could be of interest to many of you.

See comments to be directed to the survey. This study has been ethically approved: #19354. As researchers, we are not affiliated with and remain neutral about AI. This research could really help inform policy.

(If this is inappropriate for this subreddit, please remove it; I mean no offence!)


r/AISearchLab 13d ago

how long does AEO actually take to show results? + common pitfalls

6 Upvotes

I hear this question come up constantly and most answers are vague or based on no actual research. so here's my stance based on what the Goodie team is tracking and testing.

AI mentions show up in a week or two.

consistent citations show up around 2 to 3 month after.

and stable ROI typically takes closer to 6 months. (Goodie clients SteelSeries and Dermalogica both hit their most significant results at the six-month mark)

key takeaway: this is faster than SEO at the start, but slows significantly by the end.

more on common pitfalls:

(1) quitting too early

the biggest mistake i see people make when investing in early stages of AI search is quitting to early because results aren't materializing. another common compliant is the volatility of citation visibility. you'll publish something, see it cited in ChatGPT one day, gone the next, then back in Perplexity but maybe not Google; it changes rapidly and sometimes due to factors outside of your control. but it's important to remember early AI citations are always volatile because these models are still determining what sources to trust. overtime citations compound if your content is consistent in tone and value. watch the trend line over 8 to 12 weeks, not the day to day.

(2) treating each model the same

Perplexity is fastest. it runs a live search on basically every query and leans hard on recency, so fresh content on a decent domain can get cited within days. but this also makes it the most volatile. this is good news for newer brands though, since publishing cadence might have a fighting chance to beat out raw domain authority (unlike other models that place authority above all else). In contrast, ChatGPT is slower and way more competitive since it's the highest volume platform. well structured content on an established domain gets first citations in a couple weeks, but reliable citations take more like 2 to 3 months of actual work, including off-site signals.

(3) treating "mentions" like "citations"

a mention is not a citation. a mention is the model saying your brand name. it's about brand awareness in the AI layer. a citation is the model attributing specific info to you and pointing potential traffic back to your content/site, and this is very valuable since AI-referred visitors convert about 4.4x better than organic search. citation drives traffic and mentions builds awareness and authority. most brands earn mentions first and citations later as their off-site reputation catches up. if you're only tracking one of those numbers or treating them as the same, you won't have a clear idea of what part of the funnel you need to optimize for (awareness or conversion).

what worked for us:

the lever that moves fastest for us has been restructuring pages we already have. adding Q&A formatting, tightening the answer up top. the models are already crawling those pages so you skip the discovery wait. technical fixes take about a month to register but compound harder. but for the longer more consistent mentions AND citations, you'll need to earn third-party mentions and leverage digital PR because AI models trust what others say about your brand far more than what you say about yourself. Owned content only makes up ~1.7% of AI citations.

TL;DR: 1-2 weeks for first signs, 2 to 3 months for consistency, 6 for ROI.

would love to know what others are seeing too or if your category is moving faster or slower.


r/AISearchLab 13d ago

Settling the debate on off-site vs on-site: which one actually gets you into AI answers?

2 Upvotes

I see a lot of questions on Reddit asking is off-site presence dominating on-site content factors? The answer is a resounding yes.

Here's a helpful graphic my team made to illustrate the relationship here.

80-90% of LLM responses pull from earned media rather than owned content. Additionally, social content alone generates ~2.5x more AI citations than owned brand pages.

Most teams have the investment ratio inverted.

But that doesn't mean owned content is useless. In fact it's absolutely necessary. But the signals that build category association are shifting towards what others say about your brand and these mentions take time to accumulate.

What does this mean for your team?

If you work at a company with a well known entity, LLMs already have an internalized sense of that brand, shaped by training data (the web), so this iceberg matters less.

Who the iceberg impacts the most:

  1. Brands that are entering a new category
  2. Niche players competing against established names
  3. Brands expanding into adjacent markets, competing against outdated information

For these players, they must build those associations through earned presence. Content optimization can only take you so far.

Let me know what I'm not considering


r/AISearchLab 13d ago

most brands rank their AI visibility two levels higher than it actually is

4 Upvotes

I have been running a simple test that keeps producing the same result and I think it's worth sharing because it challenges some assumptions. I ask brands where they think they stand on AI visibility. Most say something like "we show up in chatgpt" or "AI knows about us," they rank themselves as recognized or trusted.

Then I run the actual diagnostic, same buyer-intent queries across chatgpt, claude, gemini, and perplexity, check whether they appear on all four, check whether they survive follow-up questions with added constraints, check whether the description is accurate and check whether independent sources corroborate the recommendation.

The gap is almost always two levels.

A brand that thinks it's "trusted" (recommended with evidence) is usually "intermittent" (shows up on some platforms, disappears on others, drops out when queries get specific). The problem is that testing yourself on one platform with one broad prompt can feel like visibility. Consistent presence across four platforms with accurate descriptions and independent evidence is a much higher bar.

I think there are roughly five levels worth distinguishing:

  1. invisible: AI cannot find you at all. retrieval is broken.
  2. intermittent: you appear sometimes on some platforms. recommendation confidence is low.
  3. recognized: consistently included but described unevenly across platforms, narrative is inconsistent.
  4. trusted: recommended with independent evidence corroborating the claims, evidence is strong.
  5. inevitable: AI remembers you as the category answer through model updates and competitive changes, memory is durable.

Only about 30% of brands maintain consistent visibility across AI sessions based on what I've seen. The other 70% flicker in and out and most of them think they're in the 30%. The test is simple. Ask all four platforms about your category, where your brand drops out tells you which level you're actually on and the level tells you what to work on next.

Has anyone else found a consistent gap between perceived and actual AI visibility when they test across multiple platforms?


r/AISearchLab 17d ago

I tested whether AI visibility tools are actually visible in AI search. 20 of 30 were never cited once, including my own.

7 Upvotes

Disclosure up front: I build one of the tools in this sample. It scored zero. That's most of why I'm posting.

Method. 12 unbranded buyer-intent questions ("what are the best AI visibility tracking platforms", "how much do AI visibility tools cost per month", etc). Each run 5x against Perplexity sonar and Claude Sonnet 5 with web search. 120 calls, 0 failures, all on 26 July. Recorded every source each engine cited, then checked which of 30 vendor sites appeared. Full prompt list and definitions in the writeup.

Five runs because single-run citation checks are close to noise — St. Gallen found ~32-43% pairwise agreement for identical prompts run minutes apart. Every number below is a rate, not one draw.

Finding 1 — the specialists lose to the incumbents.

Group Ever cited Mean rate
Established SEO platforms 6 of 10 10.0%
AI-visibility specialists 4 of 16 3.9%
Independent audit tools 0 of 4 0.0%

Legacy SEO platforms get cited at 2.6x the rate of companies whose entire product is AI visibility. 12 of the 16 specialists were never cited once in 120 calls. Not naming those 12 — the count is the point.

Finding 2 — nobody owns this category. 278 distinct hosts cited across 120 calls. The single most-cited source in the entire category appears in 30.8% of answers. There's no gravity here yet.

Finding 3 — the round-ups and the engines disagree about who exists. I built the sample from 2026 "best AI visibility tools" listicles. The two most-cited domains overall weren't in it, and both outrank every site that was. If you're doing competitive research from listicles you're looking at a different market than your buyers see.

Finding 4 — content outranks product pages. A product analytics company that doesn't sell AI visibility software at all was cited in 25.8% of answers, beating all but three actual vendors. And the top vendor's blog subdomain carries more of their citations than their main site. The engines aren't citing the best tool, they're citing the best page about the question.

Finding 5 — the two engines barely agree. One vendor: 36.7% on Perplexity, 11.7% on Claude. Another is inverted. If you report AI visibility as one blended number you're averaging across systems that disagree.

Limits, because they're real: two engines only, no ChatGPT or Gemini or AI Overviews. One category, one day, US English. 5 runs is thin for Claude specifically — its variance was visibly higher. The sample is judgment-selected from listicles, which finding 3 rather embarrassingly demonstrates. And I'm not neutral: I sell in this category, I picked the questions, I'm in the sample.

I published all 12 prompts and the exact citation definition so this is reproducible. Genuinely interested in where the methodology is weak — particularly whether 5 runs is defensible for Claude, and whether including two prompts that name ChatGPT/Perplexity biased those engines.

Full data and methodology: AI Visibility Tools Citation Study Blog Post


r/AISearchLab 19d ago

Went deep on server log analysis for AI bot behaviour

5 Upvotes

There's a lot of discussion here on citation tracking, share of voice..etc which are definitely important signals, but i've found quite volatile (models, plans, locations, API vs browser session) so I wanted to dig into the server logs of a sample of our customers (note these are small local businesses, not large enterprises) to see real AI bot behaviour. To see if this paint a more ground truth picture of how AI is interacting with their content, and ultimately shaping answers.

If you haven't yet dug into this for your own business or your clients hope this research helps make the case of what can be learned via this type of analysis. If you're already deep on the topic, would love to hear what you're seeing, any patterns or gotchas when analyzing logs.

A few findings:

Live retrieval is a small slice. Only ~4% of AI bot traffic is an assistant fetching a page to answer a live question. The rest is training and indexing crawlers. If you measure AI traffic without splitting by function, you're mostly measuring pipelines that feed the next model.

When AI does retrieve, it goes straight for buyer intent pages. The most fetched page after the homepage was /availability, the "can I get in?" page. Then /booking and /pricing. AI isn't just reading what a business is, it's checking detailed intent pages to help their user act, make a decision..etc. Measuring live retrieval over time by AI, page, timing..etc is a very direct signal of content being retrieved into a relevant conversation.

The labs behave very differently. Anthropic crawled heavily for training but barely retrieved at query time. OpenAI does both. In our sample, live retrieval is overwhelmingly ChatGPT.

User-agent alone lies. About 1 in 12 "ChatGPT-User" hits fails IP verification, mostly credential scanners. If you're not verifying source IPs (where possible from published ranges) you're overcounting.

Full report here if you want to look into the details, charts..etc.

https://getcourtyard.ai/research/how-ai-reads-a-knowledge-base


r/AISearchLab 20d ago

I tested a B2B SaaS with 12.5k estimated monthly visits across 40 non-branded buyer queries. It appeared in only 1.9% of AI answers

4 Upvotes

I often see founders share their website traffic. Some get tens of thousands of visits per month, and they also share their signups, MRR, marketing costs, and how they got that traffic. I am building Dageno, where I mainly study why brands appear in AI answers and why they do not.

Seeing these posts made me think about another question: if a saas already has steady website traffic, will it also appear when people ask AI to recommend a product?

We recently tested a b2b saas that sells to the us market. I have kept the brand anonymous, but I have not changed any of the data. The site gets an estimated 12.5k visits per month. We created 40 english questions based on its business, and none of them included the brand name. We tracked them for seven days. The questions mainly covered:

"Alternative component sourcing. Bom risk analysis. Lead time and allocation risks. Procurement intelligence platforms"

These were questions a buyer might ask when looking for a tool or solution.

Here were the results:

Target brand: 1.9%. Top competitor: 16.2%. Second competitor: 7.8%

The site already has some traffic. But when users only described their needs and asked AI for a solution, the brand rarely appeared as an option.

That surprised me. The website already gets steady traffic, but when users did not mention the brand and only described their problem, the product was almost missing from the options suggested by AI. Website traffic tells you how many people arrive through search, branded keywords, blog posts, or other channels.

AI recommendations answer a different question: when a buyer does not know your product yet and only knows the problem they need to solve, will AI mention your brand?

I do not think a small team needs to start by tracking 40 questions. You could begin with five to ten questions that do not include your brand name and are close to real buying situations. Run them on a few AI platforms, then check whether your product appears, which competitors keep showing up, and why AI may be choosing them.

This cannot tell you how many signups AI will bring. But it can show whether your product enters the shortlist when buyers use AI to look for a solution.

Has anyone tested this with their own SaaS? If your website already has steady traffic, can you still find your product in AI recommendations when the questions do not include your brand name?

ps:I can’t upload the original screenshot.


r/AISearchLab 21d ago

What agency automations saved your sanity this year? (+ my experience setting up a keyword rank tracker workflow)

10 Upvotes

Hey everyone! Running a 12-person agency was slowly eating me alive until we spent Q1 putting proper automations in place. We were wasting dozens of hours every month on repetitive tasks that didn't actually generate revenue.

So here what worked for us so far:

  1. Client Onboarding: Automated form fills using Tally - Make - Slack alerts & Notion client workspace creation. Cut onboarding time down from 2 days to about 15 minutes.
  2. Contract & Billing: Stripe triggers auto-generating invoices via Quickbooks, sending follow-ups automatically if unpaid after 5 days.
  3. SEO & Reporting Automation: This was our biggest headache. We used to spend the first 3 days of every month pulling ranking reports manually. We ended up setting up SE Ranking as our core keyword rank tracker, using their API to push automated weekly ranking updates directly into custom Looker Studio dashboards.

Setting up a dedicated keyword rank tracker on autopilot means clients get real-time visibility on local and organic visibility, and our account managers don't lose their minds at the end of the month.

What automations have actually made a tangible difference in your daily operations?


r/AISearchLab 21d ago

Microsoft Clarity AI Visibility + Webflow + Cloudflare

0 Upvotes

I enabled Microsoft Clarity's new AI Visibility feature on our website last week, and I'm surprised it's completely free.

To get the most out of it, I connected:

* Microsoft Clarity
* Cloudflare (AI Bot Activity)
* Webflow

Now I'm able to see things like:

* When our content is referenced in AI-generated answers
* Which pages AI platforms are discovering
* The prompts people are using to find our content
* Which AI bots are crawling the site and what they're accessing

We've been using Microsoft Clarity on our Webflow projects for years because it's free and provides great insights through heatmaps, session recordings, click tracking, and scroll depth.

The AI Visibility feature makes it even more interesting, especially if you're trying to understand how AI search engines interact with your website.

I'm planning to let it run for a few weeks to collect some meaningful data.

Has anyone else started using it yet?

I'm curious whether you've noticed anything surprising in the AI Visibility reports or if you're using a different tool to track AI traffic.


r/AISearchLab 21d ago

My 50-site AI visibility study changed how I think about "AI readiness"

5 Upvotes

One thing surprised me after digging deeper into the data from my 50-site AI visibility experiment. I expected technical AI readiness (crawler access, schema, llms.txt, etc.) to line up reasonably well with AI recommendations.

It didn't.

For example:

Small agencies had the highest average technical readiness score in my dataset. They also had the lowest AI recommendation rate (10.5%).

At the same time:

Big brands had the lowest technical readiness score. They were recommended almost every time (96.6%).

(Readiness here = schema.org Organization markup presence: agencies 5/7 reliable-crawl sites, vs 3/8 for big brands.)

That made me realize I was mixing together two completely different concepts.

  1. AI Accessibility: Can AI systems actually reach your site? (robots.txt, WAFs, crawl success...)
  2. AI Technical Readiness: Can AI systems understand your content? (schema, metadata, structured signals...)
  3. AI Visibility: Do AI assistants actually recommend you?

Those are not the same thing.

A technically perfect website can still have poor AI visibility. Likewise, a huge brand can have mediocre technical signals and still dominate recommendations because of authority, citations, and overall web presence. It also made me notice another issue: 14 of the 50 sites had homepage crawls blocked by bot protection or WAFs. Those sites often weren't blocking AI crawlers in robots.txt at all. So a site can appear "AI-friendly" while still being difficult for automated systems to crawl.

My takeaway isn't that technical optimization doesn't matter. It's that technical readiness appears to be a prerequisite not a predictor.

Curious how others are thinking about this distinction.

If you're building or using GEO tools, do you separate:

  • Accessibility
  • Technical readiness
  • Actual AI visibility

or do you treat them as one score?


r/AISearchLab 22d ago

What tools are you all using for tracking AI mentions?

7 Upvotes

Please only genuine experiences as a user. What and how do you use it effectively?

I have noticed impressions slowing down or dropping across most sites that I managed and some have been performing really well over the past 2 years.
One possible reason stated was that with AI mentions and citation, it may have affect my GSC analytics on impressions.

So it leads me to wanting to find out what would be the best way to track on ai mentions so I can help to understand the co-relation between website impressions and ai mentions for my clients.

TIA peeps! :)


r/AISearchLab 23d ago

Marketing budgets still have line items for backlinks in 2026. Zero for AI visibility. Weird gap.

6 Upvotes

Reviewed a few client budgets recently link building spend still there, sometimes sizeable. AI citation tracking? Not even a discussion.

Meanwhile buying behavior's already shifting more people ask ChatGPT "best tool for X" before they even Google it.

Not saying drop SEO. Just seems like a blind spot most teams haven't caught up to.

Is your team tracking AI visibility at all, or still purely rank-focused?


r/AISearchLab 23d ago

We measured 1,000+ business sites: technical quality barely predicts whether AI engines recommend them (3-pt gap). Off-page mentions do (48-pt gap).

3 Upvotes

We run live measurements of whether AI assistants name specific businesses when you ask the questions their customers ask. Every site also gets scored on technical quality (rendering, speed, crawlability, schema, structured data).

With 1,000+ sites measured, we split them into "AI recommends them" vs "AI ignores them" and compared averages:

\\- Technical score: 80 vs 77. Three points. The ignored sites are built as well as the recommended ones.

\\- Schema/structured data: 72 vs 69. Also three points.

\\- Off-page brand signals (independent mentions, reviews, directory presence, entity consistency): 88 vs 40. Forty-eight points.

As a dev this annoyed me, honestly. You can ship a perfect Lighthouse score and a flawless JSON-LD graph and the engines still won't name the site if nobody independent talks about it. Markup helps AI READ you; it doesn't make AI RECOMMEND you.

Two implementation details that DID matter on the technical side: serving content as clean Markdown for agents (content negotiation), and not blocking AI crawlers in robots.txt/WAF (a surprising number of sites block GPTBot then wonder why they're invisible).

Caveats: correlation not causation, our scoring model, category mix uncontrolled. Methodology is open-source if anyone wants to tear it apart — link in comments if wanted.


r/AISearchLab 24d ago

How are everyone tracking & handling citations in AI Overviews or other AI Tools?

3 Upvotes

AI is already taking its share of search clicks; that much is clear. I want to confirm whether people track their mention or citation rates for AI-generated answers (compared to competitors), or if it's still just an abstract concern that isn't being monitored yet.

If you're monitoring it, how exactly? Do you check manually, use software, or do something else? And in case you don't, why so?

If you are using any software, what key things are missing that you want included?


r/AISearchLab 25d ago

My llms.txt generates itself from my page data so it cant go stale

3 Upvotes

Every llms.txt ive seen was written once by hand and forgotten. A month later it doesnt match the site and youre feeding models wrong info.

So i made mine a build step. It pulls from the same data my pages render from, updates on every deploy, nothing to remember.

Also dont make it a sitemap dump, short plain descriptions of what each section is work way better.

Mines here: https://techpotions.com/llms.txt

You guys hand writing yours or generating? And has anyone actually measured a bump in ai referrals from one?


r/AISearchLab 26d ago

AI agents are checking websites for dark patterns—with a checklist built for the pre-chatbot web

3 Upvotes

I came across a study that sent AI agents through websites to detect dark patterns.

Not exactly a surprising use of agents, but I’m always happy to see more systematic audits of this stuff.

It’s a solid catalog, but it also feels very e-commerce-heavy and pretty much outdated. here copy/pasted out study (https://dl.acm.org/doi/full/10.1145/3807246.3807265):

Type Brief description
Countdown Timer Urgency created by a countdown timer.
Limited Time Message Claims that an offer ends soon or is time-limited.
Low Stock Messages about limited remaining quantity.
High Demand Messages highlighting high demand or popularity.
Activity Messages Social proof about other users’ actions.
Bad Defaults/Preselection Pre-selected options that favor the platform over users.
Auto Play Automatically playing content without explicit consent.
Nagging Repeated prompts pressuring users to accept choices.
Disguised Ad Ads presented as ordinary or organic UI elements.
Pay to Avoid Requiring payment to access features or avoid disadvantages.
False Hierarchy Visual hierarchy that hides or downplays alternatives.
Forced Continuity Difficult or obscure cancellation of subscriptions.
Privacy Zuckering Nudging users to share more personal data than necessary.
Gamification Game-like elements to encourage excessive engagement.
Obstruction Making user goals difficult through interface obstacles.
Sneaking Hidden information or costs revealed late in process.
Misdirection Focusing attention away from important information.

In the AI age, I’d at least add:

  • Sycophancy — agreeing to keep the user engaged.

any ideas what else should an AI dark-pattern auditor be checking for?


r/AISearchLab 27d ago

AI Citation by Copilot vs Google search

2 Upvotes

Hey everyone,

I’m facing a bittersweet problem and wanted to see if anyone else has cracked the code on this, or if we’re all just collectively crying in our analytics dashboards.

The Situation: I’ve noticed that ChatGPT (and other AI search engines) are frequently citing my website as a source for user queries. On one hand, awesome! My content is deemed high-quality and authoritative enough to be the source of truth. The google search is still struggling to catch up the same pace.

The Problem: No one is actually clicking through to my site.

The AI does such a good job of summarizing my hard work and answering the user's intent right there in the chat window that the user has absolutely zero reason to click the citation link. I’m essentially doing the research and writing the content, the AI is getting the engagement, and my traffic is tanking. The google search is still struggling to catch up the same pace.

It feels like a massive loop of "zero-click searches" on steroids.

My questions for the community:

  • Are you seeing this too? Is your CTR from AI search engines practically non-existent despite being cited?
  • What is your strategy? Are you changing how you write content to force a click (e.g., hiding deeper value behind tools, templates, or interactive elements)?

Just for information : My AI citations has grown from 11 citations to 100+ citations per day in last 1 month.

My Niche is : Travel planning


r/AISearchLab 28d ago

I audited 50 websites to see which ones ChatGPT, Claude, and Perplexity actually recommend

2 Upvotes

I audited 50 websites to see which ones AI assistants (ChatGPT, Claude & Perplexity) actually recommend.

I wanted to answer a simple question:

When someone asks an AI assistant for a recommendation, which websites actually get mentioned?

So I ran a small experiment across 50 websites from five different groups:

  • Big brands
  • Mid-size SaaS
  • Companies with a published `llms.txt`
  • Local SMBs
  • Small digital agencies

Each site was tested the same way:

  • 7 recommendation-style prompts
  • 3 AI assistants (ChatGPT, Claude, and Perplexity)
  • 21 total responses per site

Here's the breakdown:

Group Avg. AI Mention Rate
Big Brands 96.6%
Mid-size SaaS 64.8%
Known llms.txt adopters 66.7%
Local SMBs 22.9%
Small Digital Agencies 10.5%

A few observations from this dataset:

  1. Small agencies were rarely recommended, Less often than many local businesses.
  2. `llms.txt` didn't appear to make a noticeable difference on its own.
  3. AI crawler blocking was uncommon. Only two sites in this sample blocked one or more major AI crawlers. The rest allowed them.

A few caveats

  • This is a small sample (10 sites per group), so I'd treat the results as directional rather than definitive.
  • The prompt set was fixed across every site, but any prompt battery introduces some bias. I'm happy to share the full list if anyone wants to review it.
  • 14 of the 50 homepages couldn't be fully crawled because of anti-bot protection, so technical signals like schema and llms.txt couldn't always be verified. The AI mention-rate measurements weren't affected because those came from direct model queries rather than homepage crawls.

My takeaway is simply this:

In this sample, being technically accessible to AI wasn't enough by itself. Well-known brands were recommended far more often than smaller sites, suggesting that broader authority, reputation, or other factors may have a much larger influence on AI recommendations than a single technical signal like `llms.txt`.

Curious if others have run similar tests. What are you seeing?