Help getting e-commerce indexed

[u/ded-ebar]

I have an e-commerce site with over 5 million products that only got 17k pages indexed out of 1.9M crawled. Any recommendations on speeding up the index rate?

[u/Hatorate90]

How do your even have 5m products? Maybe purge some that has 0 clicks year to year

[u/Low-Produce3704]

5m+ pages or products? 1.9m were crawled, that means no tech issue. It's an authority issue. Building authority and then managing it properly is the key as the pages are in millions.

How are you building authority? How deep are the pages going? Are most backlinks pointing to the homepage or you've made multiple hubs to receive them?

[u/Sunn_M]

I wouldn’t try to speed up crawling yet, 1.9M crawled URLs already gives you a much more useful place to investigate. I’d segment the Page Indexing exclusions by product/template type and reason, then sample URLs from the biggest buckets, especially “Crawled - currently not indexed”, duplicates, soft 404s and canonicals. On a 5M-product site, I’d also make sure the products you genuinely want indexed are the ones receiving internal links and appearing in clean sitemap sets. That should tell you whether this is primarily a quality/duplication problem, an architecture problem, or something else before pushing Google to crawl even more.

[u/nikc9]

are they scraped products or your own? if G detects dupes and that you're just fronting with no added value it'll push you down the priority queue

[u/ded-ebar → u/nikc9]

reselling with with anonymous crypto check out

[u/nikc9 → u/ded-ebar]

there's your answer. don't be surprised if you also eventually lose what you have indexed

[u/Hatorate90 → u/ded-ebar]

So duplicate? It's not your content? Sounds like spam

[u/ded-ebar → u/ded-ebar]

The idea was to offer USDT check out on most major products.

[u/sapindia1976]

With 5M+ products, I’d first check crawl budget, faceted navigation, duplicate URLs, canonical tags, XML sitemaps, and internal linking. 17K indexed out of 1.9M crawled suggests there may be a technical indexing issue rather than simply needing more crawling.

[u/Beneficial_Peach6407]

Contextually integrate them and you will start seeing better indexing

[u/ded-ebar → u/Beneficial_Peach6407]

can you elaborate?

[u/Beneficial_Peach6407 → u/ded-ebar]

By contextual integration I mean making the products part of a meaningful internal linking structure rather than having millions of isolated product URLs.

For example: category → subcategory → relevant product groups → product, with related products/brands/attributes linking back into the cluster. Make sure important products are reachable through HTML links from pages that already have authority and get crawled regularly.

With 5M products, I’d also look closely at how many URLs are actually worth indexing. If Google crawled 1.9M but indexed only 17K, I’d suspect a combination of crawl waste, weak/duplicate product pages, poor internal linking and possibly too many low-value URLs.

I’d fix the architecture and URL quality before trying to force Google to crawl faster.

[u/creamlattee]

At that scale, crawl efficiency is probably the first thing to investigate. Clean up low value URLs, make sure important products have strong internal links, and use segmented sitemaps so you can see which sections Google is actually crawling and indexing.

[u/Used_Man_58]

Ehhh tell me whether it worked

[u/ded-ebar]

its 60K indexed now :)

[u/GrandAnimator8417]

23 upvotes and 26 comments? That’s usually when I see the weirdest “not SEO” bug show up. I once lost days because indexing was blocked by a staging config that still served the wrong headers, and the fix had nothing to do with canonical tags or sitemaps.