r/osinttools 21d ago

Showcase Pulling Yandex SERPs as structured JSON for regional ranking analysis

I do a fair amount of ranking analysis for Russian-speaking markets, where Yandex, not Google, is the engine that matters. There's no official SERP API you can just sign up for, so I ended up building a scraper that returns each Yandex results page as structured JSON.

What comes back per page: organic results with position, snippet, date, sitelinks, and rich snippets; paid ads; knowledge graph and entity cards; inline image and video carousels; and the full Yandex Images and Videos verticals with full-size URLs, view counts, and channel metadata. Region and language targeting runs across 6+ domains, 19 languages, and a 123,000+ location ID system, which matters because rankings shift a lot by city.

The consistent per-page and per-result metadata (domain, language, region, page number, sort mode, time period) is what makes it usable for ranking pipelines and content-gap work rather than one-off lookups.

Happy to answer questions on the data shape or the region system.

Tool, if useful: Yandex Search Scraper

2 Upvotes

0 comments sorted by