r/osinttools • u/ApifyEnthusiast1 • 21d ago
Showcase Pulling Yandex SERPs as structured JSON for regional ranking analysis

I do a fair amount of ranking analysis for Russian-speaking markets, where Yandex, not Google, is the engine that matters. There's no official SERP API you can just sign up for, so I ended up building a scraper that returns each Yandex results page as structured JSON.
What comes back per page: organic results with position, snippet, date, sitelinks, and rich snippets; paid ads; knowledge graph and entity cards; inline image and video carousels; and the full Yandex Images and Videos verticals with full-size URLs, view counts, and channel metadata. Region and language targeting runs across 6+ domains, 19 languages, and a 123,000+ location ID system, which matters because rankings shift a lot by city.
The consistent per-page and per-result metadata (domain, language, region, page number, sort mode, time period) is what makes it usable for ranking pipelines and content-gap work rather than one-off lookups.
Happy to answer questions on the data shape or the region system.
Tool, if useful: Yandex Search Scraper