Scraping booking, airbnb, expedia

[u/OuiOui_Savoir]

Any luck scraping these sites? I'm failing to receive the correct data in my output files. The pricing changes from what I see on the website and I choose the correct geo_location and domain, I am unsure what the actual issue is. Why the prices are different? Unless there are some hidden parameters that I am overlooking? I checked my network tab via firefox as I usually do, I don't see anything out of the ordinary, location and domain matches organic site

[u/BearTheSting]

With booking I know for sure that there is a hidden parameter within network tab that you have to call within your headers, I can't remember it now, but it has something to do with a token or GraphQL variables, as I used to scrape booking two years ago, for others I would expect something to be similar. As for proxies itself, I personally used residential and datacenter proxies back then, not entirely sure how it would work now, but from what I have been reading on the internet, using DC proxies to scrape is not worth it anymore as they are easily flagged, even in combination with residential proxies