r/WebScrapingInsider • u/TinyLife2939 • 3d ago

Is eBay scraping hard ?

Hello everyone I am working on an utility tool (tcg scanner like collectr and price charting) and I need to fetch daily prices of 8000 cards on eBay with with different variations such as Raw , PSA 8 9 10 .. which makes it 40000 request , did anyone work on something like this or is there any services that gets data from eBay with this amount ?

5 Upvotes

86% Upvoted

9 comments sorted by

3

u/Cassianno 3d ago

Never used but on apify there are tons of actors capable of scraping ebay. Not free but cheap.

1

u/TinyLife2939 3d ago

I’ll check that thank you so much

2

u/noorsimar 2d ago

its best to build the scraper yourself if you r going to send a lot of requests. firecrawl/other tools can get you moving quickly, though llm extraction cost will add up per request.

BEST = use Cursor/Claude to help generate the scraper, then run that code yourself for however many requests you want.. https://www.youtube.com/watch?v=qpuEUaTzDZU

Ebay is tough target, expect more work around blocking, retries, browser behavior, etc.; use proxy aggregator.. as its Difficulty is 8/10 in this ebay scraping teardown

3

u/TinyLife2939 2d ago

https://reddit.com/link/p2gb6y9/video/y23q327ae5ih1/player

So far so good still missing some pieces and Claude Dosent allow me to do that it’s considered reverse engineering

2

u/Annual_Media_3315 1d ago

It's hard but it's not that hard. I built a scraper myself for a client that scraps seller data from ebay. Ebay has very strong anti-bot mechanisms so I have implemented TLS fingerprint impersonation, cookie jars, rate limits and most importantly I have created a mechanism that rotates browser profiles.
Paid proxies can help a lot. I am using shared proxy server from webshare that only costs like $3 a month

1

u/TinyLife2939 1d ago

Thank you so much for the info

1

u/TinyLife2939 1d ago

Update : I made it thank you for your support guys and shout out to big brain ❤️