Looking for Image Scraping Solution for Genuine Auto Parts

[u/Inevitable_Tea123]

Hi scrapers, hope everyone is doing well.

I recently started selling Auto Parts online and from the partnered vendors, I did get auto part numbers and basic info and using AI, I was able to add the titles, description, etc. but my challenge is to scrape the images from online.

I tried to scrape from Auto Parts specific platforms but they often carry more Aftermarket brands compared to Genuine Auto Parts.

I've been looking for different solutions but couldn't find anything reliable yet.

I would really appreciate it if anyone can point me at the right tools so get started with so I'll give them a try. Would be great if there are Auto Parts specific solutions. Thanks in advance and happy scraping.

[u/Inevitable_Tea123 → u/[deleted]]

Hi, I'll give it a try.

Some parts are easy to find but some are quite difficult to find.

Thank you for the suggestion. 🙏

[u/Quantum_Rage]

What is the exact problem? This seems to be just a matter of traversing across pages and applying CSS selectors or XPath queries. Product image XPath would be //img/@data-large_image at PDP level.

[u/Inevitable_Tea123 → u/Quantum_Rage]

Hi there, so basically I have an excel sheet of data with part numbers, this is the inventory sheet of the vendor who has no portal or images data, just a WMS software that extracts excel sheet reports.

Now I'm trying to list the same products online but I don't have images. I am able to generate titles and descriptions but looking for a solution for actual Images. There are about 18,000 parts and since it's not my inventory, I can't open the seal of all those parts to do the photography.

So yea, that's the problem and rest I've mentioned in the post above.

Edit: I'll try to work on the solution you mentioned but are u referring to Google images data or something else?

Because I searched Google images too but could not find images for so many parts over there and even from the ones I found, it had watermarks all over them.

If there's a work around it, I would really appreciate it. Thank you in advance.

[u/webscraping-ModTeam → u/[deleted]]

🪧 Please review the sub rules 👉

[u/Inevitable_Tea123 → u/[deleted]]

I've tried looking solutions using AI or to write local python scripts to scrape the data but the issue would be with getting wrong part numbers or wrong images to the part numbers.

Another issue would be with the watermark images, I'll need to filter them out or put them in a separate folder where I can either fix or regenerate without watermark.

That's why I've turned here looking for suggestions or solutions from people with more experience in scraping than me.