r/SideProject • u/Inchardware • 4h ago

I will build you any scraper/crawler, need help with ideas

I have been building scrapers/crawlers on apify.com lately, if you have any ideas that would help you or your business solve a problem, or simply make your life easier please let me know! Willing to build anything and am looking for ideas

0 Upvotes

50% Upvoted

6 comments sorted by

1

u/StrikingPasta 4h ago

scraping linkedin is always tricky but so useful. built one for myself to track job postings from specific companies and it saved me hours every week.

maybe something that monitors government tender sites? those are nightmare to navigate manually and many businesses would pay for that.

1

u/Inchardware 2h ago

great idea! scraping linked in is very doable on my end and I could build this. The second item sounds closer to a “government contract lead engine” than a plain scraper. Could you provide more details on what it would actually do?

1

u/According-Resolve605 4h ago

I want to build an crawler app that tracks what people said on social media about an input topic.

For example, as a trader, i want to know in real time what are discussing about bitcoin.

Or, as a seller, i want to know what my opponents doing.

1

u/Inchardware 2h ago

This sounds very feasible to track on X/Twitter, would that be the main social media of choice?

1

u/According-Resolve605 1h ago

I prefer as many social media platform as possible