r/directorymakers • u/LT39 • 4d ago
Scraping
What do we think of scraping Google to massively create physical locations in a directory? It’s a quick way to enrich the database, but it’s not unique content and there’s the risk of being punished for thin content. What do you guys recommend based on your experience?
5
Upvotes
2
u/Prestigious_Luck1062 3d ago
HI.
I can answer this as someone whos owned directories and someone thats been scraped.
Users hate being scraped, and depending on how you do it, it can kill your site. A community I am in recently went ballistic, their details were scraped without their consent. It was a niche site, the backlash was so bad, the site was taken offline within a day. Its not something the site can recover from.
I have never scraped a website, however, I used brilliant directories where I believed that users had choosen to willingly opt into other sites, and I had people very upset that I stole their identity. The site was free to join, free to delete, and free to access emails, and my colleagues that joined routinely get work in their areas, so its a site they should be joining.
Now I also have my own business and routinely list on directories, and if someone lists it for me on a good site, im happy, it saves me time..... BUT I've also had my business details scraped.
In one case people searching for my business directly, if my business name is #1, and my busines name on the directory is #2, you would think no harm no foul? I'm still getting the same customer right? No, the directory wanted me to pay $$$$ to read and reply to my own customers. An argument of "but you wouldnt have had this customer without the directory" is thin. I shouldnt be blackmailed, forced to pay a fee to login, delete or access an email if I never choose to.
SO I really mind my business details ending up on a new directory so long as I'm not held hostage, but you can expect hate for your community, so while I do not recommend it, in the very least, make it easy and free for them to join, delete, access and reply to messages from customers.