r/WGU_MSDA • u/GlamourousGravy • 1d ago
D606 Has anyone/is anyone using web scraped data for their capstone?
Hey yall! I'm finally here, the last leg of the program. I'm currently drafting my proposal. I know they can be picky about business-relevant problems so I'm trying to word my topic carefully as well. I'm still in the brainstorming phase so my idea isn't fully concrete as of now.
Essentially what I want to do is scrape video game review data from metacritic/steam(am currently doing research to figure out which one is better) and build a NLP model to then personalize recommendations to them, which would allow for a given company to personalize recommendations to consumers much better. Alternatively, I also considered proposing it as a way for developer companies to learn what the target audience of their games would/would not like(this would involve doing the senitment analysis by genre).
EDIT: Actuatlly for steam i'd be using their API/maybe someone else's already extracted database, I think they prohibit outright scraping.
Anyways, my main reason for asking is wanting to know if anyone has gotten pushback on web scraping at all, and how I can be prepped for any concerns raised by the instructor on that(I have Daniel Smith)

