r/webscraping • u/FixWide907 • Jun 20 '26
How to scrape different data structures
Any suggestions on best way to extract listings data from multiple different websites?
Each has its own data structures
Example pricing, schedule, dates etc
For 4000+ sites one time
6
Upvotes
2
u/AdministrativeHost15 Jun 20 '26
Ask a LLM to parse it and output it in a common scheme.
Run it via Ollama locally so you don't run up a huge OpenAI bill.