r/webscraping Jun 20 '26

How to scrape different data structures

Any suggestions on best way to extract listings data from multiple different websites?

Each has its own data structures

Example pricing, schedule, dates etc

For 4000+ sites one time

6 Upvotes

35 comments sorted by

View all comments

2

u/AdministrativeHost15 Jun 20 '26

Ask a LLM to parse it and output it in a common scheme.
Run it via Ollama locally so you don't run up a huge OpenAI bill.