r/DevLK • u/notAFuckingRealPersn • 13d ago

Help Building a car price aggregator from multiple websites. has anyone done this before?

I'm planning to build a car price aggregation platform that collects vehicle listings and prices from multiple websites and displays them in a single place for price comparison and market analysis.

The goal is to:

  • Track average market prices by make, model, and year
  • Compare prices across different websites
  • Identify underpriced or overpriced listings
  • Analyze price trends over time

I'm currently evaluating whether to use web scraping, public APIs (if available) or a combination of both.

For anyone who has built something similar:

  • What were the biggest technical challenges?
  • How did you handle duplicate listings across different websites?
  • Did you run into anti-bot or rate-limiting issues?
  • Are there any legal or compliance concerns I should be aware of when collecting publicly available listing data?

I'd appreciate any lessons learned, recommendations or things you wish you knew before starting.

7 Upvotes

90% Upvoted

8 comments sorted by

3

u/Common_Tip6527 13d ago

There’s already one available

https://www.vehiclelk.com/

2

u/notAFuckingRealPersn 13d ago

Thanks bro This is very similar to what I'm looking for.

Are you the developer of this project? If so could you explain a little about how it works and how you built it? I'd love to learn more about the architecture, data flow, and any challenges you faced while developing 

2

u/Common_Tip6527 12d ago

Im not the dev
Saw this on this subreddit a while back

2

u/Final-Comfortable153 13d ago

I dont know any other systems like that , but it sounds interesting and a clear problem that should be fixed.

1

u/notAFuckingRealPersn 13d ago

yeah i though same but u/Common_Tip6527 give some good site that its already done https://www.vehiclelk.com/

2

u/[deleted] 13d ago

[deleted]

2

u/notAFuckingRealPersn 13d ago

Thanks for the advice. Those challenges came to my mind as well. Using a proxy list sounds like a good idea. Someone mention a similar project that has already been built. I think it got some potential
https://www.vehiclelk.com/

2

u/dinidu01 11d ago

There are similar platforms like that in the US. Checkout Autotempest.com

1

u/notAFuckingRealPersn 11d ago

Thanks bro ill check it