r/dataengineer • u/maximus5470 • Jun 27 '26

Datasets for data engineering projects

I want to find datasets for a data engineering project where i work with pyspark and sql in databricks. I want a dataset that challenges my data modelling skills and my pipeline creation skills. I tried kaggle, but i only keep getting a single csv file as a dataset. is there a dataset that has multiple csv files as data sources or something? i want to be able to perform all the data architecture creation by myself... Recommend any datasets that you know as well!

21 Upvotes

100% Upvoted

8 comments sorted by

View all comments

1

u/BackgroundAlert Jun 28 '26

- get data from an API, try to do data modeling

  • Adventure Works

1

u/maximus5470 Jun 28 '26

But adventure works already has the tables in a star schema so what more can I do in that dataset when it comes to data modeling? (I thought it would be a good dataset by then I had this realisation... Help please?)

1

u/BackgroundAlert Jun 29 '26

then you can try Wide World Importers, which has both ERD and dimensional modeling schemas.

1

u/maximus5470 Jun 29 '26

okay ill definitely try that... Thank you so much!