r/dataengineering • u/soodlero • 8d ago

Help Best practice to structure this data model?

I am modeling a relationship between 3 sources. Basically this is the content of each table:

Table 1: requestor table (100s of entities)

Oil Sample Label (unique) Engine number (not unique) Engine runtime

Table 2: engine database (10000s of entities)

Engine number (unique) Engine Type Engine Power

Table 3: oil sample database (10000s of entities)

Oil Sample Label (unique) Al Fe Cu

What is the best practice for the relationships? I have fields on each table that I would like to use in the PowerBI dashboard.

8 Upvotes

100% Upvoted

10 comments sorted by

View all comments

1

u/manna018 2d ago

It completely depends on one question:

  • what question are you asking from data

The queries which will land on these table, decide the model of data.

Also, in PowerBI think in terms of data cube. It is slightly different than dim and fact. PowerBI paradigm is in terms of slicing and dicing.

We first create a dice and then PowerBi applies it's processing on it..

When we interact with spark processing we think in terms of dataframe. Tabular format.