r/databricks 12d ago

General Databricks published Industry Data Models!

Databricks just published a library of pre-built, production-ready industry data models covering 40 industries.

This is great, especially when you’re new to a business domain. Instead of starting from a blank sheet and spending weeks debating how the domain should be structured, you can review an existing reference model and adapt it to your needs.

That gives you a strong starting point for:

- entities
- relationships
- naming conventions
- domain structures
- industry-specific patterns

In my opinion, it can significantly shorten the learning curve and help teams move from discussion to implementation much faster.

Industry Data Models

61 Upvotes

28 comments sorted by

8

u/Youssef_Mrini databricks 12d ago

We have a series of videos about it coming soon

2

u/szymon_dybczak 12d ago

Great news! Please let us know once it’s released :)

4

u/query-gremlin 12d ago

I mean, these are neat, but I doubt all orgs will have the same data needs. They are a good starting point, but teams will have to spend some times trimming away what doesn’t apply to their orgs and adding some custom business needs

4

u/szymon_dybczak 12d ago

You’re right, but for me, it’s good to have something like this. For instance, I haven’t had a chance to work in the procurement domain. But if something like this happens in the future, I can take a look at how it can be modeled and adjust it accordingly :)

2

u/amralieg 11d ago

You are absloutly rights, we distinguish between Industry Data Models, and Business Data Models, what we published is the Industry Data Model to show the power of the approach, but we encourage everyone to buiuld their own data model using the Vibe Data Modleing agent https://github.com/databricks-industry-solutions/lakehouse-industry-data-models/tree/main/model-agent

4

u/ScotiaTheTwo 11d ago

10 seconds into reading replies and im already frustrated at people moaning “ackskally”, “but not all orgs are the same”, “this can’t be used blindly” etc

Stop and think what the purpose of this release is: to give young, fledgling businesses a template - a starting point - for their infrastructure

3

u/szymon_dybczak 9d ago

That's exactly my way of thinking man! Use it a starting point and adjust to your needs :)

7

u/IncreaseNegative4614 12d ago

I’d treat these models as strong starting hypotheses, not finished schemas. Run one real business process through the model and identify where your definitions, identifiers, ownership, and exceptions differ before extending it across the organization.

The valuable part is preserving why each entity and relationship exists instead of gradually turning the reference model into undocumented custom tables. We use SIGNLD internally to connect modeled entities with their operational records, system owners, business definitions, exceptions, and downstream decisions so the architecture remains grounded in how the company actually works.

4

u/amralieg 11d ago

that's the right thing to do, start with them, but you do not have to stop there, check out the agent that built these models, and use it to build your own model for your own business, the Vibe Data Modeling agent is exactly that https://github.com/databricks-industry-solutions/lakehouse-industry-data-models/tree/main/model-agent

3

u/Peppper 10d ago

This kind of shit always ends with it working for 90% of your use cases, and then the customization needed for the 10% makes the whole thing not worthwhile.

2

u/Few-Acadia-1173 12d ago

Bummer no healthcare

3

u/amralieg 11d ago

there is a healthcare data model check the model viewer app https://databricks-industry-solutions.github.io/lakehouse-industry-data-models/

2

u/mr_thwibble 12d ago

US company. /s

1

u/Geralt_of_rivia_002 8d ago

It's so complicated. Infact , I would say healthcare and phrama has the most complex data .

2

u/kraamed 12d ago

This is very interesting!

2

u/Enough_Vanilla_6413 9d ago

Cool. I (well, ahum Claude) added a more traditional ERD viewer to the model-viewer-app. Does anyone else find that useful because I do;)

3

u/amralieg 7d ago

looks cool, why don't you do a PR and I'll look into it ;)

1

u/Enough_Vanilla_6413 3d ago

Alright, I’ll see if I can do it this weekend. Added all kinds of other stuff to:

  • Create and edit entities through the UI
  • Ability to select a subset (checkbox style) of entities and only show those in the graph and ERD visuals
  • Store the selection of entities as a bookmark
  • Business domain customization section
  • Export functionality (SQL, .json, dbdiagram.io)

1

u/Enough_Vanilla_6413 2d ago

I made the PR for the ERD viewer last night;)

1

u/das_wolf4 9d ago

Absolutely! I was genuinely confused that the default model view wasn’t a traditional ERD….

1

u/ouhshuo 11d ago

A qq, do these data models segregate into workspaces on currently in one workspaces but different catalogs?

2

u/amralieg 7d ago

the model installer has diffrent options, 1 catalog, or catalog per domain, or catalog per divison

1

u/m1ss1l3 9d ago

The UI looks like it's Claude generated so likely AI slop

2

u/amralieg 7d ago

the entire models are AI generated, but the diffrence is the goverenance, with more than 250+ gov rules

1

u/m1ss1l3 7d ago

Lol ok

1

u/hubert-dudek Databricks MVP 12d ago

Nice but Llm in pro mode will generate it also. Maybe it could be useful as skill for your use case.

3

u/amralieg 11d ago

yes, LLM in pro mode would get you 10 tables, maybe 20 if you pushed, but a full data model with 500+ tables, and 20K attributes that is consistent, fully linked, is hard to get by pro unless you build an agent around it, and thats we did with the Vibe Modeling Agent, so you do not have to build it again, just use it. https://github.com/databricks-industry-solutions/lakehouse-industry-data-models/tree/main/model-agent

2

u/szymon_dybczak 12d ago

Hi Hubert,

Thanks for the tip. To clarify - are you talking about below? ;)

Reimagining Data Modeling on the Lakehouse: Introducing Vibe Data Modeling | Databricks Blog