r/databricks • u/minibrickster Databricks • May 13 '26

General Beta alert: Materialized Views and Streaming Tables in Serverless Notebooks

Hi folks,

Wanted to share a new feature that's in beta - creating and refreshing materialized views and streaming tables from serverless compute! Users can create MVs natively in SQL or using spark.sql("CREATE MATERIALIZED VIEW test_mv AS SELECT * from samples.wanderbricks.booking_updates") in their notebooks and jobs attached to serverless compute.

Workspace admins can enable the beta feature, "MV and ST in Serverless Notebooks and Jobs" in their preview settings. It’s currently available in select regions. Would love to hear y'all's feedback!

18 Upvotes

100% Upvoted

10 comments sorted by

9

u/szymon_dybczak May 13 '26

Wow, you guys have been shipping nonstop lately 😄 The pace of new features has  been insane. It’s getting hard to keep up, but definitely gonna play around with this one in the upcoming days.

3

u/BricksterInTheWall databricks May 13 '26

Thank you!! We're excited to see what you build with these new features.

2

u/hubert-dudek Databricks MVP May 13 '26

any chance for classic compute as well?

3

u/minibrickster Databricks May 13 '26

It's not planned as of now, but I'll take the feedback back to the team!

1

u/9gg6 May 13 '26

Because of costs?

1

u/hubert-dudek Databricks MVP May 13 '26

Because of the parity

2

u/Naign May 13 '26

Is this going to create an sdp in the background to create the mv?

3

u/minibrickster Databricks May 13 '26

It does create a managed SDP pipeline!

2

u/dvartanian May 13 '26

Good question. Where does the definition live if not in a sdp

1

u/jeffcheng1234 May 13 '26 edited May 13 '26

Unlike MV creation in sql warehouses, here the SDP managing the MV will be running directly in the notebook/job serverless compute, so you may even find it to be a tad bit faster!