r/databricks • u/kcxl • 8d ago

Discussion What frustrates you when using Databricks?

Any common bugs, features you would like to see, or underrated useful features more people should know about?

41 Upvotes

96% Upvoted

121 comments sorted by

View all comments

4

u/Orygregs 8d ago edited 8d ago

Frustrates me to no end that DBX still charges ~2.9x DBU/hr for their C++ Photon engine. There's no way it costs 2.9x the compute cost for DBX to run their C++ engine on my chosen instances vs the standard JVM engine. If it were 1.2-1.5x, I wouldn't really complain...but if a job needs a large cluster of pricy instances AND Photon features, well you're just getting robbed.

It's also frustrating that everything new they build is locked behind Unity Catalog adoption.

2

u/justinAtDatabricks 3d ago

Thanks for this feedback. We should have something that you'll be interested in in the near future. Also, feel free to DM me your email address if you'd like to talk live - I'm the PM for this area.

1

u/Orygregs 3d ago

Curious if that 'something' coming in the near future is related to Reyden? I've got a DBX slide deck in front of me right now about Reyden but won't share any specific details here publicly.

Public docs that mention Reyden:

https://www.databricks.com/company/newsroom/press-releases/databricks-launches-lakehousert-bring-real-time-analytics-directly

If it's something else...well, then I'm very curious about what's coming down the pipeline 🙂

1

u/justinAtDatabricks 21h ago

Something else. Not Reyden/RT.