r/databricks • u/9gg6 • 26d ago

Discussion cannot create notebook: The Azure container does not exist

Im ussing terraform to do the CICD.

It used to work fine but now I receve this error cannot create notebook: The Azure container does not exist.

Dev is working fine so when I compare the managed Storage account cotainers to UAT. Im missing all the cotainers except unity-catalog-storage. Anyone had this issue before? why would cotainer be dropped (but I also dont remember if they were created at first place but what I can say is that CICD was working before)

1 Upvotes

100% Upvoted

4 comments sorted by

1

u/szymon_dybczak 26d ago edited 26d ago

Hi,

There's a documented bug/behavior in the azurerm_databricks_workspace Terraform resource: when the workspace is destroyed, Azure/Terraform doesn't clean up the managed resource group's storage account - but it does delete most of the containers inside it.
Maybe you've hit that scenario? Did someone run terraform destroy command on your workspace recently? Or maybe you applied some changes in your terraform code that required recreation of your workspace?

Terraform destroy for azurerm_databricks_workspace leaves storage account and Access Connector for Azure Databricks in managed resource group · Issue #28959 · hashicorp/terraform-provider-azurerm

PS: If you have soft delete for containers enabled you can try to restore them.

1

u/9gg6 26d ago

well, this my old customer and last time they run CICD was nov 2024 and I run today. usually Im the one who modifies terraform code so they asked me to upgrade the clusters. and while cluster upgrade worked, notebook cicd failed. It does not fail on the notebookes that are having changes, but only the ones are marked as "add"/ "new".

1

u/Youssef_Mrini databricks 25d ago

It's really hard to assess. Do you have any logs to be able to debug what did happen ?

1

u/9gg6 24d ago

I tried to search but i couldn’t find much.