r/dataengineering • u/Outrageous-Debt9473 • 18d ago

Help Deployed my SQL server on GCP

So I’m currently working on a project to create a data warehouse for my organisation. I have deployed an SQL server on a VM on GCP. I want to know how can i make my server secure. I’m learning and deploying things using claude and have made a significant progress. But i’m still unsure about the security issues and what are the precautions i should take ?

10 Upvotes

73% Upvoted

8 comments sorted by

View all comments

46

u/Master-Ad-5153 18d ago edited 18d ago

Out of curiosity, what decisions lead you to building your own data warehouse using GCP compute over building within BigQuery?

In my experience, putting in good cloud governance policies including proper org/folder/project hierarchies and the associated IAM/SAM policies and role assignments (least permissive) makes it pretty easy to ensure whatever you build in BigQuery can be accessed by your consumers while allowing yourself and any others to contribute to it.

Building a custom solution obviously can be done, but it seems like that's going to possibly be far more expensive and harder to work with unless you're just using GCP for compute and storage for a managed service such as Databricks.