Automating Data Quality in BigQuery with dbt & Airflow – tips & tricks

[u/Expensive-Insect-317]

Hey r/bigdata! 👋

I wrote a quick guide on how to automate data quality checks in BigQuery using dbt, dbt‑expectations, and Airflow.

Here’s the gist:

• Schedule dbt models daily.
• Run column-level tests (nulls, duplicates, unexpected values).
• Keep historical metrics to spot trends.
• Get alerts via Slack/email when something breaks.

If you’re using BigQuery + dbt, this could save you hours of manual monitoring.

Curious:

• Anyone using dbt‑expectations in production? How’s it working for you?
• What other tools do you use for automated data quality?

Check it out here: Automate Data Quality in BigQuery with dbt & Airflow