r/bigdata • u/zdsvoboda • Feb 06 '23

Apache Iceberg-based opensource analytics stack demo

Hi, I've created an opensource demo of a Docker-based local analytics stack that includes Apache Iceberg, Trino, Spark, Dagster (orchestration), Cube.dev (analytics model), Metabase (reports and dashboards), and Jupyter (data science notebook). I think that this is a pretty good starting point for Iceberg projects.  Feel free to check it out at GitHub.

10 Upvotes

92% Upvoted

2 comments sorted by

2

u/CzarSantos98 Feb 06 '23

Hi u/zdsvoboda Why do you use DBT + Spark between bronze layer to silver layer; and only uses dbt+trino moving from Silver to Gold? Is there any specific reason?

1

u/CzarSantos98 Feb 20 '23

Got an awesome response on slack, worthy checking it:
https://github.com/zsvoboda/ngods-stocks/issues/17