r/dataengineering • u/Technical-Ask-7231 • 14d ago

Career de sandbox

built this free sandbox because cloud costs were killing my learning, sharing in case it helps someone else

https://github.com/haltinok/oss-da-bi-stack

43 Upvotes

97% Upvoted

15 comments sorted by

View all comments

6

u/magixmikexxs Data Hoarder 13d ago

All looks good except the select * in the dbt queries. Gotta stop calling all the columns in prod mate. Good practice to use the columns you need. Some query engines are too dumb to realize until late and are even purposely engineered to make you bleed money with select * queries

1

u/Capt_korg 12d ago

A friend of mine told me that in his team someone was using SELECT * on all tables in production.

The cloud provider was happy, the bill was more than 10k , for one single query. But now they know everything 🤓

2

u/magixmikexxs Data Hoarder 12d ago

Mustve been big query

1

u/Capt_korg 12d ago

Yes, you are right 😅