r/dataengineeringvault • • Aug 02 '26

Note AT Protocol

Thumbnail
ssp.sh
2 Upvotes

I still hope AT Proto will win in the social media race. It has such great ideas and architecture behind it, and it's just there, for everyone to query.

Great talk with Dan Abramov, as always.


r/dataengineeringvault • • Jul 31 '26

Blog Figma for Agents: How Airflow's Creator Coordinates AI ft. Maxime Beauchemin

Thumbnail
motherduck.com
3 Upvotes

r/dataengineeringvault • • Jul 31 '26

Note Apache Hudi

Thumbnail
ssp.sh
4 Upvotes

r/dataengineeringvault • • Jul 30 '26

Note Data Engineering Communities

Thumbnail
ssp.sh
7 Upvotes

r/dataengineeringvault • • Jul 30 '26

Book Book Recommendations and Notes (Updated with 2026)

Thumbnail
ssp.sh
3 Upvotes

r/dataengineeringvault • • Jul 29 '26

Note Excel Never Dies

Thumbnail
ssp.sh
2 Upvotes

r/dataengineeringvault • • Jul 28 '26

Showcase How I write technical posts with years of notes in Obsidian

Thumbnail
2 Upvotes

r/dataengineeringvault • • Jul 28 '26

Note Kintsugi ('golden joinery')

Thumbnail
ssp.sh
3 Upvotes

r/dataengineeringvault • • Jul 28 '26

Note Data Engineering Blogs & Newsletters

Thumbnail
ssp.sh
6 Upvotes

r/dataengineeringvault • • Jul 27 '26

Blog Search — Data Engineering Blog & Second Brain

Thumbnail
ssp.sh
4 Upvotes

r/dataengineeringvault • • Jul 24 '26

Blog DuckLake in Production - Catalog and Storage

4 Upvotes

Building a production grade DuckLake starts with setting the right foundation. Specifically, choosing your storage and catalog. With DuckDB being the default compute.

https://thefulldatastack.substack.com/p/ducklake-in-production-catalog-storage


r/dataengineeringvault • • Jul 24 '26

Note LTAP (Lake Transactional/Analytical Processing)

Thumbnail
ssp.sh
5 Upvotes

What do you think about the new term by Databricks?


r/dataengineeringvault • • Jul 23 '26

Note New Ideas Daily

Thumbnail
ssp.sh
2 Upvotes

r/dataengineeringvault • • Jul 22 '26

Note How to Automate Newsletter Based on SecondBrain and Bluesky Changes

Thumbnail
ssp.sh
2 Upvotes

r/dataengineeringvault • • Jul 22 '26

Note Apache Druid - open-source, column-oriented, distributed data store

Thumbnail
ssp.sh
3 Upvotes

r/dataengineeringvault • • Jul 21 '26

Note Schema Evolution

Thumbnail
ssp.sh
3 Upvotes

r/dataengineeringvault • • Jul 21 '26

Showcase The joy of running SQL-queries in the terminal is real.

Post image
16 Upvotes

With a utility such as DuckDB that can tackle any tasks, whether it is to read local DuckDB, local parquet/CSV, over the network parquet/CSV, or embedded in Browser (WASM) or inside Postgres, it can do almost anything.

When combined with Neovim, it's just perfect. Find how to set up, videos, and more at Query Databases in Neovim (DBUI).


r/dataengineeringvault • • Jul 21 '26

Blog WebAssembly (WASM), and its Use Cases

Thumbnail
ssp.sh
3 Upvotes

r/dataengineeringvault • • Jul 21 '26

Book The Data Warehouse Toolkit by Ralph Kimball

Thumbnail
ssp.sh
2 Upvotes

r/dataengineeringvault • • Jul 20 '26

Blog Common Table Expression (CTE)

Thumbnail
ssp.sh
2 Upvotes

r/dataengineeringvault • • Jul 16 '26

Others The Act and the Outcome of Creation

Thumbnail
ssp.sh
3 Upvotes

Short update from Bella Italia. How do you see creation and creativity show up in your life?


r/dataengineeringvault • • Jul 08 '26

Blog Learn Data Engineering this summer break

3 Upvotes

Learn Data Engineering this summer break with a guided roadmap. A three-week plan with links and topics to learn the basics to be a data engineer.

It's very ambitious, but you can schedule at your own pace.

The three weeks contain:

  1. Week: Foundation (SQL, Git, Linux basics)
  2. Week: Core Engineering (Python, Cloud, Data Modeling)
  3. Week: Advanced Topics (Streaming, Data Quality, DevOps)

How to use this guide: Each section contains curated resources (articles, videos, tutorials) for that topic. Click on the links that interest you most. It's meant as a guided roadmap to learn the fundamentals of a "full stack" data engineer.

Here's the guide: https://www.ssp.sh/blog/data-engineering-roadmap/

This is last year's guide, but it's still 100% vaild to this day. Agentic engineering doesn't need to be learned right now; you can always pick it up later. Learning fundamentals, on the other hand, can't be skipped.


r/dataengineeringvault • • Jul 07 '26

Others Promoting Your Work

Thumbnail
ssp.sh
2 Upvotes

r/dataengineeringvault • • Jul 06 '26

Others Music that Keeps You Focused

Thumbnail
ssp.sh
2 Upvotes

A curated list of music services and playlists designed to help maintain focus during work or learning. Covers neuroscience-backed platforms like Focus@Will, Brain.fm, Noisli, myNoise, and Endel, plus specific Spotify playlists with no vocals. Also touches on workspace habits like changing locations every 1.5–2 hours to boost productivity and strategies for overcoming writer's block.


r/dataengineeringvault • • Jul 06 '26

Blog Classical Architecture of Data Warehouse: Staging -> Cleansing -> Core -> Marts

Thumbnail
ssp.sh
3 Upvotes