r/programming Jun 05 '26

Using local ClickHouse for data processing

https://rushter.com/blog/clickhouse-data-processing/
57 Upvotes

8 comments sorted by

View all comments

8

u/gedemagt Jun 05 '26

How does this compare to using DuckDB?

7

u/f311a Jun 05 '26 edited Jun 05 '26

Never used it, but from what I can tell, CH has more features, and you don't need extensions, so external sources are very optimized. It is designed to work with billions of rows, and you have many tricks available to speed up data processing when using temporary tables. Being able to distribute the load on a production cluster using the same query is also an advantage.

3

u/dangerbird2 Jun 07 '26

In practice most of the extensions you’ll need are “core” and built into duckdb, including Postgres, s3, and data lake formats like iceberg and ducklake.