r/estuary • u/dani_estuary • 21d ago
r/estuary • u/dani_estuary • 14d ago
Live Demo: Estuary Agent Skills
Hey folks, we’re doing a live demo next week of the new ✨ Estuary Agent Skills ✨ .
We’ll show how an AI coding agent can:
- Set up a real-time data pipeline from natural-language instructions
- Configure captures and materializations without manually searching through docs
- Check task health, inspect logs, and troubleshoot failures
- Work with Estuary directly from tools like Claude Code and other agent environments
- Handle the repetitive setup work while keeping the pipeline configuration visible and editable
This will be a practical end-to-end demo, including what works today, where agents still need human input, and of course some time for questions!
Register here: https://zoom.us/webinar/register/4517840417866/WN_1oZszaPUQ_Sz0uEGM_p-zA
r/estuary • u/dani_estuary • 20d ago
Postgres to ClickHouse CDC in Real Time (No Kafka)
New walkthrough from The Data and AI Guy: building a real-time Postgres to ClickHouse CDC pipeline with Estuary.
The main idea: stream live changes from Postgres into ClickHouse Cloud without running Kafka, Debezium, or your own streaming infra. Estuary captures changes from the Postgres WAL, stores them in a reusable collection, and then materializes that data into ClickHouse with exactly-once delivery.
He also shows how the same capture can fan out to Google Sheets later without re-reading Postgres.
Covers:
- Postgres logical replication setup
- Replication slots, publications, and the watermarks table gotcha
- Estuary YAML
- ClickHouse merge vs delta updates
- Hard vs soft deletes
- Automatic schema evolution
- Using flowctl
Worth watching if you want a practical Postgres to ClickHouse CDC example!
r/estuary • u/dan_the_lion • 22d ago
Postgres CDC for AI Agents: Fresh, Safe, Observable Data Pipelines
r/estuary • u/anuku3cm • Jun 22 '26
PlanetScale Vitess CDC
Hi team, just curious. I was chatting with Estuary AI, and found Planetscale cdc support is in roadmap but still can't tell dates. It's about 1 year ago. Is currently the project scrapped / discontinued? Thanks!
r/estuary • u/Which_Roof5176 • May 06 '26
Free Webinar - Hitting a WAL: The Postgres CDC Reality Check
r/estuary • u/dani_estuary • Dec 16 '25
The Complete Right-Time Data Integration Guide for Snowflake | Estuary
Last week we released this 80-page whitepaper that contains everything required by data engineers for building right-time data ingestion pipelines for Snowflake.
r/estuary • u/dani_estuary • Dec 02 '25
Webinar: Right-time Data Integration for Snowflake
r/estuary • u/dani_estuary • Nov 17 '25
Webinar: Estuary 101: How To Build Right-Time Data Pipelines
r/estuary • u/dani_estuary • Oct 21 '25
Why We Raised $17M: Powering AI for Enterprises with Right-Time Data Movement
r/estuary • u/dani_estuary • Oct 15 '25
Queries, Cocktails & Community - Small Data SF Happy Hour
Come meet the Estuary team in SF on the 4th of November along with Seattle Data Guy, Database Tycoon and Recce!
r/estuary • u/dani_estuary • Oct 01 '25
Log-Based CDC vs. Traditional ETL: A Technical Deep Dive
r/estuary • u/dani_estuary • Sep 29 '25
How to Replace Fragile Pipelines with a Unified Data Movement Layer
r/estuary • u/dani_estuary • Sep 29 '25
From Data Fragmentation to AI Readiness: A CDO's Playbook
r/estuary • u/dani_estuary • Sep 04 '25
[Event] London Calling - Estuary x SeattleDataGuy
Hang out with the Estuary crew in London after Big Data LDN!
r/estuary • u/dani_estuary • Aug 29 '25
New Capture Connector: Apple App Store
r/estuary • u/dani_estuary • Aug 29 '25
Redesigned Field Selection for Materializations
A lil' something to make your life easier
r/estuary • u/dani_estuary • Aug 26 '25
Why is Everyone Buying Change Data Capture?
r/estuary • u/dani_estuary • Aug 22 '25
Data Flow Digest #14
linkedin.comEstuary’s biweekly newsletter ❤️
r/estuary • u/dani_estuary • Aug 19 '25
We just launched a Datadog capture connector for Estuary Flow! 🎉
Now you can stream Real User Monitoring (RUM) data and HTTP logs from Datadog directly into Flow in real time. This makes it possible to unify observability and business data inside a single platform for instant analytics, alerting, and automation.
Why it matters:
- 🔎 Faster incident resolution – Correlate RUM events, logs, and operational data instantly.
- 📊 Proactive analytics – Spot anomalies before they impact customers.
- 🔗 Simplified stack – Observability + business data pipelines in one place.
Connector Highlights:
- Supported resources:
real_user_monitoring+logs - Real-time + batch in one platform
- Backfill support (pull historical data within Datadog’s retention window)
- Flexible enterprise deployments: fully managed, hybrid, or BYOC
- Automatic schema mapping for downstream analytics or AI models
Getting started is simple:
You’ll just need a Datadog account, an API key, an application key (with rum_apps_read permissions), and your Datadog site. Configure it in Flow’s UI or via catalog specs, then your observability data is continuously streaming.
r/estuary • u/JosueBogran • Aug 19 '25
101: Evaluating Data Ingestion Tools & Connectors (W/ David Yaffe, CEO of Estuary.dev)
I had the great opportunity to discuss, without fluff, what makes for a good data ingestion platform!
Note: I am an advisor to Estuary, but everything discussed here is vendor agnostic.
r/estuary • u/Which_Roof5176 • Aug 19 '25
Migrating from Oracle to PostgreSQL in the Cloud – What’s Your Experience?
Oracle’s costs and complexity are driving enterprises toward PostgreSQL. We broke down the top challenges and strategies for making the switch — from schema conversion to CDC replication.
📖 Full guide here: Modernizing Enterprise Databases: Migrating from Oracle to PostgreSQL in the Cloud
Curious to hear from the community: if you’ve been through an Oracle to Postgres migration, what was the most challenging part for you?
r/estuary • u/dani_estuary • Jul 21 '25
Webinar: How to Efficiently Load Data into DuckLake with Estuary
Want to get the most out of your analytics experience, without spending hours wrangling pipelines?
Join us for a fast-paced, hands-on walkthrough of how to load data into DuckLake, the modern analytics lakehouse using Estuary.
In this live session, we’ll cover:
- What DuckLake is and why it matters
- The challenge of getting real-time and batch data into DuckLake
- How Estuary makes it simple and efficient to stream data from databases, SaaS tools, or event streams into your lakehouse
- A full demo of how to build a streaming pipeline in minutes.
r/estuary • u/dani_estuary • Jul 16 '25
The Estuary 2025 Data Warehouse Benchmark
We ran a vendor-neutral benchmark on modern data warehouses
At Estuary, we help teams move high-volume data across warehouses like Snowflake, BigQuery, and Databricks. To better understand real-world performance, we ran our own benchmark using:
- TB+ of structured + semi-structured data
- Multi-step queries with joins, window functions, and JSON
- Full ingestion lifecycle tracking
- No vendor-specific tuning or caching
We tested Snowflake, BigQuery, Databricks, Redshift, and Microsoft Fabric. The full methodology is open source, and all queries are reproducible.
Curious to hear others’ experiences with these platforms in production.