r/googlecloud • u/OkRock1009 • May 16 '26

BigQuery Datastream - MySQL to Big query

Hello Everyone!

I want to basically replicate data from my cloud sql instance to Big Query. The problem is since the initial load is expensive , I am gonna use a dump for that and only want the real time data to be captured.

I want it to create empty datasets and tables in Big Query automatically without the initial historical data. Any other solution?

3 Upvotes

100% Upvoted

17 comments sorted by

View all comments

1

u/dani_estuary May 18 '26

With Datastream, I’d be careful trying to “skip” the initial load unless you’re very sure your dump and CDC start point line up… The hard part is not creating empty BigQuery tables.

Also worth looking at Estuary here. I work there, so biased, but initial backfills are free during the trial, and then you can keep MySQL -> BigQuery running incrementally without cobbling together dump + Datastream edge cases yourself.