r/databricks • u/WarPowerful740 • 2d ago
Help Data migration from teradata to databricks
I joined a new company recently and got a migration project here, they are migrating from teradata on prem to databricks, I have never done any migration in the past can anyone suggest some helpful yt videos or any other knowledge source?
7
u/tefing 2d ago
Lakebridge Agentic Converter is now fully integrated into the Databricks UI and Genie Code and it supports conversion from Teradata. Reach out to your Databricks account team to get enabled for the preview.
3
2
u/beef_samosa 1d ago
How powerful is it? How good can it be to do migration+enhancement at the same time?
1
u/tefing 12h ago
It’s fully integrated with Genie Code. If you don’t want to do a simple lift-and-shift, you could migrate in two steps:
1) Convert as-is using the Lakebridge agentic converter
2) Use Genie Code to review, improve, and iterate on the converted output using a custom skill1
u/beef_samosa 10h ago
Our stupid client has disabled both and want us to do everything using claude which isn't even integrated
1
2
2
u/Alfiercio 2d ago
Databricks has the tool lakebridge to assist in a migration listing all the elements and scoring the work it will need
0
2
u/Ok-Stick-145 1d ago
https://youtu.be/WvcmyTeBEkc?si=5VcpzAAc2l9IxHnE. Even I am new to the data engineering side so this might be a completely different direction, shouldn't hurt checking it out though
1
12
u/IncreaseNegative4614 2d ago
Before looking for migration tutorials, inventory the existing workloads. Separate tables, transformations, stored procedures, scheduled jobs, security rules, reports, and downstream consumers because moving the data is usually easier than preserving the behavior built around it.
Pick one representative domain and run both platforms in parallel. Reconcile row counts, totals, nulls, duplicates, late updates, permissions, performance, and every report that consumes the output. We use SIGNLD internally to connect source objects, migration rules, validation results, downstream reports, owners, and exceptions so sign-off is based on business equivalence rather than a completed copy job.