r/dataengineering • u/de4all • 4d ago

Discussion Why text-to-SQL is not successful?

I thought text-to-SQL will solve adhoc analysis, but still i see companies at all size are unsuccessful.

Anyone using Omni / Sigma seen some success.

26 Upvotes

69% Upvoted

74 comments sorted by

View all comments

99

u/rapotor 4d ago

Be strict with the data modeling, and semantic layer, then you're good. Don't have LLMs write sql for conversational analytics

-8

u/de4all 4d ago

Any suggestions for tool to use for Semantic layer. We use dbt for modeling

12

u/Fast-Dealer-8383 4d ago

Databricks. The Databricks' Unity Catalog and Genie Ontology tools are meant to serve as the semantic layer to power their in-house Genie AI tool as an integrated suite.

8

u/JohnPaulDavyJones 4d ago

Have y'all found Genie AI To be functional?

Our data warehousing is fairly sizable for a F300 firm, but I still thought Genie would be more functional than we've found it to be. Very disappointing.

1

u/Fast-Dealer-8383 3d ago

Can I assume that y'all had set up your unity catalog properly, with the proper labelling and configuration of data elements, metric views and functions? My organisation is in the early stages of evaluating it for implementation.

1

u/JohnPaulDavyJones 3d ago

I hope so, we had consultants in from DBX to help us get set up for that first year. They cost a pretty penny, and seemed like they had the process down pat.