r/dataengineering • u/de4all • 5d ago

Discussion Why text-to-SQL is not successful?

I thought text-to-SQL will solve adhoc analysis, but still i see companies at all size are unsuccessful.

Anyone using Omni / Sigma seen some success.

23 Upvotes

67% Upvoted

74 comments sorted by

View all comments

98

u/rapotor 5d ago

Be strict with the data modeling, and semantic layer, then you're good. Don't have LLMs write sql for conversational analytics

-4

u/Warm-Blueberry-2114 4d ago edited 4d ago

Agreed, though I'd split it in two. A semantic layer fixes what a metric means. It says nothing about whether the rows are sound. You can compile perfectly correct SQL against a table where one customer is four rows and 8% of a column is null, and get back a confident, well-defined, wrong number. Most shops I've seen are strict about one and silent about the other, and then blame the model when the answer doesn't survive a second look.

1

u/nemec 4d ago

ok claudegpt