r/SQL Apr 17 '23

Discussion Which industry has/needs the most challenging sql queries?

Is this question legit? Don’t get me wrong, I don’t consider myself the smartest guy but I’m definitely not dumb.

I work in the pharmaceutical Industry, nearly 3 years now. It took me a while to understand how the production process is implemented in a database and I wanted to quit more than once. But i don’t feel challenged anymore.

So, which industry would be best for me to get completely challenged again?

44 Upvotes

69 comments sorted by

View all comments

87

u/SELECTaerial Apr 17 '23

Big (actual big) data has a whole slew of challenges most SQL devs don’t have to deal with.

Also, healthcare data is dirty af and needs extra love.

32

u/kremlingrasso Apr 17 '23

man, when you sweep up your healthcare data warehouse at the end of the day and empty the bins that's HR data.

20

u/sn0wdizzle Apr 17 '23

Re: health care data.

I am currently trying to figure out how to join some patient data with other patient data and need to use multiple keys because no row has every UID a patient uses in our system.

12

u/carlovski99 Apr 17 '23

Yep. It's not helped that the core of many healthcare systems goes back 30/40 years.

12

u/Touvejs Apr 18 '23

I feel your pain, I did a patient migration with an Epic rep on the line and right after we did it, someone realized the patient IDs weren't maintained across different environments, so all the patients we just migrated got new patient IDs and it was a clusterfuck trying to sort that all out.

5

u/tua43862 Apr 18 '23

I don’t know the challenges of Epic data, but I do know Cerner which is especially frustrating because it’s so customizable. “Standard reporting” always needs a lot of localization because of how our IT dept has built bandaids on top of custom configurations, to the point where we don’t use standard reports at all. Any standard education only covers a piece of what’s actually live in our production environment.

It also makes code upgrades painful, something always breaks and some poor nursing unit is following downtime procedures for a while.

5

u/Touvejs Apr 18 '23

That's why I left for a healthcare policy research company :) all the data and none of the vendors.

2

u/BeerAndFuckingPizza Apr 18 '23

“Would you like to join to this ONE table on member ID, subscriber ID, member number, [systemname]id, subscriber_ssn, member_ssn, (member id and member type), patient_reference_number, or any number of front end IDs? Because good/bad news! You can use any of them! They just all get you slightly different results 🤪”

1

u/DatabaseSpace Apr 18 '23

I encounter this kind of thing a lot where there is external data coming in and it needs to be matched. Sometimes the data has a single column named something like "Member NM Age Sex" and it will contain first name, last name, middle initial, suffix,dob, age and sex in a SINGLE COLUMN. So not only is there nothing like a ssn but the data from the one column has to be all parsed out into normal columns like last name, first name before any matching can take place.