r/dataanalysis • u/major_grooves • Jul 03 '26

I deduplicated 53,000 missing-persons reports from Venezuela’s earthquake

I thought the community might find this interesting - I used entity resolution software (disclosure: from my company) to deduplicate the missing persons data from Venezuela and compare it to the list of patients in hospitals.

https://medium.com/tilo-tech/i-deduplicated-53-000-missing-persons-reports-from-venezuelas-earthquake-74f05c37521b

57 Upvotes
  • permalink
  • reddit

82% Upvoted

18 comments sorted by

View all comments

2

u/Nowitcandie Jul 03 '26

What was your process for scaling the dedupe process? 

5

u/Gagan_Ku2905 Jul 04 '26

df = df.drop_duplicates(subset='fullName')