1 / 7

(De-Identified) Record Linkage

Discover duplicates within or between files, addressing lack of unique identifiers and variations in spelling. Explore deterministic and approximate matching methods to balance recall and effectiveness. Evaluate accuracy with anonymous record linkage assessments.

allistair-guthrie
Download Presentation

(De-Identified) Record Linkage

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. (De-Identified) Record Linkage DongqiuyePu, AshrafFarrag, JavedMostafa

  2. Background • Identify duplicates in a file or across files • AKA: Object identification, data cleaning, entity resolution, etc….

  3. Motivation • Lack of unique identifiers • Variations of spelling, misspelling, typo…

  4. For Instance… (A) (B)

  5. Methods In a Nutshell • Deterministic matching: straightforward, no human review needed, but suffer low recall • Approximate matching: harder to implement, human review needed, higher recall

  6. Research Plan • Exact matching • Fuzzy matching for the rest

  7. Evaluating accuracy of anonymous record linkage • Evaluate collision rate of hashing algorithm (most likely will be ZERO)

More Related