Improving Fellegi-Sunter ‎model in record linkage using log-linear model and weight ‎adjustment ‎

Message:
Article Type:
Research/Original Article (دارای رتبه معتبر)
Abstract:

‎T‎oday, with the increasing access to administrative databases and the high volume of data registered in organizations, the traditional methods of data collection and analysis are not effective due to the response burden. Accordingly, the transition from traditional ‎survey methods to modern methods of data collection and analysis with the register-based statistics approach has received more and more attention from statistical data analysts. In register-based methods, it is especially important to create an integrated database by linking database records of different organizations. ‎Many record linkage algorithms have been developed using the Fellegi and Sunter ‎‎‎model‎. ‎The Fellegi-Sunter model does not leverage information contained in field values and does not care about specific possible values of a string variable (more common and less common values)‎. ‎In this ‎‏‎article‎, ‎a method that can be able to infuse these differences in specific possible values of a string variable in the Fellegi-Sunter model is presented‎.‎ ‎‎‎On the ‎other, ‎‎the ‎‎model proposed by Fellegi-Sunter‎, ‎as well as the method for adjusting the matching weights in the frequency-based record linkage‎, ‎binding in this paper, ‎are based on the assumption of conditional independence‎. ‎In some applications of record linkage‎, ‎this assumption is not met in agreement or disagreement of common variables which are used for matching‎. ‎One solution used in such a case is to use log-linear model which allows interactions between matching variables in the model‎.‎‎ In this ‎‏‎article‎, ‎we deal with two generalizations of Fellegi-Sunter ‎‎‎‎‎model, ‎one with the correction of the matching weights and the other with using a log-linear model with interactions in absence of conditional independence‎. ‎The proposed methods are implemented on labour force data set of Statistical Centre of Iran using R‎.

Language:
Persian
Published:
Journal of Statistical Sciences, Volume:17 Issue: 1, 2023
Pages:
177 to 199
https://magiran.com/p2606701