Application Validation Methods in EHR Evaluation Models: A Systematic Literature Review

Over the last few decades, several theoretical frameworks have been proposed to evaluate electronic health records (EHRs). These frameworks provide a theoretical basis for assessing the impact and outcomes of technology adoption in healthcare settings. This can help identify areas for improvement and ensure that EHRs effectively support healthcare delivery and patient care.

The purpose of this study is to present a comprehensive review of the use of validation methods in Electronic health records.

Out of a total of 62 EHR evaluation frameworks in our previous literature review, at the final stage, 34 relevant articles were included for analysis. Variables such as participants and study setting, analysis software, data gathering methods, missing data, and outlier handling, theoretical basis models to develop the EHR evaluation model, the relationship between variables of the EHR evaluation models with evaluation items, sampling technique and sample size reliability assessment methods and values, and statistical validation methods and criteria values were extracted.

Among the 34 papers that disclosed the validation methods utilized, the most widely used technique was Structural Equation Modeling (SEM), employed in 26.5% of the studies. Other methods utilized were Confirmatory Factor Analysis (CFA), and Exploratory Factor Analysis (EFA). A reliability assessment was performed in 82% of the articles. Cronbach's alpha and composite reliability (CR) were popular reliability (internal validation) methods on identified papers.

It is our belief that the results of this study can assist researchers in examining and modifying EHR evaluation frameworks to suit their specific needs. Additionally, we believe that our findings serve as a solid foundation for the creation of new EHR evaluation frameworks. Furthermore, we recommend that researchers utilize the findings presented in this article to enhance the implementation and utilization of SEM, CFA, and EFA methods in EHR evaluation models.