Validity and Reliability of the Persian Version of Usefulness, Satisfaction, and Ease of use (USE) Questionnaire for Evaluation of Smartphones for Elderly Users

Usability has been defined as the extent to which specific users can efficiently use a product to achieve specific goals. Along with the increased number of the elderly population, there is a need for user-centered products for this group of people. Smartphones are widely used products in modern society. USE (Usefulness, Satisfaction, and Ease of use) questionnaire is an easy-to-use, quick, and accurate instrument to assess product/service usability. Thus, this study was done to determine the validity and reliability of the Farsi version of the USE questionnaire to evaluate the usability of smartphones for elderly users.

The USE questionnaire was developed by Lund (2001) to assess usability, considering four separate dimensions: usefulness, satisfaction, ease of use, and ease of learning. This is a 30-item questionnaire that evaluates usability on a 7-point Likert scale. In order to assess the face and content validity of the questionnaire, a panel of nine experts was asked to rate the relevancy, clarity, simplicity, and necessity of each question using the Likert scale. Subsequently, the Content Validity Ratio (CVR) and Content Validity Index (CVI) were computed. In order to confirm the reliability of the questionnaire, two methods of internal reliability and test-retest reliability were used. In this sense, Cronbach’s alpha was calculated as the measure of internal reliability. Cronbach’s alpha equal to and above 0.7 was considered the minimum acceptable value. To measure the test-retest, 50 old adults (aged 60 years old and above) were asked to answer the questionnaire twice at a two-week interval. Then, the Pearson correlation coefficient was calculated between the two sets of scores. Also, the receiver operating characteristic (ROC) curve was utilized for specifying its sensitivity, specificity, and cut -off point

Based on the comments of the expert panel, CVI scores of all questionnaire items were above 0.78, whereas four items rated less than 0.78 in terms of CVR scores; and, consequently, were removed from the questionnaire. Moreover, according to the reliability assessment results, both internal correlation and test-retest scores obtained acceptable values. Specifically, Cronbach’s alpha coefficient for usefulness, satisfaction, ease of use, and ease of learning were 0.771, 0.862, 0.756, and 0.798, respectively. In the ROC curve, the cut-off point was reported as 4.88 with the sensitivity and specificity of 97.8% and 75%, respectively, and area under the ROC curve at this cut-off point was obtained 81%.

Comparing a product’s characteristics with standards is a prerequisite to determining the level of usability of that product. The Farsi version of the USE questionnaire is a reliable tool for measuring usability with satisfactory validity and reliability. This questionnaire can be used in future studies in smartphone usability.