Please use this identifier to cite or link to this item:
Title: A proposed method to investigate reliability throughout a questionnaire
Authors: Wentzel-Larsen, Tore;Norekvål, Tone M.;Ulvik, Bjørg;Nygård, Ottar;Pripp, Are Hugo
Keywords: VDP::Medical disciplines: 700::Health sciences: 800::Health service and health administration research: 806
Issue Date: 5-Oct-2011
Publisher: BioMed Central
Description: Background: Questionnaires are used extensively in medical and health care research and depend on validity and reliability. However, participants may differ in interest and awareness throughout long questionnaires, which can affect reliability of their answers. A method is proposed for “screening” of systematic change in random error, which could assess changed reliability of answers. Methods: A simulation study was conducted to explore whether systematic change in reliability, expressed as changed random error, could be assessed using unsupervised classification of subjects by cluster analysis (CA) and estimation of intraclass correlation coefficient (ICC). The method was also applied on a clinical dataset from 753 cardiac patients using the Jalowiec Coping Scale. Results: The simulation study showed a relationship between the systematic change in random error throughout a questionnaire and the slope between the estimated ICC for subjects classified by CA and successive items in a questionnaire. This slope was proposed as an awareness measure - to assessing if respondents provide only a random answer or one based on a substantial cognitive effort. Scales from different factor structures of Jalowiec Coping Scale had different effect on this awareness measure. Conclusions: Even though assumptions in the simulation study might be limited compared to real datasets, the approach is promising for assessing systematic change in reliability throughout long questionnaires. Results from a clinical dataset indicated that the awareness measure differed between scales.
Other Identifiers: BMC Medical Research Methodology 2011, 11:137
Appears in Collections:Faculty of Medicine and Dentistry

Files in This Item:
Click on the URI links for accessing contents.

Items in HannanDL are protected by copyright, with all rights reserved, unless otherwise indicated.