What do you think you are measuring? A mixed-methods procedure for assessing the content validity of test items and theory-based scaling

Koller, I., Levenson, M. R., & Glück, J. (2017). What do you think you are measuring? A mixed-methods procedure for assessing the content validity of test items and theory-based scaling. Frontiers in Psychology, 8, 126.doi: 10.3389/fpsyg.2017.00126

Abstract: The valid measurement of latent constructs is crucial for psychological research. Here, we present a mixed-methods procedure for improving the precision of construct definitions, determining the content validity of items, evaluation of representativeness of items for the target construct, generating test items, and analyzing items on a theoretical basis. To illustrate the mixed-methods content-scaling-structure (CSS) procedure, we analyze the Adult Self-Transcendence Inventory, a self-report measure of wisdom (ASTI, Levenson et al., 2005). A content-validity analysis of the ASTI items was used as the basis of psychometric analyses using multidimensional item response models (N = 1,215). We found that the new procedure produced important suggestions concerning five subdimensions of the ASTI that were not identifiable using exploratory methods. The study shows that the application of the suggested CSS mixed-method procedure leads to a deeper understanding of latent constructs and shows the advantages of theory-based item analysis.

Read the article: Koller, I., Levenson, M. R., & Glück, J. (2017). What do you think you are measuring? A mixed-methods procedure for assessing the content validity of test items and theory-based scaling. Frontiers in Psychology, 8, 126. doi: 10.3389/fpsyg.2017.00126



(Something interesting I found)Posted:Feb 01 2017, 12:00 AM by jlmatelski
Join the Network    
Users are able to post wisdom-related news & publications, maintain a profile, and participate in discussion forums.

Sort By