Developing measures to assess constructs from the Inner Setting domain of the Consolidated Framework for Implementation
- PDF / 545,137 Bytes
- 13 Pages / 595.276 x 790.866 pts Page_size
- 55 Downloads / 212 Views
RESEARCH
Open Access
Developing measures to assess constructs from the Inner Setting domain of the Consolidated Framework for Implementation Research Maria E. Fernandez1*, Timothy J. Walker1, Bryan J. Weiner2, William A. Calo3, Shuting Liang4, Betsy Risendal5, Daniela B. Friedman6, Shin Ping Tu7, Rebecca S. Williams8, Sara Jacobs9, Alison K. Herrmann10 and Michelle C. Kegler4
Abstract Background: Scientists and practitioners alike need reliable, valid measures of contextual factors that influence implementation. Yet, few existing measures demonstrate reliability or validity. To meet this need, we developed and assessed the psychometric properties of measures of several constructs within the Inner Setting domain of the Consolidated Framework for Implementation Research (CFIR). Methods: We searched the literature for existing measures for the 7 Inner Setting domain constructs (Culture Overall, Culture Stress, Culture Effort, Implementation Climate, Learning Climate, Leadership Engagement, and Available Resources). We adapted items for the healthcare context, pilot-tested the adapted measures in 4 Federally Qualified Health Centers (FQHCs), and implemented the revised measures in 78 FQHCs in the 7 states (N = 327 respondents) with a focus on colorectal cancer (CRC) screening practices. To psychometrically assess our measures, we conducted confirmatory factor analysis models (CFA; structural validity), assessed inter-item consistency (reliability), computed scale correlations (discriminant validity), and calculated inter-rater reliability and agreement (organization-level construct reliability and validity). Results: CFAs for most constructs exhibited good model fit (CFI > 0.90, TLI > 0.90, SRMR < 0.08, RMSEA < 0.08), with almost all factor loadings exceeding 0.40. Scale reliabilities ranged from good (0.7 ≤ α < 0.9) to excellent (α ≥ 0.9). Scale correlations fell below 0.90, indicating discriminant validity. Inter-rater reliability and agreement were sufficiently high to justify measuring constructs at the clinic-level. Conclusions: Our findings provide psychometric evidence in support of the CFIR Inner Setting measures. Our findings also suggest the Inner Setting measures from individuals can be aggregated to represent the clinic-level. Measurement of the Inner Setting constructs can be useful in better understanding and predicting implementation in FQHCs and can be used to identify targets of strategies to accelerate and enhance implementation efforts in FQHCs. Keywords: Consolidated Framework for Implementation Research, CFIR, Inner Setting, Measurement of implementation, Implementation science, Colorectal cancer screening implementation
* Correspondence: [email protected] 1 University of Texas Health Science Center at Houston, Center for Health Promotion and Prevention Research, School of Public Health, 7000 Fannin St, Houston, TX 77030, USA Full list of author information is available at the end of the article © The Author(s). 2018 Open Access This article is distributed under the terms of the Cre
Data Loading...