Using cognitive interviews to improve a measure of organizational readiness for implementation

Maria McClam, Lauren Workman, Emanuelle M. Dias, Timothy J. Walker, Heather M. Brandt, Derek W. Craig, Robert Gibson, Andrea Lamont, Bryan J. Weiner, Abraham Wandersman, Maria E. Fernandez

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

Background: Organizational readiness is a key factor for successful implementation of evidence-based interventions (EBIs), but a valid and reliable measure to assess readiness across contexts and settings is needed. The R = MC2 heuristic posits that organizational readiness stems from an organization’s motivation, capacity to implement a specific innovation, and its general capacity. This paper describes a process used to examine the face and content validity of items in a readiness survey developed to assess organizational readiness (based on R = MC2) among federally qualified health centers (FQHC) implementing colorectal cancer screening (CRCS) EBIs. Methods: We conducted 20 cognitive interviews with FQHC staff (clinical and non-clinical) in South Carolina and Texas. Participants were provided a subset of items from the readiness survey to review. A semi-structured interview guide was developed to elicit feedback from participants using “think aloud” and probing techniques. Participants were recruited using a purposive sampling approach and interviews were conducted virtually using Zoom and WebEx. Participants were asked 1) about the relevancy of items, 2) how they interpreted the meaning of items or specific terms, 3) to identify items that were difficult to understand, and 4) how items could be improved. Interviews were transcribed verbatim and coded in ATLAS.ti. Findings were used to revise the readiness survey. Results: Key recommendations included reducing the survey length and removing redundant or difficult to understand items. Additionally, participants recommended using consistent terms throughout (e.g., other units/teams vs. departments) the survey and changing pronouns (e.g., people, we) to be more specific (e.g., leadership, staff). Moreover, participants recommended specifying ambiguous terms (e.g., define what “better” means). Conclusion: Use of cognitive interviews allowed for an engaged process to refine an existing measure of readiness. The improved and finalized readiness survey can be used to support and improve implementation of CRCS EBIs in the clinic setting and thus reduce the cancer burden and cancer-related health disparities.

Original languageEnglish (US)
Article number93
JournalBMC Health Services Research
Volume23
Issue number1
DOIs
StatePublished - Dec 2023

Keywords

  • Cognitive interviewing
  • Evidence-based interventions
  • Measure development
  • Organizational readiness
  • Qualitative methods
  • cancer prevention

ASJC Scopus subject areas

  • Health Policy

Fingerprint

Dive into the research topics of 'Using cognitive interviews to improve a measure of organizational readiness for implementation'. Together they form a unique fingerprint.

Cite this