Category: Dissemination / Implementation

Symposium

Symposium 36 - Advancing the Pragmatic Measures Construct and Three New Measures of Implementation Outcomes

Friday, November 17
12:45 PM - 1:45 PM
Location: Indigo Ballroom B, Level 2, Indigo Level

Keywords: Implementation | Measurement
Presentation Type: Symposium

Science is measurement, yet implementation science is beset with measurement challenges, making it difficult to investigate the impact of mechanisms and even more challenging to inform implementation strategy selection in real world contexts. First, there are key implementation outcomes for which no psychometrically strong measures exist. Second, there are numerous measures for which their quality is unknown or questionable. Third, although rating systems exist to evaluate measures’ psychometric properties, no parallel rating criteria exist for assessing the pragmatic strength of measures. These interrelated knowledge gaps informed the development of three aims. The first aim is to establish a stakeholder-driven operationalization of pragmatic measures and develop reliable, valid rating criteria for assessing the construct. Structured web-based activities (e.g., Concept Mapping, Delphi) and involvement of an international stakeholder advisory panel led to four domains of the pragmatic construct and 5-point reliable and valid anchors for rating measures. The second aim is todevelop reliable, valid, and pragmatic measures of three critical implementation outcomes, acceptability, appropriateness, and feasibility. Using laboratory and field studies, twelve items were developed that demonstrate both psychometric and pragmatic strength. The third aim is to identify Consolidated Framework for Implementation Research and Implementation Outcome Framework-linked measures that are of high quality. Over 400 measures were identified, with the minority exhibiting sufficient psychometric and pragmatic properties for second use. This work reveals a comprehensive measurement-focused research agenda for implementation science and provides empirically supported measures, tools, and methods for accomplishing this work. The results of this work have the potential to guide strategy selection and mechanism identification in the “real world” to inform practical implementation.

Learning Objectives:

Cara C. Lewis

Associate Scientific Investigator
Kaiser Permanente Washington Health Research Institute

Presentation(s):

Send Email for Cara Lewis

Send Email for Gregory Aarons

Cameo Stanick

Vice President of Clinical Training, Evidence-Based Practices, and Research and Evaluation
Hathaway-Sycamores Child and Family Services

Presentation(s):

Send Email for Cameo Stanick

Bryan Weiner

Professor
University of Washington

Presentation(s):

Send Email for Bryan Weiner

Cara C. Lewis

Associate Scientific Investigator
Kaiser Permanente Washington Health Research Institute

Presentation(s):

Send Email for Cara Lewis


Assets

Symposium 36 - Advancing the Pragmatic Measures Construct and Three New Measures of Implementation Outcomes



Attendees who have favorited this

Please enter your access key

The asset you are trying to access is locked. Please enter your access key to unlock.

Send Email for Advancing the Pragmatic Measures Construct and Three New Measures of Implementation Outcomes