Goodman, Melody S., Ackermann, Nicole, Haskell-Craig, Zoé, Jackson, Sherrill, Bowen, Deborah J., and Sanders Thompson, Vetta L.
Background: The Research Engagement Survey Tool (REST) was developed to examine the level of partner (e.g., patients, caregivers, advocates, clinicians, community members) engagement in research studies. The REST is aligned with eight engagement principles based on the literature and consensus reached through a five round Delphi process. Each of the engagement principles has three-five corresponding items that are assessed on two Likert type scales quantity (how often: never, rarely, sometimes, often, always, not applicable) and quality (how well: poor, fair, good, very good, excellent, not applicable). We conducted a comprehensive validation of the REST. Despite the importance of partner engagement in research, currently no gold standard measure exists. Methods: Multiple strategies were employed to validate the REST. Here, we examine the internal consistency of items for each of the eight engagement principles. In addition, we examine the convergent validity of the comprehensive (32-item) REST with other measures (e.g., medical mistrust, Community Engagement in Research Index, Partnership Self-Assessment Tool, Wilder collaboration inventory, Partnership Assessment In community-based Research). We propose two scoring approaches for the REST; one aligned with the engagement principles and the other aligned with levels of community engagement: (1) outreach and education, (2) consultation, (3) cooperation, (4) collaboration, and (5) partnership. Results: The REST has strong internal consistency (Cronbach's alpha > 0.75) for each of the eight engagement principals measured on both scales (quality and quantity). The REST had negligible (e.g., medical mistrust, community engagement in research index), low (e.g., Partnership Assessment In community-based Research, Partnership Self-Assessment Tool- benefits scale), and moderate (e.g., Wilder collaboration inventory, Partnership Self-Assessment Tool- synergy scale) statistically significant correlations with other measures based on the Spearman rank correlation coefficient. These results suggest the REST is measuring something similar and correlated to the existing measures, but it captures a different construct (perceived research engagement). Conclusions: The REST is a valid and reliable tool to assess research engagement of community health stakeholders in the research process. Valid tools to assess research engagement are necessary to examine the impact of engagement on the scientific process and scientific discovery and move the field of stakeholder engagement from best practices and lessons learned to evidence-based approaches based on empirical data. Plain English summary: Researchers often conduct studies with partners (e.g., patients, caregivers, advocates, clinicians, community members) who also have an interest in the research topic. Depending on the research study the level of partner engagement in the research process may be high or low. Partners may be involved from the beginning including determining what topic to study and what questions the study should examine. They may suggest who should be included in the study, the geographic area of focus, and the outcome measures to be examined. In addition, they may help recruit study participants, interpret study results, and plan for how to share the results with those that need to know. No standard way exists to find out how involved a partner has been in a study from the partner's perspective. Here we develop and validate survey questions to measure the level of partner engagement in research studies. We looked at existing survey questions used to measure similar topics to make sure that a person who takes the survey gets consistent scores. We tested the survey with community health stakeholders (e.g., patients, caregivers, advocates, clinicians, community members) who are research partners for studies at universities across the United States. Over 2 years, the partners took different versions of the survey online four times. We used the data we collected from each survey to revise the questions and make sure that it measures partner involvement accurately and reliably. The Research Engagement Survey Tool (REST) has 32 questions to examine eight engagement principles on two scales: quantity (how much) and quality (how well). The REST is a valid and reliable tool to examine partner engagement in research. [ABSTRACT FROM AUTHOR]