Search

Introduction: Appraising the quality of studies included in systematic reviews combining qualitative and quantitative evidence is challenging. To address this challenge, a critical appraisal tool was developed: the Mixed Methods Appraisal Tool (MMAT). The aim of this paper is to present the enhancements made to the MMAT. Development: The MMAT was initially developed in 2006 based on a literature review on systematic reviews combining qualitative and quantitative evidence. It was subject to pilot and interrater reliability testing. A revised version of the MMAT was developed in 2018 based on the results from usefulness testing, a literature review on critical appraisal tools and a modified e-Delphi study with methodological experts to identify core criteria. Tool Description: The MMAT assesses the quality of qualitative, quantitative, and mixed methods studies. It focuses on methodological criteria and includes five core quality criteria for each of the following five categories of study designs: (a) qualitative, (b) randomized controlled, (c) nonrandomized, (d) quantitative descriptive, and (e) mixed methods. Conclusion: The MMAT is a unique tool that can be used to appraise the quality of different study designs. Also, by limiting to core criteria, the MMAT can provide a more efficient appraisal.

Abstract Background Participatory Research (PR) entails the co-governance of research by academic researchers and end-users. End-users are those who are affected by issues under study (e.g., community groups or populations affected by illness), or those positioned to act on the knowledge generated by research (e.g., clinicians, community leaders, health managers, patients, and policy makers). Systematic reviews assessing the generalizable benefits of PR must address: the diversity of research topics, methods, and intervention designs that involve a PR approach; varying degrees of end-user involvement in research co-governance, both within and between projects; and the complexity of outcomes arising from long-term partnerships. Methods We addressed the above mentioned challenges by adapting realist review methodology to PR assessment, specifically by developing inductively-driven identification, selection, appraisal, and synthesis procedures. This approach allowed us to address the non-uniformity and complexity of the PR literature. Each stage of the review involved two independent reviewers and followed a reproducible, systematic coding and retention procedure. Retained studies were completed participatory health interventions, demonstrated high levels of participation by non-academic stakeholders (i.e., excluding studies in which end-users were not involved in co-governing throughout the stages of research) and contained detailed descriptions of the participatory process and context. Retained sets are being mapped and analyzed using realist review methods. Results The librarian-guided search string yielded 7,167 citations. A total of 594 citations were retained after the identification process. Eighty-three papers remained after selection. Principle Investigators (PIs) were contacted to solicit all companion papers. Twenty-three sets of papers (23 PR studies), comprising 276 publications, passed appraisal and are being synthesized using realist review methods. Discussion The systematic and stage-based procedure addressed challenges to PR assessment and generated our robust understanding of complex and heterogeneous PR practices. To date, realist reviews have focussed on evaluations of relatively uniform interventions. In contrast our PR search yielded a wide diversity of partnerships and research topics. We therefore developed tools to achieve conceptual clarity on the PR field, as a beneficial precursor to our theoretically-driven synthesis using realist methods. Findings from the ongoing review will be provided in forthcoming publications.

Little research has assessed the fidelity, adaptation or integrity of activities implemented within community-based obesity prevention initiatives. To address this gap, a mixed-method process evaluation was undertaken in the context of the South Australian Obesity Prevention and Lifestyle (OPAL) initiative. An ecological coding procedure assessed fidelity and adaptation of activity settings, targets and strategies implemented in the second year of four communities. Implementation integrity reflected fidelity and adaptation to local context, whereas efforts resulting in significant deviations from the original plan were deemed to lack fidelity and integrity. Staff implemented 284 strategies in 205 projects. Results show that 68.3 and 2.1% of strategies were implemented with fidelity or adapted, respectively. Overall, 70.4% of all strategies were implemented with integrity. Staff experienced barriers with 29.6% of strategies. Chi-square analyses show statistically significant associations between implementation integrity and strategy type, intervention and behavioural targets. These relationships are weak to modest. The strongest relationship was found between implementation integrity and proximal target. Staff experienced implementation barriers at the coalition, policy, organization, interpersonal and community levels. The greatest range of barriers was encountered working with organizations. To overcome these barriers, staff took greater ownership, invested more time, persisted and allocated more financial resources.

Aboriginal Australians, including Aboriginal Health Workers (AHWs), smoke at rates double the non-Aboriginal population. This study utilized concept mapping methodology to identify and prioritize culturally relevant strategies to promote smoking cessation in AHWs. Stakeholder participants included AHWs, other health service employees and tobacco control personnel. Smoking cessation strategies (n = 74) were brainstormed using 34 interviews, 3 focus groups and a stakeholder workshop. Stakeholders sorted strategies into meaningful groups and rated them on perceived importance and feasibility. A concept map was developed using multi-dimensional scaling and hierarchical cluster analyses. Ten unique clusters of smoking cessation strategies were depicted that targeted individuals, family and peers, community, workplace and public policy. Smoking cessation resources and services were represented in addition to broader strategies addressing social and environmental stressors that perpetuate smoking and make quitting difficult. The perceived importance and feasibility of clusters were rated differently by participants working in health services that were government-coordinated compared with community-controlled. For health service workers within vulnerable populations, these findings clearly implicate a need for contextualized strategies that mitigate social and environmental stressors in addition to conventional strategies for tobacco control. The concept map is being applied in knowledge translation to guide development of smoking cessation programs for AHWs.

This study reports on the development and evaluation of a rating tool to assess the scientific utility and cultural appropriateness of community-level indicators for application with Indigenous populations. Indicator criteria proposed by the U.S. Institute of Medicine were culturally adapted through reviewing the literature and consultations with academic and Indigenous stakeholders. Pre-testing and collaborator feedback drove the iterative development of the tool with stakeholder groups in Canada, Aotearoa/New Zealand, and Australia. Pilot testing with 17 raters across countries involved rating the same selection of six health and social indicators using a six-point ordinal scale. The final version of the rating tool includes 16 questions within three criterion domains: "importance," "soundness," and "viability." Academic and community stakeholder review established face and content validity. The indicator rating tool demonstrated good internal consistency and excellent inter-rater reliability for two of three pilot testing groups. Use of this instrument can strengthen collaborative research planning and evaluation with Indigenous communities through selection of relevant and culturally appropriate indicators for application to public health research, prevention programmes, and health and social policy.

Policy implementation reflects a complex change process where government decisions are transformed into programs, procedures, regulations, or practices aimed at social betterment. Three factors affecting contemporary implementation processes are explored: networked governance, sociopolitical context and the democratic turn, and new public management. This frame of reference invites evaluators to consider challenges present when evaluating macrolevel change processes, such as the inherent complexity of health and social problems, multiple actors with variable degrees of power and influence, and a political environment that emphasizes accountability. The evaluator requires a deep and cogent understanding of the health or social issues involved; strong analysis and facilitation skills to deal with a multiplicity of values, interests, and agendas; and a comprehensive toolbox of evaluation approaches and methods, including network analysis to assess and track the interconnectedness of key champions (and saboteurs) who might affect intervention effects and sustainability.

Democratic or equal participation in decision making is an ideal that community and academic stakeholders engaged in participatory research strive to achieve. This ideal, however, may compete with indigenous peoples' right to self-determination. Study objectives were to assess the perceived influence of multiple community (indigenous) and academic stakeholders engaged in the Kahnawake Schools Diabetes Prevention Project (KSDPP) across six domains of project decision making and to test the hypothesis that KSDPP would be directed by community stakeholders. Self-report surveys were completed by 51 stakeholders comprising the KSDPP Community Advisory Board (CAB), KSDPP staff, academic researchers and supervisory board members. KSDPP staff were perceived to share similar levels of influence with (i) CAB on maintaining partnership ethics and CAB activities and (ii) academic researchers on research and dissemination activities. KSDPP staff were perceived to carry significantly more influence than other stakeholders on decisions related to annual activities, program operations and intervention activities. CAB and staff were the perceived owners of KSDPP. The strong community leadership aligns KSDPP with a model of community-directed research and suggests that equitable participation--distinct from democratic or equal participation--is reflected by indigenous community partners exerting greater influence than academic partners in decision making. (Contains 4 tables and 1 figure.)

Health and social indicators that capture the distinct historical, social, and cultural contexts of Indigenous communities can play an important role in informing the planning and delivery of community interventions. There is currently considerable interest in cataloguing and vetting meaningful community-level health and social indicators that could be applied to research and health promotion activities in Indigenous communities in Australia, Canada, and New Zealand, inclusive of conventional indicators as well as measures developed specifically for use in or with Indigenous communities. To avoid haphazard selection of indicators, and to assure the comprehensiveness and relevance of any given set of indicators, a framework that can accommodate and conceptually classify indicators representing a full range of domains is required. We report here on the development of a conceptual framework, by which Indigenous community indicators, and more general community-level social indicators, can be sorted, catalogued, and systematically classified within four hierarchical levels. The indicator framework was developed across Canada, Australia and New Zealand in consultation with academic researchers and Indigenous community stakeholders, building from established health and social indicator systems. The Indigenous indicator framework permits Indigenous communities, public health researchers, and funding agencies to compare and select the most appropriate indicators for application in specific contexts from the multitude of existing indicators.

Purpose: Although implementation fidelity is an important component in the evaluation of school health promotion programs, it assumes that teaching is the most relevant teacher role. To understand the social context of program implementation, a qualitative study was undertaken with the aim of identifying the schoolteacher's role in implementing the objectives of the Kahnawake Schools Diabetes Prevention Project (KSDPP), a locally governed Kanienke:haka (Mohawk) community-based diabetes prevention program. Design/methodology/approach: Prospective semi-structured interviews were conducted cross-sectionally with 30 teachers, two administrators and one physical education teacher across four intervention years. Interviews were analysed retrospectively using qualitative thematic analysis. Findings: In implementing KSDPP objectives teachers adopted, to varying degrees, the roles of teaching the health education curriculum, enforcing the school nutrition policy, role modelling healthy lifestyles, and encouraging healthy lifestyles. Taken together, these roles point to a high-order role of teachers taking responsibility for enabling healthy lifestyles in their children, which is congruent with a wholistic approach to health. Study findings suggest that children in different classrooms were exposed to a different intervention dose based on the extent to which teachers applied each role. Research limitations/implications: The findings suggest that the current conceptualisation of implementation fidelity should be expanded to account for the influence of the social context (i.e. teachers' roles) on the implementation of health promotion program objectives. Originality/value: Consistent with an ecological approach to intervention, teachers would benefit from interventions that predispose, enable, and reinforce their capacity to adopt and apply health promotion roles. (Contains 1 figure and 1 table.)

Assessed how the youth empowerment process encouraged positive youth development. Observation, interview, and focus group data from an urban community health promotion project indicated that practitioners created environments conducive to adolescents taking responsibility for their quality of life by welcoming and enabling youth. Power was transferred to youth as responsibility for voicing, decision making, and action, resulting in positive changes in youth development and their social integration. (SM)

Background: Early obesity prevention research interventions in Australia generally expect participants to be able to communicate in English, but do not account for other languages. This study aimed to investigate engagement, satisfaction, retention and behavioural outcomes of linguistically diverse participants from a mainstream early childhood obesity prevention trial. Methods: Healthy Beginnings is a nurse‐led intervention based in Sydney, supporting families with optimal infant feeding and active play via telephone. This secondary analysis assessed participant engagement in the nurse telephone calls (call completions), satisfaction and behavioural outcomes (6‐ and 12‐month survey data) and retention (survey completions), in the first year of life according to participants' language spoken at home (English or other language). Results: Of 1155 mothers, 533 (46%) spoke a language other than English at home. Significantly fewer mothers speaking a language other than English completed the 6‐month survey (79%) compared to those speaking English (84%), yet mothers speaking a language other than English who completed the program were more satisfied with the program overall. Significantly fewer mothers speaking a language other than English completed the final four nurse calls (of six) (56%‐65%) compared to those speaking English (70%‐80%). Adjusted odds ratios showed selected behavioural outcomes were significantly more positive for participants speaking English at home. Conclusions: Healthy Beginnings trial participants who spoke a language other than English at home had less favourable engagement, retention and behavioural outcomes compared to those who spoke English. So what? Early obesity prevention interventions should consider cultural adaptations to improve engagement and effectiveness among culturally and linguistically diverse families. [ABSTRACT FROM AUTHOR]

Objectives. Report the 8-year impact on body size, physical activity, and diet of a community-based diabetes prevention program for elementary-school children in a Kanien'keha:ka (Mohawk) community in Canada. Methods. Follow-up (1994-1996) of subjects in the intervention and comparison community and repeat cross-sectional measurements in the intervention community alone from 1994 to 2002. Measures included triceps and subscapular skinfold thicknesses, body mass index (BMI), weekly number of 15-minute episodes of physical activity, run/walk test times, television watching, and consumption of sugared foods, fatty foods, and fruits and vegetables. Results. The longitudinal data of 1994-1996 showed some early positive effects of the program on skinfold thickness but not on BMI, physical activity, fitness, or diet. Repeat cross-sectional measures from 1994 to 2002 showed increases in skinfold thickness and BMI. Physical activity, fitness, and television watching showed favorable trends from 1994 to 1999 that were not sustained in 2002. Key high-fat and high-sugar foods consumption decreased, as did consumption of fruits and vegetables. Conclusions. Although early results showed some successes in reducing risk factors for type 2 diabetes, these benefits were not maintained over 8 years. prevention, diabetes, children, community, Indians, North American, community-based participatory research., ABBREVIATION. KSDPP, Kahnawake School Diabetes Prevention Project. The increasing prevalence of childhood obesity and the appearance of type 2 diabetes during adolescence and in particular among Aboriginal youth is a [...]

Community public health interventions based on citizen and community participation are increasingly discussed as promising avenues for the reduction of health inequalities and the promotion of social justice. However, very few authors have provided explicit principles and guidelines for planning and implementing such interventions, especially when they are linked with research. Traditional approaches to public health programming emphasise expert knowledge, advanced detailed planning, and the separation of research from intervention. Despite the usefulness of these approaches for evaluating targeted narrow-focused interventions, they may not be appropriate in community health promotion, especially in Aboriginal communities. Using the experience of the Kahnawake Schools Diabetes Prevention Project, in Canada, this paper elaborates four principles as basic components for an implementation model of community programmes. The principles are: (1) the integration of community people and researchers as equal partners in every phase of the project, (2) the structural and functional integration of the intervention and evaluation research components, (3) having a flexible agenda responsive to demands from the broader environment, and (4) the creation of a project that represents learning opportunities for all those involved. The emerging implementation model for community interventions, as exemplified by this project, is one that conceives a programme as a dynamic social space, the contours and vision of which are defined through an ongoing negotiation process. Keywords: Participatory research; Diabetes prevention; Programme implementation; Community health promotion; Canada

Objective: To evaluate population‐level implementation of Confident Body, Confident Child (CBCC); an evidence‐based program providing parenting strategies to promote healthy eating, physical activity and body satisfaction in children aged 2‐6 years; with community child health nurses (CHNs). Methods: This study utilised an implementation‐effectiveness hybrid design, with dual focus on assessing: (a) CBCC implementation into Child Health Centres at a regional health service in Queensland, Australia (process evaluation); and (b) CBCC's effect on CHNs' knowledge and attitudes (outcomes evaluation). Process (CBCC reach, dose, fidelity) and outcome data (CHN knowledge of child body image; and attitudes towards higher body weights) were collected during implementation, and pre‐ and post‐intervention delivery to CHNs, respectively. Results: Twenty‐six CHNs (all female; mean age 52.7 ± 9.5 years) participated in the study by attending a 1‐day CBCC training workshop and completing demographic and outcome surveys. Process evaluation found that CBCC was implemented as planned and reached 56% of CHNs across the health service. Outcome evaluation showed small but non‐significant improvements in CHN knowledge (P =.077) and attitudes towards overweight (using Anti‐Fat Attitudes scale; significant improvements on willpower sub‐scale only (P <.05)). Discussion: This is the first study to evaluate population‐wide CBCC implementation in a real‐world health service setting with CHNs. Findings highlight the potential for using pragmatic, implementation‐focused methodologies to translate preventive eating disorder programs into community child health services. [ABSTRACT FROM AUTHOR]

Issue addressed: This study aimed to analyse the relationship between peer‐delivered health promotion programmes and student well‐being and to expand the limited body of research examining peer‐to‐peer mental health promotion as experienced by student leaders. Methods: The study was cross‐sectional and focused on the experience of participants of a Sydney‐based University Mental Health Day event, including student leaders, student participants, university staff and industry partners. It adopted a mixed‐method approach to data collection, including a quantitative and a qualitative phase. Results: Results from the quantitative phase demonstrate the benefits of peer‐delivered health promotion programmes to students who receive the event. Results from the qualitative phase of the study provide a deeper insight into the delivery of the event, from both a student leader perspective, and also from the perspective of other stakeholders, who worked closely with student leaders. Two main themes emerged from the qualitative material and are explored in detail: enabling leadership and creating a sense of purpose. Conclusion: The study concludes that, while there is mounting evidence of the benefits of student‐led mental health programmes for both leaders and their peers, more research needs to be carried out to better understand how to optimise these experiences and unlock their full potential with reference to student mental health. So what?: With the ongoing pressure on university student services to support student well‐being not being met with appropriate resourcing, peer‐to‐peer programmes, like the Mental Health and Well‐being Student Ambassador Programme, have a real opportunity to make strides in supporting and promoting student mental health. [ABSTRACT FROM AUTHOR]

Issue addressed: Poor sleep quality is common among university students and can have negative implications for physical, emotional, cognitive and academic wellbeing. Previous research has identified that sleep beliefs and sleep behaviours are associated with poor sleep quality. However, few studies have examined these variables simultaneously. This study explored associations between dysfunctional beliefs about sleep, sleep hygiene and sleep quality in a sample of university students. Methods: Participants were recruited from a pool of undergraduate psychology students and included 120 male students and 145 female students with an average age of 20 years (SD = 5.10). Participants completed an online survey including the Pittsburgh Sleep Quality Index, Dysfunctional Beliefs and Attitudes About Sleep Scale, Sleep Hygiene Index and demographic items. Results: Overall 60.4% of participants (59.4% of women, 40.6% of men) had poor sleep quality. Logistic regression indicated a significant positive association between sleep hygiene and sleep quality, OR = 1.16, P >.001, 95% CI (1.10, 1.23), and no significant relationship between dysfunctional beliefs about sleep and sleep quality, OR = 1.03, P >.79, 95% CI (0.84, 1.26), after adjusting for covariates. Conclusions: Sleep interventions for university students are needed and could focus on common hygiene components, such as using the bed for activities other than sleeping, engaging in arousing activities before bed and how to manage thinking and worrying before bed. So What? The results of the study demonstrate poor sleep quality is common among university students and indicates that sleep interventions are warranted. The positive association found between sleep hygiene and sleep quality highlights that interventions should focus on behavioural components of sleep. [ABSTRACT FROM AUTHOR]