Search

Objective Discrimination reported by mental health service users in England is high. The study aims to determine changes in mental health-related discrimination from 2008 to 2014. Methods Samples of mental health service users were interviewed from 2008 to 2014 using the Discrimination and Stigma Scale version 12. Social capital in terms of access to social resources is a marker of discrimination in terms of effects on social connections, and so from 2011, social capital also measured using the Resource Generator- UK. Results Fewer participants reported discrimination in one or more life areas in 2014 compared to 2008 ( OR: 0.58, 95% CI 0.36 to 0.94 P = 0.03). A weighted multiple regression model found a decrease in overall discrimination in 2014 compared to 2008 (mean difference: −13.55, 95% CI: −17.32 to −9.78, P < 0.001). There was not a consistent in discrimination decline between each year. No differences in access to social resources were found. Conclusions Discrimination has fallen significantly over 2008-2014, although there was not a consistent decline between years. There is no evidence that social capital has increased. [ABSTRACT FROM AUTHOR]

This final article explores some of the unique and common connections the seven early and influential evaluators have made between their extraprofessional and professional evaluation lives, as reflected in their comments and stories in their individual articles and one prominent theme noted across all cases: These evaluators described how their values developed and eventually shaped their evaluation approaches. In addition, some subthemes are identified and questions for further study are posed. Following, in one page each, the seven authors review their colleagues' articles and offer their own responses regarding what they learned from each other and what possible implications they foresee for future evaluation. Based on these reviews, readers are invited to think about possible implications for their own and their clients' evaluation lives. The entire document invites readers to relate to evaluation less as a technology and more as a values-based activity involving their own values and those of other participants in their evaluations. [ABSTRACT FROM AUTHOR]

Research Summary In this paper, we argue that both science and the policy process are well served by research with high evidentiary value. We also argue that experimental research is valuable in the policy domain not only because of its high evidentiary content but also because of its transparency. To exemplify this point, we describe how a decade-long research program on hot spots policing overturned the conventional wisdom that police could not affect crime and, in so doing, has profoundly altered police practice. Still, we recognize that for a variety of practical and ethical reasons, policy-relevant research on policing and criminal justice policy more generally cannot be based entirely on experiments. We discuss two key features of randomization-balance in expectation between the treated and the control group on all potential confounders and exogeneity of treatment status-that are the source of the high evidentiary status of randomized experiments. We go on to describe how these same two features can be credibly replicated in quasi-experimental studies that are not subject to the ethical and practical obstacles that may make experiments impractical in some circumstances. Policy Implications We urge criminologists to take greater advantage of quasi-experimental research opportunities. We also recommend that criminologists go beyond simply identifying such opportunities. They should engage practitioners and policy makers and make clear what is required to allow for strong evidence of program effectiveness. [ABSTRACT FROM AUTHOR]

Recent meta-analytic efforts have documented how couple and relationship education (CRE) programs promote healthy relationship and family functioning. The current meta-analysis contributes to this body of literature by examining stepfamily couples, an at-risk, subpopulation of participants, and assessing the effectiveness of CRE programs for individuals in these relationships. Findings are aggregated from 14 evaluation studies of CRE programs designed for stepcouples. Analyses examine effects by study design (i.e., comparison-group and one-group/pre-post) and within specific domains (i.e., family, parental, and couple functioning). The interventions have, on average, small effects overall (comparison-group: d = .20 ; one-group/pre-post: d = .23 ), and slightly larger effects in family and parental functioning when examining specific outcomes (d = .20 to .35). An examination of effectiveness over time reveals that earlier studies (i.e., 1980s and 1990s) show larger effects than more recent studies. Implications for CRE programs for stepfamilies and evaluation needs are discussed. [ABSTRACT FROM AUTHOR]

In the field of youth violence prevention, there has been increasing emphasis on 'evidence based' programs and principles shown through scientific research as reaching their intended outcomes. Community mobilization and engagement play a critical role in many evidence-based programs and strategies, as it takes a concerted effort among a wide range of people within a community to alter behavior and maintain behavioral change. How do concerned individuals and groups within a community engage others within and outside of that community to effectively plan, develop and implement appropriate EB programs as well as evaluate the outcomes and impacts of locally developed programs yet to be proven? The authors discuss five elements essential for community engagement in evidence-based youth violence prevention based on their work in a university-community partnership through the Asian/Pacific Islander Youth Violence Prevention Center (API Center), a National Academic Center for Excellence on Youth Violence Prevention Center supported by the Centers for Disease Control and Prevention. They include: (a) aligning EBPs with a community's shared vision and values; (b) establishing an inclusive environment for the planning, implementation and evaluation of EBPs; (c) nurturing collaboration for increased effectiveness and efficacy of EBPs; (d) building adequate leadership and community capacity to develop and sustain EBPs; and (e) building a learning community for evaluation and self-reflection. The authors propose placing greater emphasis on 'evaluative thinking' and organizational capacity for evaluation as we pursue evidence-based practices for youth violence prevention. This is especially important for ethnic groups for which an evidence base is not well established. [ABSTRACT FROM AUTHOR]

Opportunities for the evaluation of multinational projects offer potential for insights into project operations and effects across sites, cultures, nations, and regions. The author discusses the value of building robust multinational evaluations, practical considerations for gaining ethical clearances in diverse settings, and ways to accommodate projects with varied implementation processes and goals. © Wiley Periodicals, Inc., and the American Evaluation Association [ABSTRACT FROM AUTHOR]

Background: Evaluation research is a form of applied research that scrutinises how well a particular programme, practice, procedure or policy is operating. Evaluation researchers use both quantitative and qualitative research data to construct a collective picture of the programme under evaluation. Context: Medical educators need to provide information about a particular programme using the methods of evaluation research in order to make a decision on the potential adoption, improvements and refinements of the programme. Improving curricula and pedagogical methods using these methods may enhance health care education. Innovation: We provide an overview of the methods of evaluation research in the context of medical education. We discuss the application, general methodology, methods of collecting data and analysis for each type of evaluation research. Implications: The methods of evaluation research described in this article enable medical educators to gain a comprehensive understanding of evaluation research in the context of medical education. The use of evaluation research findings helps medical educators to make informed decisions regarding a programme and any future actions related to it. [ABSTRACT FROM AUTHOR]

The literature on local action groups offers various reflections on whether the LEADER initiative is elitist or inclusive. As one of seven key concepts behind the LEADER method, the bottom-up concept spurs an expectation that LEADER is more able to involve the average citizen than other programmes. Until now, however, only scarce information on the composition of the LEADER boards has been available to tell us if this is really so at the decision-making level. A survey from 2008 examining the composition of the 55 local action groups established in the 2007–2013 Danish Rural Development and Fisheries Programmes shows that most of the board members are extremely well-educated older men who hold many other posts in society. This lopsided representation is discussed for its problems and potentials from two opposing theoretical angles: from a perspective of post-liberal theories of inclusive democracy and the relative autonomy of elites and sub-elites. [ABSTRACT FROM AUTHOR]

Aim: Research focusing on competence assessment of practicing nurses has recently increased. However, few generic instruments are available for this purpose. This study reports cultural validation of the Italian version of the Nurse Competence Scale (NCS, English version) by exploring nurses’ perceptions of the use of the NCS instrument. Methods: Content validity of the Italian version of the NCS was assessed during the translation and back-translation process. Thereafter, cultural validity was further explored by conducting self-assessments and semi-structured interviews with 10 nurses, who practise medicine, cardiology and intensive care wards. First, the Italian version of the 73-item NCS was used to assess nurses’ competence levels and the frequency of using competencies in practice settings. Second, semi-structured interviews were conducted to evaluate nurses’ perceptions of the use of the instrument. Results: The advanced beginners obtained a high overall competence level and the experienced nurses a very high overall competence level. These results are similar with the earlier findings of nurse competence levels with the NCS. The overall frequency of using NCS competencies in clinical practice indicated good cultural validity of the instrument. The instrument was considered easy to understand and to complete, and the Italian version was considered to express the domain of nursing. However, a need to make semantic specifications for some items for the Italian version was pointed out. Conclusions: This explorative pilot study reports a first phase cultural validation process. Carefully performed translation alone does not ensure validity of translated instrument. Interview method is recommended to deepen the understanding of concept in question and the content validity of the instrument. The results support previous research findings of the use of the NCS instrument and show that it could be very useful in competence assessment for Italian nurses. [ABSTRACT FROM AUTHOR]

Five knowledge-for-action theories are summarized and compared in this chapter for their evaluation implications: knowledge utilization, diffusion, implementation, transfer, and translation. Usually dispersed across multiple fields and disciplines, these theories are gathered here for a common focus on knowledge and change. Knowledge in some form (ideas, innovation, skills, or policy) moves in some direction (laterally, hierarchically, spreads, or exchanges) among various stakeholders (knowledge producers, end users, or intermediaries) and contexts (national, community, or organizational) to achieve some outcomes (intended benefits, unanticipated outcomes, or hijacked effects). Although rooted in different disciplines, sensitive to different key indicators, and following different process paths, these theories individually and collectively provide multiple lenses on the evaluation of complex interventions. A table compares key theory points of disciplinary roots, type of knowledge, movement of knowledge, contextual influences, and the added lens of each theory. These lenses are used to analyze the set of theories for evaluation implications. © Wiley Periodicals, Inc., and the American Evaluation Association. [ABSTRACT FROM AUTHOR]

Knowledge utilization is a field crossing many sectors, from agriculture, since the 1920s, to health care today. Evaluators have made long-standing contributions to understanding knowledge utilization. Different models or ways to think about knowledge utilization have evolved to reflect different perspectives, contexts, and stages of the process, from knowledge creation to the use of effectiveness results in policymaking. The rich interdisciplinary history of this field challenges evaluators to interrogate what knowledge (really) means within a policy or program—whether knowledge is being used more symbolically, rhetorically, or tactically, for example. Differences in program or policy effectiveness across different program sites might result from different types of knowledge use in those sites. © Wiley Periodicals, Inc., and the American Evaluation Association. [ABSTRACT FROM AUTHOR]

Whether looking at the spread and adoption of an intervention across a community, across multiple units, or within a single unit, an understanding of diffusion theory can help evaluators uncover patterns and impacts that might otherwise be overlooked. The theory alerts evaluators to examine why uptake of an intervention appeared different in different sites, according to the characteristics of the people involved, the social systems involved (for example, neighborhoods, states, or organizations), or the communications channels used. Insights might explain intervention intensity across sites and consequent differential effects. It also yields useful information to assist with subsequent replication of the intervention by practitioners and policymakers. © Wiley Periodicals, Inc., and the American Evaluation Association. [ABSTRACT FROM AUTHOR]

Policy implementation reflects a complex change process where government decisions are transformed into programs, procedures, regulations, or practices aimed at social betterment. Three factors affecting contemporary implementation processes are explored: networked governance, sociopolitical context and the democratic turn, and new public management. This frame of reference invites evaluators to consider challenges present when evaluating macrolevel change processes, such as the inherent complexity of health and social problems, multiple actors with variable degrees of power and influence, and a political environment that emphasizes accountability. The evaluator requires a deep and cogent understanding of the health or social issues involved; strong analysis and facilitation skills to deal with a multiplicity of values, interests, and agendas; and a comprehensive toolbox of evaluation approaches and methods, including network analysis to assess and track the interconnectedness of key champions (and saboteurs) who might affect intervention effects and sustainability. © Wiley Periodicals, Inc., and the American Evaluation Association. [ABSTRACT FROM AUTHOR]

Translation theory originates in the field of applied linguistics and communication. The term knowledge translation has been adopted in health and other fields to refer to the exchange, synthesis, and application of knowledge. The logic model is a circular or iterative loop among various knowledge translation actors (knowledge producers and users) with translation activities evolving and occurring at various stages. Successful knowledge translation depends on the engagement of the target audience, as well as using the knowledge to inform decisions and have a positive influence on health outcomes. Understanding this alerts the evaluator to how to maximize the likely usefulness and sustainability of their evaluation research with local stakeholders. It also invites evaluators to help appreciate why programs have the short- and long-term effects that they have, particularly any unintended or unexpected program outcomes that might have otherwise been puzzling. © Wiley Periodicals, Inc., and the American Evaluation Association. [ABSTRACT FROM AUTHOR]

Transfer is a term used in many fields to describe a change process involving movement of knowledge, skills, or policy from one place to another. The central components of transfer invite the evaluator to conceptualize the change process in terms of a starting point, different understandings of what is being transferred, the medium or mechanism, the concomitant agents, the purpose, and the ending point. Technological models of transfer can be contrasted with learning models of transfer. This means that the educational technology of the intervention might be easily transferred, for example, but not the organizational engagement and inquiry process associated with it. Such scenarios are common in fields where capacity varies widely from place to place. It is therefore crucial to surface what was actually implemented, especially if programs have the same name in various sites, but in reality have replicated very different forms of the program. © Wiley Periodicals, Inc., and the American Evaluation Association. [ABSTRACT FROM AUTHOR]

This study was designed to examine whether self-esteem can be used as a source of evaluative conditioning, and whether implicit or explicit self-esteem was more predictive of the evaluative conditioning effect. Moreover, the role of contingency awareness in the acquisition of the evaluative conditioning effect was also examined. Words related to the self and a general other were served as unconditioned stimuli (USs) in the evaluative conditioning process in order to see whether the evaluation could be transferred to neutral, abstract paintings after 10 times of pairing. An evaluative conditioning effect was demonstrated in that the evaluation of the paintings became more positive after repeatedly paired with words about the self but not words about general others. Implicit self-esteem predicted the magnitude of the evaluative conditioning effect, while the association between explicit self-esteem and the evaluative conditioning effect was nonsignificant, both with and without the effect of contingency awareness being controlled for. Copyright © 2009 John Wiley & Sons, Ltd. [ABSTRACT FROM AUTHOR]

The article offers information on the forum between Colleen Hiner and Michael Rios pertaining to the book "Participatory Action Research Approaches and Methods: Connecting People, Participation and Place." The author of the book states that their publication aims to provide links between practices with social and environmental sciences. However, critique states that the book does not answer the question on how do PAR approaches and methods contribute to geographical knowledge.

Both at a conceptual and an empirical level, infra-humanization has been put on par with the relative greater attribution of uniquely human emotions to the in-group, assuming that a group's humanity is exclusively a matter of having uniquely human characteristics. In the present research we suggest that people also adopt another strategy to infra-humanize the out-group by considering those aspects that characterize and differentiate the in-group from the out-group as more uniquely human. In three studies, characteristics presented as typical of the in-group and the out-group were judged on a not uniquely human-uniquely human dimension. In addition to humanity, in Study 3 participants judged in-group and out-group characteristics also on an evaluative dimension. Consistent with the hypothesis, participants judged in-group characteristics as more human than those of the out-group, independent of their valence. The implications of these results for infra-humanization theory are discussed. [ABSTRACT FROM AUTHOR]

Te Runanga o Te Rarawa is the tribal council representing the interests of the marae (tribal commons) and hapu (a subtribal kin group) that make up the iwi (a Maori tribe) of Te Rarawa in the far north of Aotearoa/New Zealand. In April 2005, officials approached us to help them secure a valuable funding stream tagged to marshalling resources for material development in the area. They sought curriculum vitae and assistance in reframing the funding specifications. Intrigued, armed with a conceptual toolkit drawn from Gibson-Graham's ideas of post-development and asset-based community mapping, and confident that we could add value, we agreed to help. This paper examines the complex politics of our involvement and our changing positioning as researcher subjects. We argue that negotiating a politics of knowledge for projects of this nature requires engagement in complex representational politics of place and divisive identity politics that rage around it. There are no easy protocols for outside researchers, but with appropriate humility and sensitivity to these politics, we can rely on, and should stand up for, the value of our work, which lies in commitments to excellence in scholarship. We cannot and should not seek to control these politics, which will chew us up and spit us out – humanely and with good grace or otherwise. However, good academic work will recognise and adapt to them. In our particular case, we argue that our work had significant value; and in this paper, we trace the production of this value. [ABSTRACT FROM AUTHOR]

The UK National Health Service (NHS) workforce has recently seen the arrival of the Graduate Mental Health Worker (GMHW) in primary care. We established a Quality Improvement Collaborative to assist in embedding this new workforce in one Strategic Health Authority Area of England. The intervention utilised ‘collaborative’ technology which involves bringing together groups of practitioners from different organizations to work in a structured way to improve the quality of their service. The process was evaluated by an action research project in which all stakeholders participated. Data collection was primarily qualitative. During the project, there was an increase in throughput of new patients seen by the GMHWs and increased workforce satisfaction with a sense that the collaborative aided the change process within the organizations. Involvement of managers and commissioners from the Primary Care Trusts where the GMHWs were employed appeared to be important in achieving change. This was not, however, sufficient to combat significant attrition of the first cohort of workers. The project identified several barriers to the successful implementation of a new workforce for mental health problems in primary care, including widespread variation in the level and quality of supervision and in payment and terms of service of workers. A collaborative approach can be used to support the development of new roles in health care; however, full engagement from management is particularly necessary for success in implementation. The problems faced by GMHWs reflect those faced by other new workers in healthcare settings, yet in some ways are even more disturbing given the lack of governance arrangements put in place to oversee these developments and the apparent use of relatively unsupported and inexperienced novices as agents of change in the NHS. [ABSTRACT FROM AUTHOR]

Title. Improving district nurses’ confidence and knowledge in the principles and practice of palliative care. Aim. This paper is a report of part of an evaluation of the impact of a national palliative care education and support programme on the knowledge and confidence of members of district nursing teams. Background. District nursing teams are the mainstay of ‘hands on’ provision of care at home. In recognition of their central role, the English Department of Health commissioned a national palliative care education programme as postregistration education had been limited. Methods. The evaluation, conducted between 2002 and 2004, had a mixed methods design. In the summative component, 1280 nurses were randomly selected from eight cancer networks to receive postal questionnaires 1 year apart, before and after the educational intervention. Changes in scores were calculated and a multiple regression analysis undertaken to identify predictors of improvement in confidence in competence and knowledge. The formative component involved qualitative interviews with a sub-sample of 39 district nurses participating in the programme. Findings. Nurses who responded in both years (374/32%) were included in the analysis. There was a small statistically significant increase in confidence in palliative care competency and knowledge after participation in the educational programmes. Nurses without district nursing qualifications and who had never worked in specialist palliative care had the largest improvements in scores. Qualitative data supported these findings. Conclusion. The findings suggest that the education programme led to improvements in self-reported district nursing confidence in palliative care competencies and knowledge; it is likely that the baseline level of palliative care confidence in competency and knowledge has as a result been raised nationally. [ABSTRACT FROM AUTHOR]

Introduction and Aims. In an era of health care rationalisation, residential detoxification services catering for drug- and alcohol-dependent homeless people are being closed. The principal findings of a recent evaluation of a non-medicated residential detoxification service are presented. The aims were to describe the characteristics of residents, their experience of admission, rates of withdrawal completion, referral patterns, staff and key informant perceptions of the service and its role within the wider treatment system. Design and Methods. A process evaluation was utilised incorporating interviews with residents (n = 80) and key informants (n = 13); a survey of all service staff (n = 10); and demographic and clinical data for all residents (n = 392) admitted over one calendar year. Results. Residents were heavily substance-dependent and marginalised, with many exhibiting substantial mental and physical health impairments. Polydrug use and frequent prior engagement with drug and alcohol services were common. The majority completed withdrawal and were referred to further treatment. Residents who presented for heroin and other opiate withdrawal were more likely than other residents to leave before completing treatment (odds ratio 2.47, 95% confidence interval 1.48 - 4.15). Information from key informants, service staff and residents converged in underscoring the important role performed by the service. Discussion and Conclusion. Out-patient detoxification for homeless and severely drug- and alcohol-dependent populations is unrealistic. For this group, access to residential detoxification is vital as it provides an environment where potentially serious medical and psychological complications can be managed. There continues to be a clear role for supervised withdrawal in such a setting. [Silins E, Sannibale C, Larney S, Wodak A, Mattick R. Residential detoxification: Essential for marginalised, severely alcohol- and drug-dependent individuals. Drug Alcohol Rev 2008;27:414-419] [ABSTRACT FROM AUTHOR]

Qualitative methods can do much to describe context and illuminate the “why” behind patterns encountered in institutional assessment. Alone, or in combination with quantitative methods, they should be the approach of choice for many of the most important assessment questions. [ABSTRACT FROM AUTHOR]

This chapter presents a case report of Canada's International Development Research Centre's success in revamping its project reporting system. The new process has transformed the organization's culture and deepened evaluative capacity, thus promoting accountability for the management of public funds and the ability to learn and improve. [ABSTRACT FROM AUTHOR]

The authors draw on empirical research on evaluation to consider how process use has been operationalized to date and what this may mean for ongoing research in this area. [ABSTRACT FROM AUTHOR]

This chapter describes the results of an exploratory study that sought to understand what U.S. American Evaluation Association members think process use looks like in practice. [ABSTRACT FROM AUTHOR]

This chapter describes the issues surrounding evaluation process use in a large, national, multilevel, multisite evaluation funded by the National Science Foundation. Two key questions that emerge from this chapter are to what extent a multilevel core evaluation can affect evaluation process use and what types of process use can be affected. [ABSTRACT FROM AUTHOR]

Over time, intentional process use can have the practical effect of building the evaluation capacity of an organization. This chapter outlines possible steps that take purposeful advantage of the evaluation process. [ABSTRACT FROM AUTHOR]

There are a number of tools available for organizations wishing to measure and subsequently develop Continuous Improvement (CI). In this article, we review and evaluate a well-accepted CI development model, namely the CI Maturity Model ( Bessant and Caffyn, 1997 ), against data collected from the 2nd Continuous Improvement Network Survey and a number of empirical cases described in the literature. While the CI Maturity Model suggests that CI maturation ought to be a linear process, the findings in this article suggest that there are feasible alternatives for companies to develop CI capability. [ABSTRACT FROM AUTHOR]

This paper traces the history of socio-technical design, emphasizing the set of values it embraces, the people espousing its theory and the organizations that practise it. Its role in the implementation of computer systems and its impact in a number of different countries are stressed. It also shows its relationship with action research, as a humanistic set of principles aimed at increasing human knowledge while improving practice in work situations. Its evolution in the 1960s and 1970s evidencing improved working practices and joint agreements between workers and management are contrasted with the much harsher economic climate of the 1980s and 1990s when such principled practices, with one or two notable exceptions, gave way to lean production, downsizing and cost cutting in a global economy, partly reflecting the impact of information and communications technology. Different future scenarios are discussed where socio-technical principles might return in a different guise to humanize the potential impact of technology in a world of work where consistent organizational and economic change are the norm. [ABSTRACT FROM AUTHOR]

This chapter offers firsthand experiences in optimizing the organizational and personal dimensions of evaluation research in an independent, entrepreneurial consulting environment. [ABSTRACT FROM AUTHOR]

The essay discusses the importance of program quality in corrections, in light of research by Lowenkamp, Latessa, and Smith (2006), which mentions the influence of program integrity on recidivism. A comprehensive model of program planning, development and evaluation can increase the effectiveness of correctional interventions. Topics include evaluation of programmatic variations by the CPAI metric, the methodologies of evaluability assessment and process evaluation, and the outlook for multilevel research designs.

The editorial comments on the reaction to a study by Lowenkamp, Latessa, and Smith (2006). The lack of measures for program quality in their research has sparked controversy, despite positive reactions that were mentioned in essays from Andrews (2006) and Welsh (2006). Factors contributing to the slow advancement of evaluative research in corrections are the paucity of data, restrictive research design, and the slow integration of theory with practice. Topics include the risk-needs-responsivity method for program design and delivery.

This paper uses meta-analysis to investigate whether random assignment (or experimental) evaluations of voluntary government-funded training programs for the disadvantaged have produced different conclusions than nonexperimental evaluations. Information includes several hundred estimates from 31 evaluations of 15 programs that operated between 1964 and 1998. The results suggest that experimental and nonexperimental evaluations yield similar conclusions about the effectiveness of training programs, but that estimates of average effects for youth and possibly men might have been larger in experimental studies. The results also suggest that variation among nonexprimental estimates of program effects is similar to variation among experimental estimates for men and youth, but not for women (for whom it seems to be larger), although small sample sizes make the estimated differences somewhat imprecise for all three groups. The policy implications of the findings are discussed. © 2006 by the Association for Public Policy Analysis and Management [ABSTRACT FROM AUTHOR]

This final chapter analyzes the content of the preceding examples, suggesting implications for the field of prevention research and practice. [ABSTRACT FROM AUTHOR]

The article discusses various reports published within the issue including one on a problem common to many types of intervention programs designed to effect behavior change and another on a problem common to the evaluation of any program for youth.

AIM: This paper reports an action research project that promoted posturing face down following macular hole surgery and aimed to enhance patient outcomes. This paper gives an overview of the process and outcomes of the first three of four phases of the project: problem identification, planning and action. The fourth phase, which was an evaluation of the project, is reported in another paper. BACKGROUND: Surgical repair for macular hole is common procedure carried out worldwide, and patients are required to posture face down for several weeks after this surgery. There is anecdotal evidence that many patients find this difficult to carry out. In the context of increasing medical specialization, nursing practice must be developed to meet the needs of patients being treated. This study will, therefore, be relevant beyond the particular specialty and geographical location described. METHOD: The methodology was participative and cyclical. Initially, a fact-finding exercise was undertaken, using qualitative interviews with 18 members of staff to elicit their perspectives on the posturing of patients. Based on the fact-finding exercise, seven action objectives were set. While these were being implemented, three further research projects were identified and undertaken. Two were qualitative studies: one investigated patients' experiences of the surgery and posturing, and the second concerned nurses' developing working theories on the promotion of posturing and effects of nursing care on patient outcomes. Another pilot study was a randomized controlled trial to consider the effect of two different posturing regimes on patient outcomes. In addition to regular action research group meetings, these studies served to inform and monitor the changes as they were put into practice. The work was carried out from 1998 to 2002. FINDINGS: Several factors appeared to influence whether patients postured after surgery, namely: education of staff and patients, appropriately timed services, clear lines of responsibility for patient care, good communication and availability of equipment. CONCLUSION: The research suggests that an approach to care is required that appreciates and deals with the multiple factors that influence whether patients carry out the posturing. [ABSTRACT FROM AUTHOR]

This chapter describes two projects and develops from them a set of five factors that facilitate multicultural validity. The chapter also includes a discussion of some limitations of these case examples and suggestions for further testing and refinement of multicultural validity in the more general context of validity within the evaluation field. [ABSTRACT FROM AUTHOR]

Taking a historical view of selected program evaluation approaches, this chapter articulates a personal lens and journey of understanding how culturally responsive evaluation is geared toward effectiveness, benefits, and outcomes of programs designed to serve the less powerful. [ABSTRACT FROM AUTHOR]

zeigler z, smith pa & fawcett j (2004) Journal of Clinical Nursing 13, 467–478 Breast cancer: evaluation of the Common Journey Breast Cancer Support Group Most studies of cancer support groups have focused on the effects of groups established for research purposes, from the exclusive perspective of the group participants. This Roy Adaptation Model-based programme evaluation project focused on identifying the experiences of both participants in and facilitators of a community hospital-sponsored breast cancer support group. Repeated measures survey methodology. Ten women with breast cancer and two Registered Nurse group facilitators participated in the programme evaluation project. Qualitative data were analysed using content analysis. Themes extracted from the data were categorized according to the Roy Adaptation Model modes of adaptation. The group participants completed Initial and End of Year Interview Guides and Group Voices Forms; the group facilitators completed the Facilitators’ Voices Form. The Institutional Review Committee of a community hospital approved the programme evaluation project. The Common Journey Breast Cancer Support Group is a community hospital-sponsored cancer support group established to meet the informational, emotional support, and social support needs of women with breast cancer who reside in a rural state in the New England region of the USA. Responses of participants and facilitators, which reflected all four of the Roy model modes of adaptation, indicated that the combination of information and emotional and social support was effective. Nurses and other health professionals who establish community-based cancer support groups should consider formal evaluation of the outcomes, from the perspectives of both participants and facilitators, and should publish the results. The results of this programme evaluation project are limited to one breast cancer support group with a small number of female participants and two facilitators. Results cannot be generalized to support groups for other types of cancer or to cancer support groups for men. Nurses and other health professionals should consider establishing and facilitating community hospital-sponsored support groups for women with breast cancer, which have the potential to meet the women's informational, emotional support, and social support needs. [ABSTRACT FROM AUTHOR]

Discusses the conceptual foundations and overarching themes of the Talent Development (TD) evaluation framework, formulated by the Howard University Center for Research on the Education of Students Placed At Risk (CRESPAR). Themes of the TD Model of School Reform; Aims of the evaluation of TD interventions; Features of the TD model; Recommendations for minimizing problems in implementing evaluations in diverse urban settings.

This article focuses on he national evaluation of Sure Start local programmes in England. Sure Start local programmes are central to the Great Britain's government's policy for combating the adverse effects of poverty and disadvantage on young children and their families. Sure Start local programmes are designed to be comprehensive, community-based projects adapted to local needs, and making maximal use of local expertise and enthusiasms. The Sure Start programmes recognized the need for rigorous evaluation and after a competitive commissioning process the National evaluation of Sure Start was initiated. Sure Start local programmes involve changes to existing services. Improved services and community functioning are presumed to lead to enhanced family community functioning that enhance child development.

Focus groups provide an effective means of incorporating the perspectives of “hidden” populations in assessments of community health needs and assets. A series of focus groups was conducted with specifically targeted segments of a community to develop a comprehensive picture of community health. The authors describe the focus group process, major findings, and the use of focus group results in a highly multicultural community. Despite differences in age, length of residence, and ethnicity, the focus groups were remarkably similar in the issues raised. The majority of participants viewed the multicultural nature of the community as an asset but voiced some of the difficulties of living in a multiethnic and multilanguage environment. Similar areas of concern in the community arose from all of the focus groups, including housing and other environmental issues and problems of access to health care. Focus group findings have been used to initiate activity addressing identified community problems. Focus group participation had the added benefit of increasing community members' participation in other community endeavors. [ABSTRACT FROM AUTHOR]

Mainstreaming evaluation requires establishing aesthetic and ethical frameworks, as well as developing knowledge and skills that make "doing evaluation" seem like the right thing. Mainstreaming, however, can pose challenges to good evaluation practice; a view from cultural anthropology suggests that evaluation can have distinct meanings in different settings. Stories from program evaluation research in Indonesia illustrate the ways comforts and rigidities associated with mainstreamed evaluation processes may hinder high-quality evaluation. [ABSTRACT FROM AUTHOR]

BACKGROUND: Critical realism is a relatively new philosophical perspective that combines a realist ontology with a relativist epistemology in subscribing to a form of 'robust' relativism. The potential benefits of adopting a critical realist approach are considered in two areas of evaluation research: theory-driven programme evaluation and policy evaluation. AIM: The aim of the paper is to identify the main features of critical realism and explore its potential as a philosophical framework in the field of evaluation research. CONCLUSION: We argue that critical realism provides a coherent framework for evaluation research that is based on the understanding of causal mechanisms. This is particularly important for frontline services seeking to use evidence-based interventions, as interventions need to be properly understood if they are to be used effectively in the context of clinical practice. Critical realism can also add depth to policy analysis. However, there is a potential for critical realists to drift beyond the boundary that separates scientific knowledge from speculative theory when making recommendations about the best course of action to follow. [ABSTRACT FROM AUTHOR]

Examines the concept of evaluation criteria in public policymaking and implementation within consensus-seeking partnerships in the U.S. Problems involving the economy, regulation and threat to property rights; Range of partnership goals; Contribution of the overall evaluation.

Focuses on the Economic and Social Research Council's Children 5-16 Research Programme aimed at raising awareness on contemporary childhood in Great Britain. Origin of the programme; Approaches to developing new knowledge about children as social actors; Contributions into the differentiation of contemporary childhood experiences; Achievement of the Children 5-16 Programme on methodological approaches in relation to children as social actors.

Teenage parents are commonly characterized as poor, minority, single mothers with low levels of education and problematic parenting behaviors. The role of teenage childbearing per se in mothers' parenting behaviors, however, is not well understood. This study addressed links between maternal childbearing age and parenting behaviors among 1,702 low-income mothers participating in the Early Head Start Research and Evaluation Project. The sample includes White (n = 704), Black (n = 595), and Latina (n = 403) mothers. One third of the sample were teenage childbearers (younger than 19 years at the birth of the target child). When the children were 14 months old, mothers and children were videotaped in their home during a 10-min free play assessment. This study examined four key parenting behaviors coded from this assessment: supportiveness, detachment, intrusiveness, and negative regard/hostility. Findings indicate that teenage childbearers were significantly less supportive, more detached, more intrusive, and more negative/hostile with their infants than older childbearers. Associations held above and beyond the effects of race/ethnicity, education, family type, family income, and child sex and age for supportiveness, detachment, and intrusiveness (but not negative regard/hostility). These findings provide the most definitive evidence to date of differences between teenage and older mothers' parenting behaviors, above and beyond demographic co-factors. Within-group analyses revealed different patterns of association in the three racial/ethnic groups. ©2002 Michigan Association for Infant Mental Health. [ABSTRACT FROM AUTHOR]

Nonprofit agencies are struggling to meet new funder demands in outcome evaluation. This study is the first of its kind to examine factors that contribute to agency progress in this area. Path analysis is used to examine chains of influence among five predictors of success as well as three control variables. Study findings indicate that agency culture, technology, management support, and involvement are key predictors of quality. Nonprofit managers who want to succeed in the new era of accountability should consider the potential impact of these factors on the quality of outcome evaluation plans in their agencies. [ABSTRACT FROM AUTHOR]