Search

This unique book features original writings from evaluation′s foundational thinkers, together with new commentaries from contemporary authors. Each section includes an introduction to a core evaluation concept by the editors, a classic reading, two commentaries on that topic by contemporary authors, and a reflection guide written by the editors.

Beloved for its conversational style and reliable advice, this text is now in a revised and updated third edition, reflecting key developments in evaluation. It includes expanded coverage of equity and social justice issues, values and cost analysis, visualizing qualitative data with software, and more. Twenty-six concise chapters, or'sessions,'give students, applied researchers, and program administrators a solid foundation for conducting or using evaluations. Covering both quantitative and qualitative methods, the book emphasizes fostering evaluation use. It shows how to build collaborative relationships with users; formulate answerable evaluation questions; deal with contingencies that might alter the traditional sequence of an evaluation; and collect, analyze, and report data. Student-friendly features throughout the sessions include titles written as questions, bulleted recaps,'Thinking Ahead'and'Next Steps'pointers, cautionary notes, and annotated suggestions for further reading. An in-depth case study provides the basis for end-of-session practice exercises. New to This Edition •New sessions on context-sensitive evaluation, including the organizational, sociopolitical, and community contexts of a program. •New or expanded discussions of timely topics: identifying evaluation decision makers, analyzing program costs, coding and visualizing qualitative data with software, and more. •Updated suggestions for further reading and discussion in every chapter.

Covering both the theory and practice of evaluation in one engaging volume, this leading text is now in a revised third edition. It features additional evaluation approaches, such as the Indigenous paradigm; new examples, ranging from small to large and multi-site evaluations; and more. Instructors praise the diverse evaluations, many with reflective commentary from evaluators, and rich pedagogical features. The text describes the major theoretical paradigms in evaluation and the ways they inform methodological choices. Readers learn effective strategies for clarifying their own theoretical assumptions; working with stakeholders; developing questions; using quantitative, qualitative, and mixed methods designs; choosing data collection and sampling strategies; analyzing data; and communicating and utilizing findings. The book includes guidance for planning an evaluation of a specific project or program. Extensive recommended online resources and tools are provided at the companion website. New to This Edition •Restructured section on philosophical frameworks, with a new chapter on the Indigenous paradigm and expanded coverage of disability, feminist, and LGBTQ+ theories. •Additional sample studies, including multi-site and systems- and complexity-informed evaluations. •Expanded coverage of logic models, cost–benefit evaluations, and mixed methods designs. •New and updated coverage of data collection technologies, qualitative coding methods, Sustainable Development Goals, and uses and pitfalls of artificial intelligence. Pedagogical Features •Reflection questions that prepare students to read each chapter. •'Extending Your Thinking'questions and learning activities. •New within-chapter maps to aid in navigating chapter sections. •Boxes offering sample evaluations and closer looks at key concepts. •Helpful checklists and tables, bolded key terms, and an end-of-book Glossary. •Companion website with links to recommended online resources and tools.

Showing how evaluation practice looks when guided by theory, the third edition of the influential'theory tree'book is significantly revised with over 80% new material, including a greater focus on equity and theories over theorists. Chapters from leading authorities describe the goals of each theory; the type of evaluation for which it is appropriate (formative, summary formative, summative, adaptive); the size of the program for which it is most applicable; specific prescriptions; and observable actions that help to define the theory. Readers are given the tools to select suitable approaches for the size, contexts and stage of an evaluation and their own personal values. New to This Edition •Chapters on culturally responsive evaluation, Indigenous evaluation, and developmental evaluation. •Organized around theories rather than individual theorists. •Increased attention to practical applications, including a chapter distilling the goals, methods, and standards of evaluations based on each theory. •Case study chapter on the role of theory in evaluation policy.

The book shows how to apply validity concepts when planning and conducting an evaluation, thereby making sure that the evaluation stays true to the purposes for which it was initiated. Marc T. Braverman demonstrates that evaluating with validity means being able to answer the evaluation questions in a way that is useful, accurate, and reflective of the information needed from the evaluation. His approach is practical, with the goal of helping evaluators to conduct high-quality outcome evaluations, and he illustrates concepts with case study examples drawn from studies of intervention effectiveness over many years. The book begins by looking at the ways that validity is conceptualized and the uses to which it is put. Subsequent chapters analyze separate phases of the outcome evaluation process and the critical decisions about design and analysis that are typically required.

Why do many social programs have such a poor track record? What can we do to maximize a program's chance of success? If a program shows promise, how can we scale it up? To answer these questions confronting policymakers, and to ensure that strong programs are designed, developed, implemented, and taken to scale, appropriate evaluation approaches must be used throughout a program's life cycle. In The Oxford Handbook on Program Design and Implementation Evaluation, Dr. Anu Rangarajan surfaces insights and expertise from a team of eminent scholars to create a comprehensive and actionable toolbox of evaluation methodologies that can be used to examine social programs throughout their life cycle. The methodologies presented in the Handbook describe how to conduct developmental evaluations, perform rapid-cycle evaluations, employ implementation science concepts, assess program effectiveness in the absence of a true counterfactual, measure cost-effectiveness, scale up promising interventions, and assess systems change. Incorporating these approaches at every stage of a program's life cycle will maximize its chances of success; doing so consistently across social programs will help improve their impact overall. This Handbook is an action-oriented primary resource for social researchers, faculty and students, program practitioners, policy analysts, and funders of social programs and evaluations. By providing real-world examples of each approach alongside methodological guidance, and by highlighting challenges and lessons learned, the Handbook is invaluable to novices and seasoned professionals alike.

While women have influenced the fields of program evaluation and mixed methods research, their contributions are rarely acknowledged. In this edited volume, we recognize the contributions Jennifer C. Greene made to evaluation and mixed methods, focusing on how she disrupted traditional ways methods are conceptualized and implemented. We aim to provide a range of perspectives on how Greene disrupted social science theory, methodology, and training through her commitment to the values of democracy, diversity, and dialogue. Accordingly, the volume makes explicit how Greene democratized social science inquiry and training by emphasizing inclusive, culturally responsive, and educative theories, methods, and pedagogical practices. Second, it clarifies how her commitment to diversity supported scholars from diverse disciplinary backgrounds and cultures (within and beyond the United States) and validated often ignored perspectives on phenomena or experiences. And third, it showcases how her commitment to dialogue opened spaces for non-traditional methodological approaches that engage, communicate, and disseminate program evaluation and mixed methods work. Taken together, the first-hand accounts presented in this volume offer a historical perspective and practical guidance on program evaluation and mixed methods conceptualization, implementation, and training. Endorsements:'The theme of “disruption” in this book is a powerful look at the breadth and significance of Jennifer C. Greene's distinguished contributions, both theoretical and practical, in evaluation for over 30 years. In essence, these chapters reveal the sustaining power of her scholarship and influence today and likely in years to come. Her recognition that no single method can solve the complex problems faced in evaluation is revealed in the ontological, epistemological, and methodological work she developed on mixed methods, which led to a genre of study that recast the debate about the hegemony of quantitative over qualitative methods and vice versa. She has foregrounded values, the quintessential character of evaluation, by recognizing the multiplicity of perspectives that guide our theories, roles, questions, designs, and perceptions of quality. Jennifer Greene's generativity is exemplified in her egalitarian dialogic stance, inclusion of voices and context, and commitment to equity. The chapters reflect the impact of her work on scholars who continue to advance evaluation for a more just society.'— Valerie J. Caracelli, U.S. Government Accountability Office'It is not possible to convey in a few words my strongest endorsement for this volume that begins scratching the surface of Jennifer C. Greene's many contributions to evaluation theory, methods, and practice. I have worked with and learned from her on many occasions over the years as I grappled with refining my understanding and practice of culturally responsive evaluation. I commend the editors and authors for this first substantive collection providing a more in-depth understanding and appreciation of Jennifer Greene's body of work for some while providing others the opportunity to revisit the lessons we have learned from her work, spirit, and commitment to make a difference.'— Stafford Hood, Center for Culturally Responsive Evaluation & Assessment (CREA) and Professor Emeritus University of Illinois at Urbana-Champaign

From the founder of empowerment evaluation (EE), a framework uniquely suited to advancing social justice causes, this book explains the theories, principles, and steps of conducting EE from scratch or within a preexisting evaluation or work plan. David M. Fetterman describes how EE enables program planners and participants to define their mission or purpose, take stock of how well they are doing, and plan for the future to achieve self-determined goals. EEs of two large programs (Feeding America and USAID/REACH) are discussed in depth; other EE case examples address such topics as raising test scores in impoverished and rural schools and bridging the digital divide in communities of color. User-friendly features include chapters on conducting EE remotely and frequently asked questions, as well as illuminating sidebars and glossaries of acronyms and concepts/terms.

Ziel dieses Buches ist es, kompakt und nutzerfreundlich Grundkenntnisse für die Planung, Durchführung und Anwendung von Evaluationen zu vermitteln. Hierfür greift es auf die inhaltlichen Konzepte und Unterlagen zahlreicher Kurse zur Evaluation im In- und Ausland zurück.Das Buch richtet sich an Interessierte, die erst über wenige Kenntnisse im Bereich der Evaluation verfügen und sich weiterbilden möchten. Es dient sowohl Personen, die Evaluationen selbst durchführen als auch Entscheidungsträgern, die Evaluationen in Auftrag geben, aber auch denjenigen, die evaluiert werden. Alle Beteiligten an einer Evaluation sollten wissen, welche Charakteristika und Standards eine professionell und kompetent durchgeführte Evaluation auszeichnen.Die zweite Auflage wurde vollständig überarbeitet und um ein Kapitel zum Monitoring und einen Einblick in den politischen Kontext erweitert.

Too often evaluation findings end up on the shelf! Why? Many interventions have several moving parts working together to achieve something each part cannot do independently. Unfortunately, many of the available evaluation approaches oversimplify this reality. A major reason for this is that evaluators do not have a blueprint to plan, and the associated methods to execute, an evaluation fit for this purpose. As such, they revert to using methods with which they are familiar, but are not suitable, for evaluating complex interventions. Consequently, the evaluation findings do not make sense to decisionmakers, so they are ignored. This book provides evaluators of all skill levels with a simple 3-step framework, System Evaluation Theory, that will lead to more actionable recommendations because the methods better capture the reality in which interventions operate; that is as a system. The book first reviews the limitations of program evaluation approaches that pointed to a need for a different way of thinking, one grounded in systems. After defining a system, the book explains how SET is intentionally aligned to evaluate a system's two essential properties: interdependence and emergence. Individual chapters are dedicated to explaining how to execute each SET step. Throughout, the author draws on real-world examples and those from his own evaluations to help bridge the theory-practice divide. The reader is then shown how to use SET to develop actionable recommendations.

This Social Impact Assessment textbook provides the reader with details on the background and development of the SIA concept to include the methods, guidelines and principles for conducting an actual Social Impact Assessment. These sections are followed by actual SIA case studies to include the use of public involvement in the SIA process. The text concludes with the application of SIA outside the United States and international principles for doing Social Impact Assessment.

Este libro ofrece una visión bastante completa de los más importantes aspectos vinculados con la evaluación privada de proyectos de inversión. Una primera parte presenta los conceptos básicos indispensables para comprender los principales tópicos de la evaluación de proyectos: matemáticas financieras, economía, estadística y contabilidad. La segunda parte del libro se concentra en el análisis de la evaluación económica y financiera de proyectos, donde se incluyen temas como la identificación de los principales ingresos y costos de los mismos, el cálculo de su rentabilidad, la comparación de alternativas de inversión y las decisiones que deben tomarse bajo situaciones riesgosas, entre otros. Cada capítulo contiene un resumen de conceptos y ejercicios propuestos. Adicionalmente, el lector podrá acceder a las resoluciones propuestas para estos ejercicios, así como al planteamiento de un conjunto de casos prácticos, ingresando a una página web con el código que aparece en cada ejemplar.

Elgar Research Agendas outline the future of research in a given area. Leading scholars are given the space to explore their subject in provocative ways, and map out the potential directions of travel. They are relevant but also visionary.This unique Research Agenda addresses salient current issues in evaluation research, offering a broad perspective on the role of evaluation in society. International expert contributors explore how evaluation research is not only academic research engaged in practical problem-solving, but is also research that takes a critical look at this engagement, providing inspiration for reflexivity among evaluators. Drawing on a range of perspectives, including sociology, organization theory, psychoanalytic theory, and feminism, chapters analyse examples of how evaluation works in a number of arenas, such as education, research, and voluntary work.Taking a critical look at evaluation as a social phenomenon, this Research Agenda will be a useful resource for scholars and students of evaluation, public administration and management, and public policy. It will also be beneficial in helping practitioners and researchers to understand the major emerging issues within the field of evaluation.

Introduction to Theory-Driven Program Evaluation provides a clear guide for practicing evaluation science, and numerous examples of how these evaluations actually unfold in contemporary practice. A special emphasis is placed how to conduct theory-driven program evaluations that are culturally responsive and strengths-focused.In this thoroughly revised new edition, author Stewart I. Donaldson provides a state-of-the art treatment of the basics of conducting theory-driven program evaluations. Each case follows a three-step model: developing program impact theory; formulating and prioritizing evaluation questions; and answering evaluation questions. The initial chapters discuss the evolution and popularity of theory-driven program evaluation, as well as step-by-step guide for culturally responsive and strengths-focused applications. Succeeding chapters provide actual cases and discuss the practical implications of theory-driven evaluation science. Reflections, challenges, and lessons learned across numerous cases from practices are discussed.The volume is of significant value to practicing evaluators, professors of introductory evaluation courses and their students, advanced undergraduate and graduate students, and serves as a text or a supplementary text for a wide range of evaluation and applied research courses. It is also of great interest to those interested in the connections between work and health, well-being, career development, human service organizations, and organizational improvement and effectiveness.

Recipient of a 2021 Most Promising New Textbook Award from the Textbook & Academic Authors Association (TAA) Evaluation in Today's World: Respecting Diversity, Improving Quality, and Promoting Usability is a timely and comprehensive textbook that guides students, practitioners, and users of evaluations in understanding evaluation purposes, theories, methodologies, and challenges within today's sociocultural and political context. Veronica G. Thomas and Patricia B. Campbell include discussions of evaluation history, frameworks, models, types, planning, and methods, through a social justice, diversity, and inclusive lens. The authors focus on ethics in diverse cultural contexts, help readers understand how social problems and programs get politicized and, sometimes, framed through a racialized lens, show how to engage stakeholders in the evaluation process, and communicate results in culturally appropriate ways. Included with this title: The password-protected Instructor Resource Site (formally known as SAGE Edge) offers access to all text-specific resources, including a test bank and editable, chapter-specific PowerPoint® slides.

'Practical, useful counsel emanates throughout. Impressively grounded in real world experiences.'- Michael Quinn Patton, author of Utilisation-Focused EvaluationEffective evaluation can provide valuable insights into the way a program, a course or an organisation is being run, and direction for improvement. This widely-used introduction to evaluation is intended for non-specialists in the human services who need to do evaluation as part of a busy workload.Everyday Evaluation on the Run offers a practical over view of the main approaches to evaluation, strategies for involving stakeholders, and the evaluation industry's toolbox of models and techniques. The author emphasises the core principles and concepts of evaluation, and the idea of building a culture of evaluation.This third edition of Everyday Evaluation on the Run reflects current thinking on values in organisations and the need to use evaluation to guide future practice rather than just as an auditing process. With extensive examples, it is a handy reference for professionals and students in health, welfare, and community work, and in government and non-profit agencies.

Long Term Perspectives in Evaluation is the first book to advocate the virtues of a long-term perspective for policy evaluation as well as to show how evaluations can take a longer time perspective than they usually do. To get there, it is necessary to understand the decision-making context of evaluations and study the obstacles and the resistance toward long-term perspectives – as knowledge of that will lay the ground for more effective advocacy.The book is divided into three parts: the first section examines different aspects of methodology and methods. In the next section, authors present case studies of long-term evaluations, examine their own experiences of such evaluations and discuss difficulties, challenges and lessons learned. Cases discussed include: education sector reforms in Sweden, local governance reforms in Denmark, policy interventions in Southern Italy and Brazil, and Paris Declaration Principles of aid effectiveness such as Swedish aid to Tanzania, Vietnam, Laos and Sri Lanka. Finally, the third section sees the authors turn to a set of contextual issues and concluding remarks. Bringing together a rich collection of insights and a renowned group of experts, Long Term Perspectives in Evaluation: Increasing Relevance and Utility, constitutes a significant landmark in the field.

This book inductively develops a new typology that identifies and evaluates three principal strategies that have been, and are being, used to extend international human rights protections to new categories of vulnerable populations. The book explicates the evolution and ongoing utility of the three strategies: categorical enlargement, conceptual expansion, and group-conscious universal application. The strategies are elucidated by case studies of nine distinct vulnerable populations: national minorities; those oppressed on the basis of caste; people with albinism; cross-cultural migrants; members of the African diaspora; Roma/Gypsies; persons affected by leprosy; older individuals; and lesbian, gay, bisexual, and transgender (LGBT) people. The book concludes by considering the utility of the three strategies for emerging vulnerable populations. It encourages discourse about the protection of vulnerable populations to move beyond a stale fixation on the texts of treaties and towards a more proactive normative framework that prioritizes the lived experiences of human beings. Extending International Human Rights Protections to Vulnerable Populations will be of key interest to students and scholars of international human rights, to social justice advocates, to human rights practitioners, and to those working with oppressed groups, human rights law, and international relations.

Social workers are increasingly faced with the demands of evaluating their own programs and practice to maintain accountability to funding agencies, secure funding, and remedy a number of social problems facing our society. One of the nine basic competencies required by the social work accreditation agency is to be able to conduct evaluations. Evaluation is a critical area of practice for demonstrating accountability to clients, communities, numerous other stakeholders, and funding and regulatory agencies. Social Work Evaluation, Third Edition, offers a straightforward guide to a broad range of social work evaluations at both the program and practice levels. Author James R. Dudley's seven-step approach to evaluation makes use of qualitative, quantitative, and mixed research methods to provide oversight and address important issues at the planning, implementation, and outcome stages of a program or practice intervention. His unique focus on involving clients in the evaluation process ensures that social workers consistently improve their capacity to impact their clients'well-being and remain accountable to them and others they serve. Case examples from the extensive evaluation experience of the author and others illustrate a wide range of logic-based methods discussed throughout the text for real-world application. This comprehensive text effectively aims to enhance student and practitioner skill sets to meet these demands of a changing field.

Compelling evidence shows health disparities are the result of inequalities in income, education, limited access to medical care, substandard social environments, and poor economic conditions. This book introduces these social determinants of health (SDOH), discusses how they relate to public health programs, and explains how to design and evaluate interventions bearing them in mind. Arguing that many public health programs fail to be as effective as they could be, because they ignore the underlying causes of health disparities, this important reference gives concrete examples of how evaluations focusing on the social determinants of health can alleviate health inequalities, as well as step-by-step guidance to undertaking them. This resource blends current research, existing data, and participatory evaluation methods. It is designed for teachers, students, practitioners, and policymakers interested in public health programming and evaluation.A Choice Recommended Title

Does a program work? What is the value? How do we know? These are questions that keep evaluators up at night. Continued rural community funding, employment, health, and justice depend on our answers to these questions. For evaluators working in rural communities, the task is great, but the return is even greater. Now more than ever before, evaluators have an opportunity to impact social change in rural America.Beginning with an introduction of rural community evaluation, Evaluation in Rural Communities highlights the differences in approaches to evaluation in rural areas, supported by case studies that illustrate key themes and objectives. It explores a number of issues, including• sustainability• policy• cost–benefit analysis• rural community evaluation as a platform to support social change.In particular, readers will also learn how to overcome rural community challenges, such as limited resources, the digital divide, limited funding, lower employment and educational attainment, limited opportunities for social interactions, and the distrust of outsiders. Blending aspects of community-based participatory research, empowerment evaluation, and program evaluation methods, this book is an accessible yet nuanced guide that integrates critical thinking, problem solving, social and political contexts, and outcomes related to evidence-based evaluation.

Demystifying the evaluation journey, this is the first evaluation mentoring book that addresses the choices, roles, and challenges that evaluators must navigate in the real world. Experienced evaluator and trainer Donna R. Podems covers both conceptual and technical aspects of practice in a friendly, conversational style. She focuses not just on how to do evaluations but how to think like an evaluator, fostering reflective, ethical, and culturally sensitive practice. Extensive case examples illustrate the process of conceptualizing and implementing an evaluation--clarifying interventions, identifying beneficiaries, gathering data, discussing results, valuing, and developing recommendations. The differences (and connections) between research, evaluation, and monitoring are explored. Handy icons identify instructive features including self-study exercises, group activities, clarifying questions, facilitation and negotiation techniques, insider tips, advice, and resources. Purchasers can access a companion website to download and print reproducible materials for some of the activities and games described in the book.

The concepts of cause and effect are critical to the field of program evaluation. Experimentally-designed evaluations—those that randomize to treatment and control groups—offer a convincing means for establishing a causal connection between a program and its effects. Experimental Evaluation Design for Program Improvement considers a range of impact evaluation questions, particularly those questions that focus on the impact of specific aspects of a program. Laura R. Peck shows how a variety of experimental evaluation design options can provide answers to these questions, and she suggests opportunities for experiments to be applied in more varied settings and focused on program improvement efforts.

A Social Well-Being Account is the product of an assessment of the comparative beneficial and adverse social effects likely to occur as a result of implementing—or not implementing—a particular development plan. This volume establishes procedures for conducting research and analyzing data in order to make this assessment for water development plans

Designed to provide clear and detailed assistance in the complex process of assessing social change, this book emphasizes the development of an analytic approach and a theoretical framework that can be applied to the assessment of very diverse events--changes in the natural environment, the local economy, or the dominant technology. The guide, based on a sociological perspective that highlights the importance of community social organization in analyzing social change, focuses on the development of user skills in assessment design, research, analysis, and presentation. The guide's theoretical basis and emphasis on the interrelationships that create social change make it valuable to those studying social change in general, as well as to those responsible for conducting or utilizing social impact assessments. Detailed'how to'information, clear writing, and careful design impart the skills necessary to identify and analyze the factors and processes leading to social change and to interpret and present research findings in an effective manner.

This book provides inspiration for social workers to explore the possibilities of using Photovoice to engage with communities. Built on strong theoretical foundations and grounded in ethical principles, Jarldorn assesses Photovoice as an arts-based approach that provides a valuable mechanism for social workers to engage people in participatory action research, with the potential to influence policy and public opinion. Positioning Photovoice as a method aligned with feminist and radical social work perspectives, the author draws upon her research project which used Photovoice with former prisoners to demonstrate the transformative potential of participatory methods. Photovoice Handbook for Social Workers is intended to be a useful, hands-on resource, combining the importance of theory and the practicalities of doing action research.

Managers of workforce training programs are often unable to afford costly, full-fledged experimental or nonexperimental evaluations to determine their programs'impacts. Therefore, many rely on the survey responses of program participants to gauge program impacts. Smith, Whalley, and Wilcox present the first attempt to assess such measures despite their already widespread use in program evaluations. They develop a multidisciplinary framework for addressing the issue and apply it to three case studies: the National Job Training Partnership Act Study, the U.S. National Supported Work Demonstration, and the Connecticut Jobs First Program. Each of these studies were subjected to experimental evaluations that included a survey-based participant evaluation measure. The authors apply econometric methods specifically developed to obtain estimates of program impacts among individuals in the studies and then compare these estimates with survey-based participant evaluation measures to obtain an assessment of the surveys'efficacy. The authors also discuss how their findings fit into the broader literatures in economics, psychology, and survey research.

Written by two of the world's most well-known ROI (Return on Investment) gurus, this guide is indispensable for anyone involved in showing the value of money for projects and programs in governments, non-governmental organizations, nonprofits, and businesses. These range from human capital programs to marketing initiatives, technology implementations, systems integrations, quality and lean processes, public health initiatives, procurement procedures, public relations events, risk management policies, economic development programs, corporate social responsibility projects, public policy programs, branding activities, innovation programs, customer satisfaction projects, and everything in between. In a step-by-step process, the book shows how to measure the success of projects and programs, including measuring impact and ROI (Return on Investment). This book also shows how to forecast the value of the project in advance and how to collect data during and after project implementation. It addresses improvements throughout the process so that the project delivers optimum value. In addition to businesses, this book is appropriate for governments, NGOs, nonprofits, universities and healthcare organizations. As a reference for those who are seeking ways to assign value to what they have measured, the book will clarify and resolve much of the mystery surrounding the conversion of data to monetary values. Building on a tremendous amount of experience, application, practice, and research, the book will be based on the work of many individuals and organizations, particularly those who have been reaching the ultimate levels of accountability using the ROI Methodology. Developed in an easy-to-read format and fortified with examples, tips, and checklists, this will be an indispensable guide for those who seek to understand accountability issues.

Social Validity is a concept used in behavioral intervention research. It focuses on whether the goals of treatment, the intervention techniques used, and the outcomes achieved are acceptable, relevant, and useful to the individual in treatment. The Social Validity Manual, Second Edition, provides background on the development of social validity, an overview of current research in social validity, and guidelines for expanding the practice of social validation. The book offers detailed information on scales and methods for measuring social validity across the goals, procedures, and effects of treatments utilized in various fields. The second edition incorporates advances in research findings and offers two new chapters on the use of social validity in the health sciences and how social validity plays an important role in increasing cultural awareness. - Defines and conceptualizes social validity - Summarizes research advances in social validity - Compares and contrasts social validity measures - Includes use of social validity in multiple disciplines - Reviews how to organize social validity data - Provides new coverage of use in health professions

Evaluators have always worked in diverse communities, and the programs they evaluate are designed to address often intractable socio-political and economic issues. Evaluations that explicitly aim to be more responsive to culture and cultural context are, however, a more recent phenomenon. In this book, Jill Anne Chouinard and Fiona Cram utilize a conceptual framework that foregrounds culture in social inquiry, and then uses that framework to analyze empirical studies across three distinct cultural domains of evaluation practice (Western, Indigenous and international development). Culturally Responsive Approaches to Evaluation provide a comparative analysis of these studies and discuss lessons drawn from them in order to help evaluators extend their current thinking and practice. They conclude with an agenda for future research.

The leading text that covers both the theory and practice of evaluation in one engaging volume has now been revised and updated with additional evaluation approaches (such as mixed methods and principles-focused evaluation) and new methods (such as technologically based strategies). The book features examples of small- and large-scale evaluations from a range of fields, many with reflective commentary from the evaluators; helpful checklists; and carefully crafted learning activities. Major theoretical paradigms in evaluation--and the ways they inform methodological choices--are explained. Readers learn effective strategies for clarifying their own theoretical assumptions; working with stakeholders; developing questions; using quantitative, qualitative, and mixed methods designs; selecting data collection and sampling strategies; analyzing data; and communicating and utilizing findings. The new companion website provides extensive recommended online resources and tools, organized by chapter. New to This Edition •Additional evaluation approaches: collaborative evaluation, principles-focused evaluation, and desk reviews. •Coverage of new data collection technologies and methods of qualitative coding. •Expanded discussions of logic models, cost–benefit analysis, and mixed methods designs. •Many new and updated sample studies. Pedagogical Features •Reflection questions that prepare students to read each chapter. •'Extending Your Thinking'questions and practical activities. •Boxes delving into key concepts and example studies. •End-of-book Glossary, and highlighted key terms throughout. •Companion website with links to helpful resources on all aspects of evaluation.

Evaluation Practice for Collaborative Growth highlights the approaches, tools, and techniques that are most useful for evaluating educational and social service programs. This book walks the reader through a process of creating answerable evaluations questions, designing evaluation studies to answer those questions, and analyzing, interpreting, and reporting the evaluation's findings so they are useful and meaningful for key stakeholders. The text concludes with a chapter devoted to the shifting landscape of evaluation practice as it faces complex systems and issues that are shaped by society. Additionally, the author provides a list of knowledge and skills needed to adapt to a changing landscape and encourages organizations to use evaluation as a mechanism for learning and adapting to change. Her orientation toward community-based approaches and social justice prevail throughout the book's content and align well with a reader's desire to be inclusive and accountable in programing efforts. Nonprofit leaders, social science professionals, and students will find this book helpful for understanding basic program evaluation concepts, methods, and strategies.

Youth civic engagement efforts have become common across the globe. With the ratification of the UN Convention on the Rights of the Child, many have turned to civic engagement methodologies to create opportunities for young people to have a voice in decisions that affect them. With the dissemination of youth civic engagement practice, there is a need to evaluate these efforts to satisfy funders, stakeholders, and participants. As a social innovation, youth civic engagement efforts present unique issues to evaluation and invite innovative and participatory evaluation designs. This volume brings together experienced evaluators, evaluation and youth civic engagement scholars, and civic youth workers to inform evaluation designs for youth civic engagement practice and programs. The book uses the US Center for Disease Control's framework for evaluation process, and explores issues, questions, and choices an evaluator can make when designing an evaluation of youth civic engagement practices. The heart of the book includes case studies written by professional evaluators, evaluation and youth scholars, and youth workers to define issues for each stage and provide guidance for others who want to design a robust, rigorous, and responsive evaluation for youth civic engagement initiatives and practices. The final chapters of the book provide straightforward and clear guidance for beginning to intermediate evaluators when designing and conducting evaluation studies.

Since the first edition in 1981,Social Work Research and Evaluation has provided graduate-level social work students with basic research and evaluation concepts to help them become successful evidence-based practitioners, evidence-informed practitioners and practitioners who are implementing evidence-based programs. Students will gain a thorough understanding and appreciation for how the three dominant research methodologies--quantitative, qualitative, and mixed methods--will help them achieve their professional goals, regardless of their area of specialization. Written in clear, everyday language, this edition also includes the pedagogical features that will make it easy and effective for classroom use.

Today, evaluation is part of governing systems and is supported by powerful institutions. It is taken for granted that evaluation leads to betterment. However, evaluation itself is seldom analyzed from a critical perspective. In this book, Jan-Eric Furubo and Nicoletta Stame have assembled an international line-up of distinguished experts and emerging scholars to fill this void. Examining evaluation from a critical – or evaluative – perspective, each contribution in this book offers a systematic and critical insight into the broader relationship between evaluation and society. Divided into three parts, the various chapters ask questions such as: What are the consequences of the institutionalization of evaluation? Has the professionalization of evaluators favored their action in the public interest? Is the money spent on evaluation worth it? Is the market of evaluation allowing real competition for the best services? The answers to these questions demonstrate that the constitutive effects of the social practice of evaluation can also be the suppression of other forms of knowledge and the favoring of certain notions about societal development and political and administrative processes.

From pioneering leaders in the field, this is the first book to provide a solid foundation for three major stakeholder involvement approaches: collaborative, participatory, and empowerment evaluation. Highlighting differences among the approaches, the authors focus on the role of the evaluator, who may be in charge of the evaluation, share control, or serve as a'critical friend,'leaving stakeholders in control. Practitioners are guided to select and implement the most appropriate framework for the purpose and scope of a given evaluation and the needs of community members and funders. For each approach, a chapter on essential features is followed by two chapters presenting actual sample evaluations--for example, early childhood and community health initiatives, an aquarium, a project with Google, and more. The concluding chapter discusses similarities and circumstances in which the approaches can be combined.

This book has been replaced by Evaluation Essentials, Third Edition, ISBN 978-1-4625-5543-7.

Tackling Wicked Problems in Complex Ecologies is a call to action, focusing on the role that evaluators can play in addressing social and economic problems. Evaluation extends beyond theories and methods, encompassing a range of proven approaches for addressing ecological complexities that drive inequities around the globe. Bringing together leading thinkers and problem-solvers, this collection traverses the range of contexts at the frontiers of the field—from inadequate food supply and housing to unemployment and poverty. Editors Rodney Hopson and Fiona Cram demonstrate the effects of an engaged approach to evaluation, in which three considerations take center stage: its relevance, the relationships it engenders, and the responsibilities it requires. This is a handbook for tackling the social and economic problems of the twenty-first century which, though wicked, are amenable to the tools of the trade.

This title was first published in 2000: A detailed study of a number of key issues arising in evaluation research, in particular the impact of context upon evaluation findings and the implication context has for methodology. Providing case study illustrations, the work includes discussion of definitions and uses, experimental logic, methods and difficulties in experimental evaluations and the importance of incorporating both process and context in evaluation research design.

This title was first published in 2000: This book provides an exploration of the link between individualized project evaluation and policy analysis. The conceptual and legislative frameworks which contextualize family support are explored in full. By drawing on existing literature and examining the political and legislative aspects of family support the book aims to provide in one volume accessible and up to date information and discussion of key developments within family support, in the UK and internationally as well as within Northern Ireland where the research is set. Five family support settings are selected for close examination by the research and the key evaluation questions applied. The book details the methodology employed and explores exactly how the settings were organized for family support. Additionally the book seeks to identify needs in the context of family support across the range of settings by examining indicators of potential need. Services appropriate to family support were also analyzed across the range of settings. Finally the book reviews the settings against criteria for the evaluation and development of projects considered to be family support.

L'évaluation de programmes s'inscrit dans un changement de paradigme mondial qui se traduit, entre autres, par une redéfinition des pouvoirs. La pratique évaluative ne peut se contenter d'ajustements mineurs, ce qui implique un élargissement des compétences de l'évaluateur. Pour les éminents théoriciens Ernest House et Thomas Schwandt, non seulement ceux-ci doivent-ils être compétents sur les plans stratégique et technique, mais ils doivent aussi démontrer une certaine sagesse qui permet à la pratique d'être flexible, attentive et soucieuse d'offrir un jugement rencontrant l'acceptabilité de l'ensemble des parties prenantes. Le présent ouvrage trace le portrait d'une conception de la pratique professionnelle (praxis) qui intègre ces composantes. Les auteurs s'intéressent plus particulièrement à la rencontre entre les acteurs, qui constitue un défi en soi, en présentant un éventail d'approches et d'expériences qui favorisent leur rapprochement.

Are you a grant maker, manager or evaluator who must assess your work to improve as well as be accountable for the use of resources and results? Does the project, program or organization you fund, manage or evaluate contend with substantial uncertainty about what to do and what will be the results? Do you thus experience constant change and unexpected and unforeseeable actors and factors in your intervention? Do you need to know what you are achieving and how in real time? And therefore, do you seek an alternative to conventional monitoring and evaluation of social change results? If yes, then you are the audience for this book. Beginning in 2002, working closely with co-evaluators and commissioners of evaluations, the author developed Outcome Harvesting to enable evaluators, grant makers, and managers to identify, formulate, verify, and make sense of changes that interventions have influenced in a broad range of cutting–edge innovation and development projects and programs around the world. Over these years, he led Outcome Harvesting evaluative exercises involving almost 500 non-governmental organizations, networks, government agencies, funding agencies, community-based organizations, research institutes and university programs. In over fifty evaluations, with forty co-evaluators he has harvested thousands of outcomes on six continents. Outcome Harvesting has proven useful in evaluations of a great diversity of initiatives: human rights advocacy, political, economic and environmental advocacy, arts and culture, health systems, information and communication technology, conflict and peace, water and sanitation, taxonomy for development, violence against women, rural development, organic agriculture, participatory democracy, waste management, public sector reform, good governance, eLearning, social accountability, and business competition, amongst others. In this book, the author explains the steps of Outcome Harvesting and how to customize them according to the nine underlying principles. He shares his experience and gives practical advice on how to work with Outcome Harvesting and remain true to its essential features.