Search

This decade has been marked by the development of several approaches to psychological skills training (PST). To assess current trends in PST in order to ascertain if consumers' needs are being met, a content analysis of PST approaches published in books in North America between 1980 and 1988 was conducted with regard to target populations, content areas, and format characteristics. Based on the content analysis, six needs representing viable future directions for PST are outlined. These needs include targeting youth and coaches in addition to elite athletes, moving beyond basic education into specific implementation procedures, differentiating between psychological skills and methods, adopting a holistic approach based on the interactional paradigm and a personal development model, defining the practice of sport psychology based on the personal development of sport consumers, and facilitating the theory/practice relationship through research-based PST programming and evaluation research. [ABSTRACT FROM AUTHOR]

This study considers whether police departments’ characteristics relate to the methodology and results of the evaluations that they participate in, and contrasts police departments that have carried out rigorous crime prevention research to comparison groups of US police agencies. Findings include departments that participate in quasi-experimental crime prevention research are larger and more likely to find statistically significant successes than those that participate in experiments, and evaluators differ in composition and practices from most US police departments. This suggests that researchers and policy makers should involve smaller suburban and rural police agencies to increase the generalizability of evaluation research. [ABSTRACT FROM PUBLISHER]

It is very important to know how much we can extrapolate from a study's results. This paper examines the issue using data from impact evaluations in development. [ABSTRACT FROM AUTHOR]

The article presents research on community organizing in order to improve educational equality, using the methodology of participatory action research (PAR). The study focuses on the efforts of African American and Latino communities in Berkeley, California that used the methods of building power and community to achieve school reform that addressed educational inequalities. A definition of learning power is provided and the debate over how underrepresented communities can organize for educational change is discussed.

The article focuses on the summer interdisciplinary research projects that were sponsored by National Conferences on Undergraduate Research (NCUR) and the Alice and Leslie E. Lancy Foundation through a grant program at 26 campuses across the U.S. It summarizes the findings of the authors on their assessment on grant programs, focusing primarily on questions about the benefits and challenges of interdisciplinary research. It stresses that in most cases, NCUR/Lancy grants were awarded for a two year period.

Second Life (SL) is a three dimension virtual world imagined and created by its users. To explore various facets of language learning within SL, faculty members of an American university and a Chinese university took an evaluation research approach to search for appropriate ways to integrate SL into an EFL (English as a Foreign Language) program. This paper reports a part of the research efforts with a focus on the Chinese students' perspectives of an EFL Program in SL. Specifically included in this paper are (a) the Chinese students' perceived technology readiness to use SL for EFL learning, (b) their perceptions of SL, and (c) the EFL Program implemented in SL. The paper reviews related literature and theoretical support, describes the study's context and its implementation procedures, and discusses the evaluation results and implications. Finally, the paper shares with the audience some considerations for integrating SL into an EFL program. [ABSTRACT FROM AUTHOR]

This study describes the design of the process evaluation of a collaborative effort among community partners to address health issues in central Oklahoma. The design is an application of a sound process evaluation planning framework that integrates the components of context, reach, dose delivered, dose received, fidelity, implementation, recruitment, barriers, and maintenance. The planning framework also provides guidance regarding the steps of designing and implementing the process evaluation. This planning process was conducted by utilizing a participatory research approach. At the end of the planning phase, the evaluation team accomplished the following: (a) development of an evaluation plan, (b) development of evaluation instruments (i.e., surveys, interview guides, observation forms), and (c) development of evaluation questions and process objectives. The information derived from this study can be valuable to practitioners and researchers involved in the planning of community partnerships or coalitions and interested in process evaluation that takes place in community settings. [ABSTRACT FROM AUTHOR]

With the goal of assisting predominantly low-socio-economic status and minority undergraduate education majors to achieve necessary competence in the use of oral and written Standard English, an innovative action research initiative was incorporated into an introductory education class at a comprehensive urban university in the northeastern part of the United States. The project integrated written and oral Standard English exercises into the course's curriculum as a means of bolstering students' skills while still helping them master the course content. Preliminary results demonstrate students' improved competence in both written and oral Standard English, and an increased awareness of how and when to use various forms of English. [ABSTRACT FROM AUTHOR]

The article presents a study on the ground-based method of assessing urban forest structure, functions and values in the U.S. The data collection variables and model methods were compared among its 14 cities with an average tree density ranging from 22.5 trees/ha to 111.6 trees/ac. The Urban Forest Effects (UFORE) model was developed to help in assessing the urban forest structure and several functions.

Copyright of Canadian Journal of Program Evaluation is the property of University of Toronto Press and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

This chapter describes the results of an exploratory study that sought to understand what U.S. American Evaluation Association members think process use looks like in practice. [ABSTRACT FROM AUTHOR]

The National Research Council’s report on evaluating anticrime programs contains sensible suggestions for improving evaluation research in criminal justice but neglects the important role of substantive theory in linking evaluations of anticrime initiatives to variation in crime rates across time and place. A working knowledge of crime rates is essential for designing and evaluating anticrime programs. This essay calls for the development of a policy evaluation infrastructure that would support the continuous monitoring of crime rates, generate knowledge of crime-producing conditions, and link evaluation research findings to one another and to expected policy outcomes, notably crime reduction. [ABSTRACT FROM AUTHOR]

The National Research Council (NRC) Report on Improving Evaluation of Anticrime Programs raises a fundamental question about the mission of evaluation research. The implicit premise of the report is that the mission of evaluation is to answer questions about programs developed by others; in short, to test anti-crime programs. In contrast, the mission of experimental criminology has, historically, been to develop anti-crime programs as well as to test them. There are times when an arm’s-length relationship between program and evaluation may be appropriate. Yet, such a separation necessarily produces a courtroom-like adjudication role for evaluators, rather than the laboratory-like, participant–inventor role that has characterized the best of experimental criminology. The recent case of the Chicago police’s “evaluating” the use of sequential suspect identification methods developed by academic psychologists shows the many flaws of the “testing-only” model. This suggests that providing “effective guidance of criminal justice policy and practice,” as the NRC report defines its focus [Lipsey, M. ed (2005). http://newton.nap.edu/pdf/0309097061/pdf_image/R1.pdf] will not only require evaluation research (defined as arm’s-length testing) but the full toolbox of experimental criminology to develop and test anti-crime programs. [ABSTRACT FROM AUTHOR]

The article presents a research that proposes a method for evaluating the Older Blind Independent Living Program in the U.S. It focuses on the improvement of measurement quality and consideration of additional methodological approaches to evaluation of national services to persons who are blind or visually impaired. It seeks to demonstrate that covariance structure analysis can contribute substantively to the examination of relationships among measured constructs, specifically program effectiveness: how improvements in blindness and low-vision rehabilitation skills can positively affect other activities of daily living related to functioning and satisfaction.

This methodological study examines an original data collection model designed to incorporate human factors and enhance data richness in qualitative and evaluation research. Evidence supporting this model is drawn from in-depth youth and adult interviews in one of the largest policy/program evaluations undertaken in the United States, the Drug, Alcohol, and Tobacco Education evaluation (77 districts, 118 schools). When applying the explicit observation technique (EOT)—the strategic and non judgmental disclosure of nonverbal human factor cues by the interviewer to the respondent during interview—data revealed the observation disclosure pattern. Here, respondents linked perceptions with policy or program implementation or effectiveness evidence. Although more research is needed, it is concluded that the EOT yields richer data when compared with traditional semistructured interviews and, thus, holds promise to enhance qualitative and evaluation research methods. Validity and reliability as well as qualitative and evaluation research considerations are discussed. [ABSTRACT FROM AUTHOR]

The article discusses the researchers' experiences in searching for relevant information on the educational and training requirements of child welfare case managers in the United States. The researchers faced several methodological challenges in their research work, which evaluated the hiring and training policies of a state child welfare agency. Different stakeholders' viewpoints are analyzed using information from administrative data, focus groups, advisory groups and online and mailed surveys.

I had the pleasure of meeting several action researchers across the USA during my sabbatical late last year. The multiple purposes for my visit to the USA were to meet doctoral students doing their research in organizational change and development in Hawaii; interview prominent action researchers in the US about examining action research dissertations; and to have discussions with action researchers on ways to increase conversations among action researchers around the world. I thought it would be good to share some insights from my visit with fellow action researchers as a letter to Action Research. [ABSTRACT FROM AUTHOR]

Copyright of Canadian Journal of Program Evaluation is the property of University of Toronto Press and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

This articles examines the role of community collaborative research in the development of prevention evaluation research and intervention capacity on a local level through community organizations and/or local health departments in the United States. It summarizes issues and best practices across projects. It also provides linkages with Community Collaborative Research Initiative outputs on a statewide level through infrastructure developed through the partnerships between public health and research systems. Finally, the article presents a number of processes and practices designed to build evaluation capacity.

Focuses on the lipid management pilot program run by clinical pharmacists for the medically underserved in Hale County, Alabama. Reasons for the development of the program in the county; Description of the program; Significance of the program in preventing and treating coronary heart diseases which is very rampant in the county.

Suggests alternative ways of implementing legislation of the U.S. Congress that provides funding to religious organizations in their social service work. Information on the charitable laws and its merits; Analysis of an alternative program which promote spiritual transformation as an integral part of the social service programs of religious organizations; Details of a White House report on the status of equal opportunity public funding for nonprofit organizations and faith-based social service providers; Suggestions on the implementation of charitable laws focusing on empirical data and strong public support.

Explores the implications of performance ethnography as a powerful tool for representing themes that emerge from ethnographic evaluation research using data from the North Carolina A+ Schools Program. Comparison of the aspects of different approaches to program evaluation focusing on distance response or the emotional engagement of audience; Evaluation of the relational basis of dialogic encounter for use in performance ethnography; Significance of the distinction between monologue and dialogue approach to the development of a rationale for the use of performance ethnography that may foster reflection between evaluators and program participants.

Examines the concept of evaluation criteria in public policymaking and implementation within consensus-seeking partnerships in the U.S. Problems involving the economy, regulation and threat to property rights; Range of partnership goals; Contribution of the overall evaluation.

This article provides an overview of the history and context leading to Florida's efforts to implement an evaluation-driven research and associated quality assurance system for its juvenile justice education policies and practices. The Juvenile Justice Educational Enhancement Program began implementing Florida's evaluation research and quality assurance system to juvenile justice education in 1998. The article includes a brief summary of articles comprising this special issue of Evaluation Review that address the Juvenile Justice Educational Enhancement Program's various functions, methodological components, data, preliminary findings, continuing evaluation research efforts, and impediments. [ABSTRACT FROM AUTHOR]

This article discusses the Juvenile Justice Educational Enhancement Program's evaluation of juvenile justice education through the integration of multiple data sources. Validation of best practices and the corresponding effect of these practices on community reintegration require the development of a comprehensive database of program-level and individual-level indicators from several sources. These sources include the Florida Department of Education, the Florida Department of Juvenile Justice, the Florida Department of Law Enforcement, the Florida Department of Corrections, and the Juvenile Justice Educational Enhancement Program's own educational quality assurance and pre-/posttest data. This article examines the methodological, political, and bureaucratic obstacles encountered in this effort. Evaluation research analyses are also explored with an emphasis on the meaning of outcome measures relative to causal issues of time order, the modeling of events, and analytic strategy. The article provides a framework for future juvenile justice educational evaluation and a critical examination of problems encountered in integrating data sources for the purpose of outcome evaluation. [ABSTRACT FROM AUTHOR]

This article discusses the role of politics in the Juvenile Justice Educational Enhancement Program's effort to use evaluation research data to inform Florida's juvenile justice education policies and practices. Through consideration of the Juvenile Justice Education Enhancement Program's experiences with privatization and the tough love and economy of scale rationales for larger and more custodial juvenile institutions, the variable role of politics is examined. Although the two examples are different, the discussion demonstrates that by maintaining an overriding commitment to its evaluation research purpose, the Juvenile Justice Educational Enhancement Program has been able to continue its data-driven policy efforts despite operating in a politically charged environment. [ABSTRACT FROM AUTHOR]

Focuses on the tracking and probing performance of public program service delivery for evaluation professionals in the U.S. Method for improving the understanding of the operations and results of public programs; Potential roles of evaluation professionals; Effects of performance measurement on the supply of evaluation expertise.

Presents a preview on the projections in the field of evaluation research in the U.S. Developments occurring in the field of evaluation; Demand for evaluator expertise; Factors affecting the field of evaluation.

Reports the evaluation of the fidelity of service practices to system-of-care principles (SOC) in the United States. Comparison of practice-level variables between SOC and traditional service systems; Implications of the study for the principle; Implementation of SOC at the practice-level.

Examines the role of practitioner skill on evaluation program teaching in the United States. Description of the professor-student involvement on evaluation separate from coursework; Discussion on directed evaluation experience; Implication of challenges on teaching program evaluation.

Presents an interview with University of Illinois professor Jennifer C. Greene on the evaluation of Natural Resources Leadership Program in the United States. Illustration of evaluation methods; Basis of the evaluation; Purpose of the evaluation.

Examines an evaluation framework based on the perceived needs of grant-giving foundations in the United States. Role of evaluation in grant-giving foundations; Experience of creating and managing evaluation offices; Challenges faced by organization regarding evaluation.

Focuses on the development of collection capacity of the evaluation community in the United States. Impact of collective capacity building on quality of life among evaluators; Factors affecting the relationship of evaluators; Recommendations for improving collective capacity relationship.

Focuses on the development of PROTOTYPES WomensLink, a community based organization for women with HIV/AIDS in Los Angeles, California. Selection of program components; List of challenges related to evaluation design and implementation; Collaboration between community-based programs and applied researchers.

Focuses on the integration of evaluation in comprehensive HIV care programs. Development of specialized evaluation models; Use of evaluation data to ensure quality of care and improve clinic programs; Need for monitoring program operations in clinical settings.

Evaluates the programs of the community-based organizations (CBO) aimed at providing quality care for HIV/AIDS patients in the United States. Barriers encountered in approaching services; Provision of technical assistance to CBO.

Examines conceptual issues in program evaluation for HIV/AIDS services within a community-based organization in the United States. Considerations for a community-based organization participating in a demonstration project; Changes in the national context of HIV/AIDS.

Evaluates the Special Projects of National Significance (SPNS) Innovative Models of HIV/AIDS Care Initiative funded by the Health Resources and Services Administration in the United States. Mechanism of the SPNS Cooperative Agreement Projects.

Focuses on the planned variation approach for improving social and educational programs in the United States. Implications for the needs of program operators; Provision of methodological advantages and tests program theory; Consideration of issues for implementation; Comparison of the approach to other types of theory-based evaluation.

Comments on the article of Professor John Stanfield on race awareness in the United States. Recapitulation on American educational and social structures; Significance of creating institutional change; Problems of educating educationally and socially disadvantaged children; Value of rethinking methods for minority evaluation programs.

Part II. Provides a systematic meta-evaluation of the Veterans Benefits Administration's Reader Focused Writing program evaluation in the United States. Implications for the improvement of professional practice; Use of a systematic inquiry in assessing evaluative standards; Importance of evaluator competence and ethical professionalism in work performance.

Presents the Reader-Focused Writing Project evaluation by CIRCE in Illinois. Demonstration of a close-to-deal evaluation case regarding benefits of veterans; Performance rating of the CIRCE study in managing the program for the Veterans Benefits Administration; Verdict of meta-evaluators on the CIRCE program evaluation.

Provides an abbreviated summary of a completed evaluation study critiqued by competent evaluators in Chicago, Illinois. Evaluation of the Reader Focused Writing program for the Veterans Benefits Administration (VBA); Identification of VBA training goals; Evaluation design as an interpretive data; Excerpts from the data collection and analysis section.

Comments on the implications of human disability and diversity for evaluation practice in the United States. Impact of human differences on social researches; Challenge of including disabled people in cultural and ethical value assessments; Description of the disability social model.

Focuses on the relevance of physical disability in evaluation in the United States. Disability as a dimension of human diversity; Prevalence of neglect of disability in evaluation; Comparison between the moral and medical model of disability; Importance of core values to evaluation practices; Issues concerning evaluation of disability programs.

Assesses the effectiveness of a strategy in obtaining active written parental consent for outcome evaluation of an alcohol, tobacco and drug abuse prevention program in the United States. Implementation of the study in school districts; Use of the multiple case study approach and a performance adequacy analysis; Cost effective analysis of the program.

Presents some non-randomized constructed comparison groups for evaluating age-related outcomes of intervention programs for young children in the United States. Impact of treatment on age-dependent variables; Effect of economic conditions on the developmental process of children; Correlation between the length of treatment time and the different age spans.