Search

Background A challenge for systematic reviews on improving health worker performance is that included studies often use different performance indicators, and the validity of comparing interventions with different indicators is unclear. One potential solution is to adjust comparisons by indicator category, with categories based on steps of the case-management process that can be easily recognized (assessment of symptoms, treatment etc.) and that might require different levels of effort to bring about improvements. However, this approach would only be useful if intervention effect sizes varied by indicator category. To explore this approach, studies were analyzed that evaluated the Integrated Management of Childhood Illness (IMCI) strategy. Methods Performance indicators were grouped into four categories: patient assessment, diagnosis, treatment and counseling. An effect size of IMCI was calculated for each indicator. Linear regression modeling was used to test for differences among the mean effect sizes of the indicator categories. Results Six studies were included, with data from 3136 ill child consultations. Mean effect sizes for 63 assessment indicators, 12 diagnosis indicators, 31 treatment indicators and 34 counseling indicators were 50.9 percentage-points (%-points), 44.7, 36.5 and 46.6%-points, respectively. After adjusting for baseline indicator value, compared with the assessment mean effect size, the diagnosis mean was 7.3%-points lower (P = 0.23), the treatment mean was 15.2%-points lower (P = 0.0004) and the counseling mean was 12.9%-points lower (P = 0.0027). Conclusion Adjusting the results of systematic reviews for indicator category and baseline indicator value might be useful for improving the validity of intervention comparisons. [ABSTRACT FROM PUBLISHER]

Objective Training health workers to use Integrated Management of Childhood Illness (IMCI) guidelines can improve care for ill children in outpatient settings in developing countries. However, even after IMCI training, important performance gaps exist. One potential reason is that the effect of training can rapidly wane. Our aim was to determine if the performance of IMCI-trained health workers deteriorated over 3 years. Methods We studied two departments in Benin. First, we performed a record review of 32 IMCI-trained health workers during the first year of IMCI implementation (2001-2002). Second, we analysed data from cross-sectional health facility surveys from 2001 to 2004 that represented the entire study area. Primary outcomes were the proportion of children under 5 years old with potentially life-threatening illnesses who received either recommended or adequate treatment, and among all children, an index of overall guideline adherence. Secondary outcomes reflected the treatment of individual diseases. Outcomes were calculated monthly, and time trends were evaluated with regression modelling. Results The record review included 9393 consultations, and the surveys included 411 consultations performed by 105 health workers. For both data sources, performance trends were essentially flat for nearly all outcomes. Absolute levels of performance revealed substantial performance gaps. Conclusions We found no evidence that performance declined over 3 years after IMCI training. However, important performance gaps found immediately after IMCI training persisted and should be addressed. [ABSTRACT FROM AUTHOR]

Background: The simulated client (SC) method for evaluating health worker performance utilizes surveyors who pose as patients to make surreptitious observations during consultations. Compared to conspicuous observation (CO) by surveyors, which is commonly done in developing countries, SC data better reflect usual health worker practices. This information is important because CO can cause performance to be better than usual. Despite this advantage of SCs, the method's full potential has not been realized for evaluating performance for pediatric illnesses because real children have not been utilized as SCs. Previous SC studies used scenarios of ill children that were not actually brought to health workers. During a trial that evaluated a quality improvement intervention in Benin (the Integrated Management of Childhood Illness [IMCI] strategy), we conducted an SC survey with adult caretakers as surveyors and real children to evaluate the feasibility of this approach and used the results to assess the validity of CO. Methods: We conducted an SC survey and a CO survey (one right after the other) of health workers in the same 55 health facilities. A detailed description of the SC survey process was produced. Results of the two surveys were compared for 27 performance indicators using logistic regression modeling. Results: SC and CO surveyors observed 54 and 185 consultations, respectively. No serious problems occurred during the SC survey. Performance levels measured by CO were moderately higher than those measured by SCs (median CO - SC difference = 16.4 percentage-points). Survey differences were sometimes much greater for IMCI-trained health workers (median difference = 29.7 percentage-points) than for workers without IMCI training (median difference = 3.1 percentage-points). Conclusion: SC surveys can be done safely with real children if appropriate precautions are taken. CO can introduce moderately large positive biases, and these biases might be greater for health workers exposed to quality improvement interventions. [ABSTRACT FROM AUTHOR]

Objectives. To estimate the impact of the Integrated Management of Childhood Illness (IMCI) strategy on early-childhood mortality, we evaluated a malaria-control project in Benin that implemented IMCI and promoted insecticide-treated nets (ITNs). Methods. We conducted a before-and-after intervention study that included a nonrandomized comparison group. We used the preceding birth technique to measure early-childhood mortality (risk of dying before age 30 months), and we used health facility surveys and household surveys to measure process indicators. Results. Most process indicators improved in the area covered by the intervention. Notably, because ITNs were also promoted in the comparison area children's ITN use increased by about 20 percentage points in both areas. Regarding early-childhood mortality, the trend from baseline (1999-2001) to follow-up (2002-2004) for the intervention area (13.0% decrease; P<.001) was 14.1% (P<.001) lower than was the trend for the comparison area (1.3% increase; P=.46). Conclusions. Mortality decreased in the intervention area after IMCI and ITN promotion. ITN use increased similarly in both study areas, so the mortality impact of ITNs in the 2 areas might have canceled each other out. Thus, the mortality reduction could have been primarily attributable to IMCI's effect on health care quality and care-seeking. [ABSTRACT FROM AUTHOR]

Objectives. We evaluated an intervention to support health workers after training in Integrated Management of Childhood Illness (IMCI), a strategy that can improve outcomes for children in developing countries by encouraging workers' use of evidence-based guidelines for managing the leading causes of child mortality. Methods. We conducted a randomized trial in Benin. We administered a survey in 1999 to assess health care quality before IMCI training. Health workers then received training plus either study supports (job aids, nonfinancial incentives, and supervision of workers and supervisors) or usual supports. Follow-up surveys conducted in 2001 to 2004 assessed recommended treatment, recommended or adequate treatment, and an index of overall guideline adherence. Results. We analyzed 1244 consultations. Performance improved in both intervention and control groups, with no significant differences between groups. However, training proceeded slowly, and low-quality care from health workers without IMCI training diluted intervention effects. Per-protocol analyses revealed that workers with IMCI training plus study supports provided better care than did those with training plus usual supports (27.3 percentage-point difference for recommended treatment; P<.05), and both groups outperformed untrained workers. Conclusions. IMCI training was useful but insufficient. Relatively inexpensive supports can lead to additional improvements. (Am J Public Health. 2009;99: 837-846. doi:10.2105/AJPH.2008.134411) [ABSTRACT FROM AUTHOR]

To identify factors associated with improved performance of health care workers who treat ill children in developing countries, the authors analyzed a sample of consultations of children with malaria (defined as any fever) from a national health facility survey conducted in the Central African Republic from December 1995 to January 1996. Twenty-eight health care workers and 204 children were studied. A univariate analysis revealed the following significant predictors of correct treatment, as defined by the Central African malaria control program: high fever (odds ratio (OR) = 3.25, 95% confidence interval (Cl): 1.47, 7.17); correct health care worker diagnosis (OR = 2.59, 95% Cl: 1.39, 4.85); and the caregiver's reporting the child’s fever to the health care worker (OR = 2.18, 95% Cl: 1.32, 3.62). There was an unexpected inverse association between the presence of a fever treatment chart and correct treatment (OR = 0.19, 95% Cl: 0.04, 0.91). Correct treatment was marginally associated with a longer consultation time (p value for trend = 0.058). Neither in-service training in the treatment of fever nor supervision was significantly associated with correct treatment. For child health programs to improve, targeted studies are needed to understand which factors, alone or in combination, improve hearth care worker performance. Am J Epidemiol 2000; 151: 1029-35. [ABSTRACT FROM PUBLISHER]

Objective To describe an approach for evaluating the impact of malaria control efforts on malaria-associated mortality in sub-Saharan Africa, where disease-specific mortality trends usually cannot be measured directly and most malaria deaths occur among young children. Methods Methods for evaluating changes in malaria-associated mortality are examined; advantages and disadvantages are presented. Results All methods require a plausibility argument—i.e., an assumption that mortality reductions can be attributed to programmatic efforts if improvements are found in steps of the causal pathway between intervention scale-up and mortality trends. As different methods provide complementary information, they can be used together. We recommend following trends in the coverage of malaria control interventions, other factors influencing childhood mortality, malaria-associated morbidity (especially anaemia), and all-cause childhood mortality. This approach reflects decreases in malaria’s direct and indirect mortality burden and can be examined in nearly all countries. Adding other information can strengthen the plausibility argument: trends in indicators of malaria transmission, information from demographic surveillance systems and sentinel sites where malaria diagnostics are systematically used, and verbal autopsies linked to representative household surveys. Health facility data on malaria deaths have well-recognized limitations; however, in specific circumstances, they could produce reliable trends. Model-based predictions can help describe changes in malaria-specific burden and assist with program management and advocacy. Conclusions Despite challenges, efforts to reduce malaria-associated mortality in Africa can be evaluated with trends in malaria intervention coverage and all-cause childhood mortality. Where there are resources and interest, complementary data on malaria morbidity and malaria-specific mortality could be added. [ABSTRACT FROM AUTHOR]

Background Past studies have shown that health workers in developing countries often do not follow clinical guidelines, though few studies have explored with appropriate methods why errors occur. To develop interventions that improve health worker performance, factors affecting treatment practices must be better understood. Methods We analysed data from a health facility survey in Blantyre District, Malawi, in which health workers were observed treating ill children, and then children were independently re-examined by ‘gold-standard’ study clinicians. The analysis was limited to children with uncomplicated malaria (defined according to Malawi's guidelines as fever or anaemia without signs of severe illness), and a treatment error was defined as failure to treat with an effective antimalarial. Results Twenty-eight health workers and 349 ill-child consultations were evaluated; 247 (70.8%) children were treated with an effective antimalarial, and 102 (29.2%) were subject to treatment error. Logistic regression analysis revealed that in-service malaria training was not associated with treatment quality (univariate odds ratio (OR) = 1.16, 95% confidence interval (CI): 0.46–2.93); whereas acute respiratory infections training was associated with making an error (adjusted OR (aOR) = 2.42, 95% CI: 1.23–4.76). High fever and chief complaint of fever were associated with fewer errors (aOR = 0.25, 95% CI: 0.10–0.60 and aOR = 0.25, 95% CI: 0.13–0.48, respectively). Errors were more likely to occur in consultations starting before 1 p.m. (aOR = 1.88, 95% CI: 1.07–3.31). Supervision was not associated with better treatment quality. Conclusions These results suggest that the disease-specific training and supervision, performed before the survey, did not lead to long-term improvements in health care quality. Furthermore, case management training for one specific disease may have worsened quality of care for another disease. These results support integration of guidelines for multiple conditions. Interventions should be evaluated for unintended negative effects on overall quality of care. [ABSTRACT FROM AUTHOR]

Objective To describe options for analysing deaths with an unknown cause, which often occur in community-based studies that are used to estimate disease-specific mortality burden and trends in low-income countries. Methods Mathematical formulae were derived that accommodate deaths with an unknown cause for the disease-specific mortality rate, proportion of deaths attributable to the disease and all-cause mortality rate. Seven specific options are presented, including example calculations from a study of childhood malaria mortality in The Gambia. An algorithm is proposed to help make decisions on analysing deaths with an unknown cause. Results In the Gambian study, 25.2% of deaths had an unknown cause. Three options would result in 23.6% (minimum), 48.8% (maximum) and 28.7% (probably the best estimate) of deaths attributed to malaria. The best analysis option depends on the disease of interest: diseases for which the diagnostic method has high sensitivity and specificity (e.g., measles, neonatal tetanus) are best analysed assuming that deaths with an unknown cause never have this cause, while diseases for which specificity and/or sensitivity is low (e.g., malaria) are likely to account for some proportion of deaths with an unknown cause. Conclusions The most important aspects of analysing deaths with unknown cause are choosing appropriate assumptions, describing them explicitly and performing a sensitivity analysis. Studies of causes of death should report several key pieces of information on deaths with unknown cause to aid interpretation. [ABSTRACT FROM AUTHOR]

Summary In low and middle income countries, health workers are essential for the delivery of health interventions. However, inadequate health-worker performance is a very widespread problem. We present an overview of issues and evidence about the determinants of performance and strategies for improving it. Health-worker practices are complex behaviors that have many potential influences. Reviews of intervention studies in low and middle income countries suggest that the simple dissemination of written guidelines is often ineffective, that supervision and audit with feedback is generally effective, and that multifaceted interventions might be more effective than single interventions. Few interventions have been evaluated with rigorous cost-effectiveness trials, and such studies are urgently needed to guide policy. We propose an international collaborative research agenda to generate knowledge about the true determinants of performance and about the effectiveness of strategies to improve performance. Furthermore, we recommend that ministries of health and international organizations should actively help translate research findings into action to improve health-worker performance, and thereby improve health. [ABSTRACT FROM AUTHOR]

: BackgroundPopulation attributable fractions (PAFs) are useful for estimating the proportion of disease cases that could be prevented if risk factors were reduced or eliminated. For diseases with multiple risk factors, PAFs of individual risk factors can sum to more than 1, a result suggesting the impossible situation in which more than 100% of cases are preventable.: MethodsA hypothetical example in which risk factors for a disease were eliminated in different sequences was analyzed to show why PAFs can sum to more than 1.: ResultsPAF estimates assume each risk factor is the first to be eliminated, thereby describing mutually exclusive scenarios that are illogical to sum, except under special circumstances. PAFs can sum to more than 1 because some individuals with more than one risk factor can have disease prevented in more than one way, and the prevented cases of these individuals could be counted more than once. Upper and lower limits of sequential attributable fractions (SAFs) can be calculated to describe the maximum and minimum proportions of the original number of disease cases that would be prevented if a particular risk factor were eliminated.: ConclusionsImproved descriptions of the assumptions that underlie the PAF calculations, use of SAF limits, or multivariable PAFs would help avoid unrealistic estimates of the disease burden that would be prevented after resources are expended to reduce or eliminate multiple risk factors. [Copyright &y& Elsevier]

A letter to the editor in response to the article "Volume and Outcome: It Is Time to Move Ahead," by A.M. Epstein in the April 11, 2002 issue is presented.

Objectives. To prepare for the implementation of Integrated Management of Childhood Illness (IMCI) in Benin, we studied the management of ill children younger than 5 years at outpatient health facilities. Methods. We observed a representative sample of consultations; after each consultation, we interviewed caregivers and reexamined children. Health workers' performance was evaluated against IMCI guidelines. To identify determinants of performance, statistical modeling was performed and 6 focus groups with health workers were conducted to solicit their opinions. Results. Altogether, 584 children were enrolled and 101 health workers were observed; 130 health workers participated in focus group discussions. Many serious deficiencies were found: incomplete assessment of children's signs and symptoms, incorrect diagnosis and treatment of potentially life-threatening illnesses, inappropriate prescription of dangerous sedatives, missed opportunities to vaccinate, and failure to refer severely ill children for hospitalization. Quantitative and qualitative analyses showed various health facility-, health worker-, caregiver-, and child-related factors as possible determinants of health worker performance. Conclusions. Action is urgently needed. Our results suggest that to improve health care delivery, interventions should target both the health system and the community level. (Am J Public Health. 2001;91:1625-1635) [ABSTRACT FROM AUTHOR]

Conclusions. Georgia adults have low awareness of stroke warning signs. Our findings underscore the importance of conducting an effective educational campaign. Furthermore, a need exists for questions on stroke awareness that approximate more closely the situation in which a person must identify a potential stroke. [ABSTRACT FROM AUTHOR]

Studies convalescent Ebola hemorrhagic fever patients and household contacts in Kikwit, Zaire to determine if secondary transmission occurs during convalescence. Number of people who died from the disease; Duration of infectivity; Conditions and symptoms manifested by infected patients.

Investigates the effectiveness of using single dose of sodium hypochlorite to disinfect Vibrio cholerae-contaminated well water in Guinea-Bissau, West Africa. Measurement of chlorination level; Chlorination protocol; Duration of adequate chlorination.

Background: In many contexts, including fragile settings like Afghanistan, the coverage of basic health services is low. To address these challenges there has been considerable interest in working with NGOs and examining the effect of financial incentives on service providers. The Government of Afghanistan has used contracting with NGOs for more than 15 years and in 2019 introduced pay-for-performance (P4P) into the contracts. This study examines the impact of P4P on health service delivery in Afghanistan. Methods: We conducted an interrupted time series (ITS) analysis with a non-randomized comparison group that employed segmented regression models and used independently verified health management information system (HMIS) data from 2015 to 2021. We compared 31 provinces with P4P contracts to 3 provinces where the Ministry of Public Health (MOPH) continued to deliver services without P4P. We used data from annual health facility surveys to assess the quality of care. Findings: Independent verification of the HMIS data found that consistency and accuracy was greater than 90% in the contracted provinces. The introduction of P4P increased the 10 P4P-compensated service delivery outcomes by a median of 22.1 percentage points (range 10.2 to 43.8) for the two-arm analysis and 19.9 percentage points (range: - 8.3 to 56.1) for the one-arm analysis. There was a small decrease in quality of care initially, but it was short-lived. We found few other unintended consequences. Interpretation: P4P contracts with NGOs led to a substantial improvement in service delivery at lower cost despite a very difficult security situation. The promising results from this large-scale experience warrant more extensive application of P4P contracts in other fragile settings or wherever coverage remains low. [ABSTRACT FROM AUTHOR]

Background: Although supervision is a ubiquitous approach to support health programs and improve health care provider (HCP) performance in low- and middle-income countries (LMICs), quantitative evidence of its effects is unclear. The objectives of this study are to describe the effect of supervision strategies on HCP practices in LMICs and to identify attributes associated with greater effectiveness of routine supervision.Methods: We performed a secondary analysis of data on HCP practice outcomes (e.g., percentage of patients correctly treated) from a systematic review on improving HCP performance. The review included controlled trials and interrupted time series studies. We described distributions of effect sizes (defined as percentage-point [%-point] changes) for each supervision strategy. To identify attributes associated with supervision effectiveness, we performed random-effects linear regression modeling and examined studies that directly compared different approaches of routine supervision.Results: We analyzed data from 81 studies from 36 countries. For professional HCPs, such as nurses and physicians, primarily working at health facilities, routine supervision (median improvement when compared to controls: 10.7%-points; IQR: 9.9, 27.9) had similar effects on HCP practices as audit with feedback (median improvement: 10.1%-points; IQR: 6.2, 23.7). Two attributes were associated with greater mean effectiveness of routine supervision (p < 0.10): supervisors received supervision (by 8.8-11.5%-points), and supervisors participated in problem-solving with HCPs (by 14.2-20.8%-points). Training for supervisors and use of a checklist during supervision visits were not associated with effectiveness. The effects of supervision frequency (i.e., number of visits per year) and dose (i.e., the number of supervision visits during a study) were unclear. For lay HCPs, the effect of routine supervision was difficult to characterize because few studies existed, and effectiveness in those studies varied considerably. Evidence quality for all findings was low primarily because many studies had a high risk of bias.Conclusions: Although evidence is limited, to promote more effective supervision, our study supports supervising supervisors and having supervisors engage in problem-solving with HCPs. Supervision's integral role in health systems in LMICs justifies a more deliberate research agenda to identify how to deliver supervision to optimize its effect on HCP practices. [ABSTRACT FROM AUTHOR]

Objective To evaluate treatment practices for uncomplicated malaria after the policy change from chloroquine to sulfadoxine-pyrimethamine and to artemether-lumefantrine in Zambia. Design Cross sectional survey. Setting Outpatient departments of all government and mission facilities in four districts in Zambia. Participants 944 children with uncomplicated malaria seen by 103 health workers at 94 health facilities. Main outcome measures Antimalarial prescriptions in accordance with national guidelines and influence of factors on health workers' decision to prescribe artemether-lumefantrine. Results Artemether-lumefantrine, sulfadoxine-pyrimethamine, and chloroquine were available, respectively, at 48 (51%), 94 (100%), and 71 (76%) of the 94 facilities. Of 944 children with uncomplicated malaria, only one child (0.1%) received chloroquine. Among children weighing less than 10 kg, sulfadoxine-pyrimethamine was commonly prescribed in accordance with guidelines (439/550, 79.8%). Among the children weighing 10 kg or more, sulfadoxine-pyrimethamine was commonly prescribed (266/394, 68%), whereas recommended artemether-lumefantrine was prescribed for only 42/394 (11%) children. Among children weighing 10 kg or more seen at facilities where artemether-lumefantrine was available, the same pattern was observed: artemether-lumefantrine was prescribed for only 42/192 (22%) children and sulfadoxine-pyrimethamine remained the drug of choice (103/192, 54%). Programmatic activities such as in-service training and provision of job aids did not seem to influence the prescribing of artemether with lumefantrine. Conclusion Although the use of chloroquine for uncomplicated malaria was successfully discontinued in Zambia, the change of drug policy towards artemether-lumefantrine does not necessarily translate into adequate use of this drug at the point of care. [ABSTRACT FROM AUTHOR]

Background: Surveillance data are essential for malaria control, but quality is often poor. The aim of the study was to evaluate the effectiveness of the novel combination of training plus an innovative quality improvement method—collaborative improvement (CI)—on the quality of malaria surveillance data in Uganda. Methods: The intervention (training plus CI, or TCI), including brief in-service training and CI, was delivered in 5 health facilities (HFs) in Kayunga District from November 2015 to August 2016. HF teams monitored data quality, conducted plan-do-study-act cycles to test changes, attended periodic learning sessions, and received CI coaching. An independent evaluation was conducted to assess data completeness, accuracy, and timeliness. Using an interrupted time series design without a separate control group, data were abstracted from 156,707 outpatient department (OPD) records, laboratory registers, and aggregated monthly reports (MR) for 4 time periods: baseline—12 months, TCI scale-up—5 months; CI implementation—9 months; post-intervention—4 months. Monthly OPD register completeness was measured as the proportion of patient records with a malaria diagnosis with: (1) all data fields completed, and (2) all clinically-relevant fields completed. Accuracy was the relative difference between: (1) number of monthly malaria patients reported in OPD register versus MR, and (2) proportion of positive malaria tests reported in the laboratory register versus MR. Data were analysed with segmented linear regression modelling. Results: Data completeness increased substantially following TCI. Compared to baseline, all-field completeness increased by 60.1%-points (95% confidence interval [CI]: 46.9–73.2%) at mid-point, and clinically-relevant completeness increased by 61.6%-points (95% CI: 56.6–66.7%). A relative − 57.4%-point (95% confidence interval: − 105.5, − 9.3%) change, indicating an improvement in accuracy of malaria test positivity reporting, but no effect on data accuracy for monthly malaria patients, were observed. Cost per additional malaria patient, for whom complete clinically-relevant data were recorded in the OPD register, was $3.53 (95% confidence interval: $3.03, $4.15). Conclusions: TCI improved malaria surveillance completeness considerably, with limited impact on accuracy. Although these results are promising, the intervention's effectiveness should be evaluated in more HFs, with longer follow-up, ideally in a randomized trial, before recommending CI for wide-scale use. [ABSTRACT FROM AUTHOR]

Background: Demand for high-quality surveillance data for malaria, and other diseases, is greater than ever before. In Uganda, the primary source of malaria surveillance data is the Health Management Information System (HMIS). However, HMIS data may be incomplete, inaccurate or delayed. Collaborative improvement (CI) is a quality improvement intervention developed in high-income countries, which has been advocated for low-resource settings. In Kayunga, Uganda, a pilot study of CI was conducted in five public health centres, documenting a positive effect on the quality of HMIS and malaria surveillance data. A qualitative evaluation was conducted concurrently to investigate the mechanisms of effect and unintended consequences of the intervention, aiming to inform future implementation of CI. Methods: The study intervention targeted health workers, including brief in-service training, plus CI with 'plan-do-study-act' (PDSA) cycles emphasizing self-reflection and group action, periodic learning sessions, and coaching from a CI mentor. Health workers collected data on standard HMIS out-patient registers. The qualitative evaluation (July 2015 to September 2016) included ethnographic observations at each health centre (over 12–14 weeks), in-depth interviews with health workers and stakeholders (n = 20), and focus group discussions with health workers (n = 6). Results: The results suggest that the intervention did facilitate improvement in data quality, but through unexpected mechanisms. The CI intervention was implemented as planned, but the PDSA cycles were driven largely by the CI mentor, not the health workers. In this context, characterized by a rigid hierarchy within the health system of limited culture of self-reflection and inadequate training and supervision, CI became an effective form of high-quality training with frequent supervisory visits. Health workers appeared motivated to improve data collection habits by their loyalty to the CI mentor and the potential for economic benefits, rather than a desire for self-improvement. Conclusions: CI is a promising method of quality improvement and could have a positive impact on malaria surveillance data. However, successful scale-up of CI in similar settings may require deployment of highly skilled mentors. Further research, focusing on the effectiveness of 'real world' mentors using robust study designs, will be required to determine whether CI can be translated effectively and sustainably to low-resource settings. [ABSTRACT FROM AUTHOR]

Background: Quality improvement collaboratives (QICs) have been used to improve health care for decades. Evidence on QIC effectiveness has been reported, but systematic reviews to date have little information from low- and middle-income countries (LMICs). Objective: To assess the effectiveness of QICs in LMICs. Methods: We conducted a systematic review following Cochrane methods, the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach for quality of evidence grading, and the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) statement for reporting. We searched published and unpublished studies between 1969 and March 2019 from LMICs. We included papers that compared usual practice with QICs alone or combined with other interventions. Pairs of reviewers independently selected and assessed the risk of bias and extracted data of included studies. To estimate strategy effectiveness from a single study comparison, we used the median effect size (MES) in the comparison for outcomes in the same outcome group. The primary analysis evaluated each strategy group with a weighted median and interquartile range (IQR) of MES values. In secondary analyses, standard random-effects meta-analysis was used to estimate the weighted mean MES and 95% confidence interval (CI) of the mean MES of each strategy group. This review is registered with PROSPERO (International Prospective Register of Systematic Reviews): CRD42017078108. Results: Twenty-nine studies were included; most (21/29, 72.4%) were interrupted time series studies. Evidence quality was generally low to very low. Among studies involving health facility-based health care providers (HCPs), for “QIC only”, effectiveness varied widely across outcome groups and tended to have little effect for patient health outcomes (median MES less than 2 percentage points for percentage and continuous outcomes). For “QIC plus training”, effectiveness might be very high for patient health outcomes (for continuous outcomes, median MES 111.6 percentage points, range: 96.0 to 127.1) and HCP practice outcomes (median MES 52.4 to 63.4 percentage points for continuous and percentage outcomes, respectively). The only study of lay HCPs, which used “QIC plus training”, showed no effect on patient care-seeking behaviors (MES -0.9 percentage points), moderate effects on non-care-seeking patient behaviors (MES 18.7 percentage points), and very large effects on HCP practice outcomes (MES 50.4 percentage points). Conclusions: The effectiveness of QICs varied considerably in LMICs. QICs combined with other invention components, such as training, tended to be more effective than QICs alone. The low evidence quality and large effect sizes for QIC plus training justify additional high-quality studies assessing this approach in LMICs. [ABSTRACT FROM AUTHOR]

Background: Mobile health (mHealth), which uses technology such as mobile phones to improve patient health and health care delivery, is increasingly being tested as an intervention to promote health worker (HW) performance. This study assessed the effect of short messaging services (SMS) reminders in a study setting. Following a trial of text-message reminders to HWs to improve case management of malaria and other childhood diseases in southern Malawi that showed little effect, qualitative data was collected to explore the reasons why the intervention was ineffective and describe lessons learned. Methods: Qualitative data collection was undertaken to lend insight into quantitative results from a trial in which 105 health facilities were randomized to three arms: (1) twice-daily text-message reminders to HWs, including clinicians and drug dispensers, on case management of malaria; (2) twice-daily text-message reminders to HWs on case management of malaria, pneumonia and diarrhoea; and, (3) a control arm. In-depth interviews were conducted with 50 HWs in the intervention arms across seven districts. HWs were asked about acceptability and feasibility of the text-messaging intervention and its perceived impact on recommended case management. The interviews were recorded, transcribed and translated into English for a thematic and framework analysis. Nvivo 11 software was used for data management and analysis. Results: A total of 50 HWs were interviewed at 22 facilities. HWs expressed high acceptance of text-message reminders and appreciated messages as job aids and practical reference material for their day-to-day work. However, HWs said that health systems barriers, including very high outpatient workload, commodity stock-outs, and lack of supportive supervision and financial incentives demotivated them, limited their ability to act on messages and therefore adherence to case management guidelines. Drug dispensers were more likely than clinicians to report usage of text-message reminders. Despite these challenges, nearly all HWs expressed a desire for a longer duration of the SMS intervention. Conclusions: Text-message reminders to HWs can provide a platform to improve understanding of treatment guidelines and case management decision-making skills, but might not improve actual adherence to guidelines. More interaction, for example through targeted supervision or two-way technology communication, might be an essential intervention component to help address structural barriers and facilitate improved clinical practice. [ABSTRACT FROM AUTHOR]

Background: Health care provider (HCP) performance in low- and middle-income countries (LMICs) is often inadequate. The Health Care Provider Performance Review (HCPPR) is a comprehensive systematic review of the effectiveness and cost of strategies to improve HCP performance in LMICs. We present the HCPPR’s methods, describe methodological and contextual attributes of included studies, and examine time trends of study attributes. Methods: The HCPPR includes studies from LMICs that quantitatively evaluated any strategy to improve HCP performance for any health condition, with no language restrictions. Eligible study designs were controlled trials and interrupted time series. In 2006, we searched 15 databases for published studies; in 2008 and 2010, we completed searches of 30 document inventories for unpublished studies. Data from eligible reports were double-abstracted and entered into a database, which is publicly available. The primary outcome measure was the strategy’s effect size. We assessed time trends with logistic, Poisson, and negative binomial regression modeling. We were unable to register with PROSPERO (International Prospective Register of Systematic Reviews) because the protocol was developed prior to the PROSPERO launch. Results: We screened 105,299 citations and included 824 reports from 499 studies of 161 intervention strategies. Most strategies had multiple components and were tested by only one study each. Studies were from 79 countries and had diverse methodologies, geographic settings, HCP types, work environments, and health conditions. Training, supervision, and patient and community supports were the most commonly evaluated strategy components. Only 33.6% of studies had a low or moderate risk of bias. From 1958–2003, the number of studies per year and study quality increased significantly over time, as did the proportion of studies from low-income countries. Only 36.3% of studies reported information on strategy cost or cost-effectiveness. Conclusions: Studies have reported on the efficacy of many strategies to improve HCP performance in LMICs. However, most studies have important methodological limitations. The HCPPR is a publicly accessible resource for decision-makers, researchers, and others interested in improving HCP performance. [ABSTRACT FROM AUTHOR]

A lack of clear guidance for funders, evaluators and improvers on what to include in evaluation proposals can lead to evaluation designs that do not answer the questions stakeholders want to know. These evaluation designs may not match the iterative nature of improvement and may be imposed onto an initiative in a way that is impractical from the perspective of improvers and the communities with whom they work. Consequently, the results of evaluations are often controversial, and attribution remains poorly understood. Improvement initiatives are iterative, adaptive and context-specific. Evaluation approaches and designs must align with these features, specifically in their ability to consider complexity, to evolve as the initiative adapts over time and to understand the interaction with local context. Improvement initiatives often identify broadly defined change concepts and provide tools for care teams to tailor these in more detail to local conditions. Correspondingly, recommendations for evaluation are best provided as broad guidance, to be tailored to the specifics of the initiative. In this paper, we provide practical guidance and recommendations that funders and evaluators can use when developing an evaluation plan for improvement initiatives that seeks to: identify the questions stakeholders want to address; develop the initial program theory of the initiative; identify high-priority areas to measure progress over time; describe the context the initiative will be applied within; and identify experimental or observational designs that will address attribution. [ABSTRACT FROM AUTHOR]

Background: During the 2014–2016 Ebola epidemic in West Africa, a key epidemiological feature was disease transmission within healthcare facilities, indicating a need for infection prevention and control (IPC) training and support. Methods: IPC training was provided to frontline healthcare workers (HCW) in healthcare facilities that were not Ebola treatment units, as well as to IPC trainers and IPC supervisors placed in healthcare facilities. Trainings included both didactic and hands-on components, and were assessed using pre-tests, post-tests and practical evaluations. We calculated median percent increase in knowledge. Results: From October–December 2014, 20 IPC courses trained 1,625 Guineans: 1,521 HCW, 55 IPC trainers, and 49 IPC supervisors. Median test scores increased 40% (interquartile range [IQR]: 19–86%) among HCW, 15% (IQR: 8–33%) among IPC trainers, and 21% (IQR: 15–30%) among IPC supervisors (all P<0.0001) to post-test scores of 83%, 93%, and 93%, respectively. Conclusions: IPC training resulted in clear improvements in knowledge and was feasible in a public health emergency setting. This method of IPC training addressed a high demand among HCW. Valuable lessons were learned to facilitate expansion of IPC training to other prefectures; this model may be considered when responding to other large outbreaks. [ABSTRACT FROM AUTHOR]

Background: Appropriate diagnosis and treatment are essential for reducing malaria mortality. A cross-sectional outpatient health facility (HF) survey was conducted in southern Malawi from January to March 2015 to determine appropriate malaria testing and treatment practices four years after implementation of a policy requiring diagnostic confirmation before treatment. Methods: Enrolled patients were interviewed, examined and had their health booklet reviewed. Health workers (HWs) were asked about training, supervision and access to the 2013 national malaria treatment guidelines. HFs were assessed for malaria diagnostic and treatment capacity. Weighted descriptive analyses and logistic regression of patient, HW and HF characteristics related to testing and treatment were performed. Results: An evaluation of 105 HFs, and interviews of 150 HWs and 2342 patients was completed. Of 1427 suspect uncomplicated malaria patients seen at HFs with testing available, 1072 (75.7%) were tested, and 547 (53.2%) tested positive. Testing was more likely if patients spontaneously reported fever (odds ratio (OR) 2.6; 95% confidence interval (CI) 1.7-4.0), headache (OR 1.5; 95% CI 1.1-2.1) or vomiting (OR 2.0; 95% CI 1.0-4.0) to HWs and less likely if they reported skin problems (OR 0.4; 95% CI 0.2-0.6). Altogether, 511 (92.7%) confirmed cases and 98 (60.3%) of 178 presumed uncomplicated malaria patients (at HFs without testing) were appropriately treated, while 500 (96.6%) of 525 patients with negative tests did not receive anti-malarials. Only eight (5.7%) suspect severe malaria patients received appropriate pre-referral treatment. Appropriate treatment was more likely for presumed uncomplicated malaria patients (at HFs without testing) with elevated temperature (OR 1.5/1 -C increase; 95% CI 1.1-1.9), who reported fever to HWs (OR 5.7; 95% CI 1.9-17.6), were seen by HWs with additional supervision visits in the previous 6 months (OR 1.2/additional visit; 95% CI 1.0-1.4), or were seen by older HWs (OR 1.1/year of age; 95% CI 1.0-1.1). Conclusions: Correct testing and treatment practices were reasonably good for uncomplicated malaria when testing was available. Pre-referral treatment for suspect severe malaria was unacceptably rare. Encouraging HWs to elicit and appropriately respond to patient symptoms may improve practices. [ABSTRACT FROM AUTHOR]

Background: Correct treatment of potentially life-threatening illnesses (PLTIs) in children under 5 years, such as malaria, pneumonia, and diarrhea, can substantially reduce mortality. The Integrated Management of Childhood Illness (IMCI) strategy has been shown to improve treatment of child illnesses, but multiple studies have shown that gaps in health worker performance remain after training. To better understand factors related to health worker performance, we analyzed 9,330 patient consultations in Benin from 2001-2002, after training one of the first cohorts of 32 health workers in IMCI. Methods: With data abstracted from patient registers specially designed for IMCI-trained health workers, we examined associations between health facility-, health worker-, and patient-level factors and 10 case-management outcomes for PLTIs. Results: Altogether, 63.6 % of children received treatment for all their PLTIs in accordance with IMCI guidelines, and 77.8 % received life-saving treatment (i.e., clinically effective treatment, even if not exactly in accordance with IMCI guidelines). Performance of individual health workers varied greatly, from 15-88 % of patients treated correctly, on average. Multivariate regression analyses identified several factors that might have influenced case-management quality, many outside a manager's direct control. Younger health workers significantly outperformed older ones, and infants received better care than older children. Children with danger signs, those with more complex illnesses, and those with anemia received worse care. Health worker supervision was associated with improved performance for some outcomes. Conclusions: A variety of factors, some outside the direct control of program managers, can influence health worker practices. An understanding of these influences can help inform the development of strategies to improve performance. [ABSTRACT FROM AUTHOR]

Background: Correct treatment of potentially life-threatening illnesses (PLTIs) in children under 5 years, such as malaria, pneumonia, and diarrhea, can substantially reduce mortality. The Integrated Management of Childhood Illness (IMCI) strategy has been shown to improve treatment of child illnesses, but multiple studies have shown that gaps in health worker performance remain after training. To better understand factors related to health worker performance, we analyzed 9,330 patient consultations in Benin from 2001–2002, after training one of the first cohorts of 32 health workers in IMCI. Methods: With data abstracted from patient registers specially designed for IMCI-trained health workers, we examined associations between health facility-, health worker-, and patient-level factors and 10 case-management outcomes for PLTIs. Results: Altogether, 63.6 % of children received treatment for all their PLTIs in accordance with IMCI guidelines, and 77.8 % received life-saving treatment (i.e., clinically effective treatment, even if not exactly in accordance with IMCI guidelines). Performance of individual health workers varied greatly, from 15–88 % of patients treated correctly, on average. Multivariate regression analyses identified several factors that might have influenced case-management quality, many outside a manager’s direct control. Younger health workers significantly outperformed older ones, and infants received better care than older children. Children with danger signs, those with more complex illnesses, and those with anemia received worse care. Health worker supervision was associated with improved performance for some outcomes. Conclusions: A variety of factors, some outside the direct control of program managers, can influence health worker practices. An understanding of these influences can help inform the development of strategies to improve performance. [ABSTRACT FROM AUTHOR]

Background The lack of high quality timely data for evidence-informed decision making at the district level presents a challenge to improving maternal and newborn survival in low income settings. To address this problem, the EQUIP project (Expanded Quality Management using Information Power) implemented a continuous household and health facility survey for continuous feedback of data in two districts each in Tanzania and Uganda as part of a quality improvement innovation for mothers and newborns. Methods Within EQUIP, continuous survey data were used for quality improvement (intervention districts) and for effect evaluation (intervention and comparison districts). Over 30 months of intervention (November 2011 to April 2014), EQUIP conducted continuous cross-sectional household and health facility surveys using 24 independent probability samples of household clusters to represent each district each month, and repeat censuses of all government health facilities. Using repeat samples in this way allowed data to be aggregated at six four-monthly intervals to track progress over time for evaluation, and for continuous feedback to quality improvement teams in intervention districts. In both countries, one continuous survey team of eight people was employed to complete approximately 7,200 household and 200 facility interviews in year one. Data were collected using personal digital assistants. After every four months, routine tabulations of indicators were produced and synthesized to report cards for use by the quality improvement teams. Results The first 12 months were implemented as planned. Completion of household interviews was 96% in Tanzania and 91% in Uganda. Indicators across the continuum of care were tabulated every four months, results discussed by quality improvement teams, and report cards generated to support their work. Conclusions The EQUIP continuous surveys were feasible to implement as a method to continuously generate and report on demand and supply side indicators for maternal and newborn health; they have potential to be expanded to include other health topics. Documenting the design and implementation of a continuous data collection and feedback mechanism for prospective description, quality improvement, and evaluation in a low-income setting potentially represents a new paradigm that places equal weight on data systems for course correction, as well as evaluation. [ABSTRACT FROM AUTHOR]

The article presents a study which examines the use of mobile phone text messaging to remind health workers to adhere to pediatric malaria treatment guidelines in Kenya. It assesses the potential of text messaging reminders in the improvement and maintenance of health workers' adherence to treatment guidelines. It shows that text-messaging reminders improved artemether-lumefantrine management by 23.7% percentage points after intervention and 24.5 percentage points after six months.

Objective To assess the validity of health facility (HF)-based data on bednet and insecticide-treated bednet possession and use by children <5 years old. Methods We compared estimates based on data collected via HF surveys of under-5s attending well-child visits (e.g. immunizations) and sick-child visits vs. representative household surveys (a ‘gold standard’ method for measuring insecticide-treated net coverage). In Lindi region, Tanzania, we collected contemporaneous data on 637 under-5s via a HF survey (444 well-child visits and 193 sick-child visits), and on 305 households with an under-5 (including 354 children) via a household survey. In Rufiji district, Tanzania, we collected contemporaneous data on 1433 under-5s via a HF survey (911 well-child visits and 522 sick-child visits), and on 328 households with an under-5 (including 455 children) via a household survey. Results Possession of bednets by households with an under-5 was similar using HF data and household data in both Lindi region and Rufiji district. However, reported use of bednets was significantly higher in HF data than household data in both Lindi and Rufiji, as was reported use of insecticide-treated bednets. HF-based data accurately estimated community-level bednet possession in households with an under-5, but overestimated community-level bednet use by 9–35% and insecticide-treated bednet use by 15–21%. Conclusions Information bias rather than selection bias appears to be a key cause for the overestimation of bednet and insecticide-treated bednet use (e.g. social desirability bias: caretakers of under-5s attending health facilities might be more likely to report using bednets and insecticide-treated bednets). Additional studies of the validity, cost and utility of HF-based data to monitor insecticide-treated bednet use are needed before recommending this monitoring strategy for widespread use. Overestimating insecticide-treated bednet use could lead to inappropriate public health actions and missed opportunities for achieving local and global public health goals. [ABSTRACT FROM AUTHOR]

The article discusses ways in which community health workers can help reach the United Nations' Millennium Development Goals for world health child survival. Case management of childhood illness, preventive care, promotion of healthy behavior and community activism are all essential to child survival promotion. Community health workers require adequate pay, good training and specific tasks and goals. Community health programs must be evaluated for effectiveness and impact on child survival. The article presents a demographic assessment of community health workers and discusses what their role in specific interventions should be.

Summary Background Valid information about cause-specific child mortality and morbidity is an essential foundation for national and international health policy. We undertook a systematic review to investigate the geographical dispersion of and time trends in publication for policy-relevant information about children's health and to assess associations between the availability of reliable data and poverty. Methods We identified data available on Jan 1, 2001, and published since 1980, for the major causes of morbidity and mortality in young children. Studies with relevant data were assessed against a set of inclusion criteria to identify those likely to provide unbiased estimates of the burden of childhood disease in the community. Findings Only 308 information units from more than 17 000 papers identified were regarded as possible unbiased sources for estimates of childhood disease burden. The geographical distribution of these information units revealed a pattern of small well-researched populations surrounded by large areas with little available information. No reliable population-based data were identified from many of the world's poorest countries, which account for about a third of all deaths of children worldwide. The number of new studies diminished over the last 10 years investigated. Interpretation The number of population-based studies yielding estimates of burden of childhood disease from less developed countries was low. The decreasing trend over time suggests reductions in research investment in this sphere. Data are especially sparse from the world's least developed countries with the highest child mortality. Guidelines are needed for the conduct of burden-of-disease studies together with an international research policy that gives increased emphasis to global equity and coverage so that knowledge can be generated from all regions of the world. [ABSTRACT FROM AUTHOR]

Problem/Condition: Malaria is caused by any of four species of intraerythrocytic protozoa of the genus Plasmodium (i.e., P. falciparum, P. vivax, P. ovale, or P. malariae). These parasites are transmitted by the bite of an infective female Anopheles species mosquito. The majority of malaria infections in the United States occur among persons who have traveled to areas with ongoing transmission. In the United States, cases can occur through exposure to infected blood products, by congenital transmission, or by local mosquitoborne transmission. Malaria surveillance is conducted to identify episodes of local transmission and to guide prevention recommendations for travelers. Period Covered: This report covers cases with onset of illness in 2002. Description of System: Malaria cases confirmed by blood film are reported to local and state health departments by healthcare providers or laboratory staff. Case investigations are conducted by local and state health departments, and reports are transmitted to CDC through the National Malaria Surveillance System (NMSS). Data from NMSS serve as the basis for this report. Results: CDC received reports of 1,337 cases of malaria with an onset of symptoms in 2002 among persons in the United States or one of its territories. This number represents a decrease of 3.3% from the 1,383 cases reported for 2001. P. falciparum, P. vivax, P. malariae, and P. ovale were identified in 52.3%, 25.4%, 2.8%, and 2.8% of cases, respectively. Eleven patients (0.8% of total) were infected by >2 species. The infecting species was unreported or undetermined in 213 (15.9%) cases. Compared with 2001, the number of reported malaria cases acquired in Asia (n = 171) and Africa (n = 903) increased by 4.3% and 1.9%, respectively, whereas the number of cases acquired in the Americas (n = 141) decreased by 41.2%. Of 849 U.S. civilians who acquired malaria abroad, 317 (37.3%) reported that they had followed a chemoprophylactic drug regimen recommended by... [ABSTRACT FROM AUTHOR]

Objectives. To characterize community health worker (CHW) performance using an algorithm for managing common childhood illnesses in Siaya District, Kenya, we conducted CHW evaluations in 1998, 1999, and 2001. Methods. Randomly selected CHWs were observed managing sick outpatient and inpatient children at a hospital, and their management was compared with that of an expert clinician who used the algorithm. Results. One hundred, 108, and 114 CHWs participated in the evaluations in 1998,1999, and 2001, respectively. The proportions of children treated "adequately" (with an antibiotic, antimalarial, oral rehydration solution, or referral, depending on the child's disease classifications) were 57.8%, 35.5%, and 38.9%, respectively, for children with a severe classification and 27.7%, 77.3%, and 74.3%, respectively, for children with a moderate (but not severe) classification. CHWs adequately treated 90.5% of malaria cases (the most commonly encountered classification). CHWs often made mistakes assessing symptoms, classifying illnesses, and prescribing correct doses of medications. Conclusions. Deficiencies were found in the management of sick children by CHWs, although care was not consistently poor. Key reasons for the deficiencies appear to be guideline complexity and inadequate clinical supervision; other possible causes are discussed. (Am J Public Health. 2001;91: 1617-1624) [ABSTRACT FROM AUTHOR]

Background: Correct treatment of potentially life-threatening illnesses (PLTIs) in children under 5 years, such as malaria, pneumonia, and diarrhea, can substantially reduce mortality. The Integrated Management of Childhood Illness (IMCI) strategy has been shown to improve treatment of child illnesses, but multiple studies have shown that gaps in health worker performance remain after training. To better understand factors related to health worker performance, we analyzed 9,330 patient consultations in Benin from 2001-2002, after training one of the first cohorts of 32 health workers in IMCI.Methods: With data abstracted from patient registers specially designed for IMCI-trained health workers, we examined associations between health facility-, health worker-, and patient-level factors and 10 case-management outcomes for PLTIs.Results: Altogether, 63.6% of children received treatment for all their PLTIs in accordance with IMCI guidelines, and 77.8% received life-saving treatment (i.e., clinically effective treatment, even if not exactly in accordance with IMCI guidelines). Performance of individual health workers varied greatly, from 15-88% of patients treated correctly, on average. Multivariate regression analyses identified several factors that might have influenced case-management quality, many outside a manager's direct control. Younger health workers significantly outperformed older ones, and infants received better care than older children. Children with danger signs, those with more complex illnesses, and those with anemia received worse care. Health worker supervision was associated with improved performance for some outcomes.Conclusions: A variety of factors, some outside the direct control of program managers, can influence health worker practices. An understanding of these influences can help inform the development of strategies to improve performance. [ABSTRACT FROM AUTHOR]

Background: The lack of high quality timely data for evidence-informed decision making at the district level presents a challenge to improving maternal and newborn survival in low income settings. To address this problem, the EQUIP project (Expanded Quality Management using Information Power) implemented a continuous household and health facility survey for continuous feedback of data in two districts each in Tanzania and Uganda as part of a quality improvement innovation for mothers and newborns.Methods: Within EQUIP, continuous survey data were used for quality improvement (intervention districts) and for effect evaluation (intervention and comparison districts). Over 30 months of intervention (November 2011 to April 2014), EQUIP conducted continuous cross-sectional household and health facility surveys using 24 independent probability samples of household clusters to represent each district each month, and repeat censuses of all government health facilities. Using repeat samples in this way allowed data to be aggregated at six four-monthly intervals to track progress over time for evaluation, and for continuous feedback to quality improvement teams in intervention districts.In both countries, one continuous survey team of eight people was employed to complete approximately 7,200 household and 200 facility interviews in year one. Data were collected using personal digital assistants. After every four months, routine tabulations of indicators were produced and synthesized to report cards for use by the quality improvement teams.Results: The first 12 months were implemented as planned. Completion of household interviews was 96% in Tanzania and 91% in Uganda. Indicators across the continuum of care were tabulated every four months, results discussed by quality improvement teams, and report cards generated to support their work.Conclusions: The EQUIP continuous surveys were feasible to implement as a method to continuously generate and report on demand and supply side indicators for maternal and newborn health; they have potential to be expanded to include other health topics. Documenting the design and implementation of a continuous data collection and feedback mechanism for prospective description, quality improvement, and evaluation in a low-income setting potentially represents a new paradigm that places equal weight on data systems for course correction, as well as evaluation. [ABSTRACT FROM AUTHOR]