Search

Objective: It is unknown whether computer-generated, patient-tailored feedback leads to improvements in glycemic control in people with type 2 diabetes.Research Design and Methods: We recruited people with type 2 diabetes aged ≥ 40 years with a glycated hemoglobin (A1C) ≥ 7%, living in Hamilton, Canada, who were enrolled in a community-based program (Diabetes Hamilton) that provided regular evidence-based information and listings of community resources designed to facilitate diabetes self-management. After completing a questionnaire, participants were randomly allocated to either receive or not receive periodic computer-generated, evidence-based feedback on the basis of their questionnaire responses and designed to facilitate improved glycemic control and diabetes self-management. The primary outcome was a change in A1C after 1 year.Results: A total of 465 participants (50% women, mean age 62 years, and mean A1C 7.83%) were randomly assigned, and 12-month A1C values were available in 96% of all participants, at which time the A1C level had decreased by an absolute amount of 0.24 and 0.15% in the intervention and control groups, respectively. The difference in A1C reduction for the intervention versus control group was 0.09% (95% CI -0.08 to 0.26; P = 0.3). No between-group differences in measures of quality of life, diabetes self-management behaviors, or clinical outcomes were observed.Conclusions: Providing computer-generated tailored feedback to registrants of a generic, community-based program that supports diabetes self-management does not lead to lower A1C levels or a better quality of life than participation in the community-based program (augmented by periodic A1C testing) alone. [ABSTRACT FROM AUTHOR]

The growing numbers of topically relevant biomedical publications readily available due to advances in document retrieval methods pose a challenge to clinicians practicing evidence-based medicine. It is increasingly time consuming to acquire and critically appraise the available evidence. This problem could be addressed in part if methods were available to automatically recognize rigorous studies immediately applicable in a specific clinical situation. We approach the problem of recognizing studies containing useable clinical advice from retrieved topically relevant articles as a binary classification problem. The gold standard used in the development of PubMed clinical query filters forms the basis of our approach. We identify scientifically rigorous studies using supervised machine learning techniques (Naïve Bayes, support vector machine (SVM), and boosting) trained on high-level semantic features. We combine these methods using an ensemble learning method (stacking). The performance of learning methods is evaluated using precision, recall and F(1) score, in addition to area under the receiver operating characteristic (ROC) curve (AUC). Using a training set of 10,000 manually annotated MEDLINE citations, and a test set of an additional 2,000 citations, we achieve 73.7% precision and 61.5% recall in identifying rigorous, clinically relevant studies, with stacking over five feature-classifier combinations and 82.5% precision and 84.3% recall in recognizing rigorous studies with treatment focus using stacking over word + metadata feature vector. Our results demonstrate that a high quality gold standard and advanced classification methods can help clinicians acquire best evidence from the medical literature. [ABSTRACT FROM AUTHOR]

BACKGROUND: Physicians have difficulty keeping up with new evidence from medical research. METHODS: We developed the McMaster Premium LiteratUre Service (PLUS), an internet-based addition to an existing digital library, which delivered quality- and relevance-rated medical literature to physicians, matched to their clinical disciplines. We evaluated PLUS in a cluster-randomized trial of 203 participating physicians in Northern Ontario, comparing a Full-Serve version (that included alerts to new articles and a cumulative database of alerts) with a Self-Serve version (that included a passive guide to evidence-based literature). Utilization of the service was the primary trial end-point. RESULTS: Mean logins to the library rose by 0.77 logins/month/user (95% CI 0.43, 1.11) in the Full-Serve group compared with the Self-Serve group. The proportion of Full-Serve participants who utilized the service during each month of the study period showed a sustained increase during the intervention period, with a relative increase of 57% (95% CI 12, 123) compared with the Self-Serve group. There were no differences in these proportions during the baseline period, and following the crossover of the Self-Serve group to Full-Serve, the Self-Serve group's usage became indistinguishable from that of the Full-Serve group (relative difference 4.4 (95% CI -23.7, 43.0). Also during the intervention and crossover periods, measures of self-reported usefulness did not show a difference between the 2 groups. CONCLUSION: A quality- and relevance-rated online literature service increased the utilization of evidence-based information from a digital library by practicing physicians. [ABSTRACT FROM AUTHOR]

Objective: The ability to accurately identify articles about therapy in large bibliographic databases such as EMBASE is important for researchers and clinicians. Our study aimed to develop optimal search strategies for detecting sound treatment studies in EMBASE in the year 2000. Methods: Hand searches of journals were compared with retrievals from EMBASE for candidate search strategies. Six trained research assistants reviewed fifty-five journals indexed in EMBASE and rated articles using purpose and quality indicators. Candidate search strategies were developed for identifying treatment articles and then tested, and the retrievals were compared with the hand-search data. The operating characteristics of the strategies were calculated. Results: Three thousand eight hundred fifty articles were original studies on treatment, of which 1,256 (32.6%) were methodologically sound. Combining search terms revealed a top performing strategy (random:.tw. OR clinical trial:.mp. OR exp health care quality) with sensitivity of 98.9% and specificity of 72.0%. Maximizing specificity, a top performing strategy (double-blind:.mp. OR placebo:.tw. OR blind: .tw.) achieved a value over 96.0%, but with compromised sensitivity at 51.7%. A 3-term strategy achieved the best optimization of sensitivity and specificity (random:.tw. OR placebo:.mp. OR double-blind:.tw.), with both these values over 92.0%. Conclusion: Search strategies can achieve high performance for retrieving sound treatment studies in EMBASE. [ABSTRACT FROM AUTHOR]

BACKGROUND: Clinical end users of EMBASE have a difficult time retrieving articles that are both scientifically sound and directly relevant to clinical practice. Search filters have been developed to assist end users in increasing the success of their searches. Many filters have been developed for the literature on therapy and reviews for use in MEDLINE, but little has been done for use in EMBASE with no filter development for studies of prognosis. The objective of this study was to determine how well various methodologic textwords, index terms, and their Boolean combinations retrieve methodologically sound literature on the prognosis of health disorders in EMBASE. METHODS: An analytic survey was conducted, comparing hand searches of 55 journals with retrievals from EMBASE for 4,843 candidate search terms and 8,919 combinations. All articles were rated using purpose and quality indicators, and clinically relevant prognostic articles were categorized as 'pass' or 'fail' according to explicit criteria for scientific merit. Candidate search strategies were run in EMBASE, the retrievals being compared with the hand search data. The sensitivity, specificity, precision, and accuracy of the search strategies were calculated. RESULTS: Of the 1,064 articles about prognosis, 148 (13.9%) met basic criteria for scientific merit. Combinations of search terms reached peak sensitivities of 98.7% with specificity at 50.6%. Compared with best single terms, best multiple terms increased sensitivity for sound studies by 12.2% (absolute increase), while decreasing specificity (absolute decrease 5.1%) when sensitivity was maximized. Combinations of search terms reached peak specificities of 93.4% with sensitivity at 50.7%. Compared with best single terms, best multiple terms increased specificity for sound studies by 7.1% (absolute increase), while decreasing sensitivity (absolute decrease 8.8%) when specificity was maximized. CONCLUSION: Empirically derived search strategies combining indexing terms and textwords can achieve high sensitivity or specificity for retrieving sound prognostic studies from EMBASE. [ABSTRACT FROM AUTHOR]

This series provides clinicians with strategies and tools to interpret and integrate evidence from published research in their care of patients. The 2 key principles for applying all the articles in this series to patient care relate to the value-laden nature of clinical decisions and to the hierarchy of evidence postulated by evidence-based medicine. Clinicians need to be able to distinguish high from low quality in primary studies, systematic reviews, practice guidelines, and other integrative research focused on management recommendations. An evidence-based practitioner must also understand the patient's circumstances or predicament; identify knowledge gaps and frame questions to fill those gaps; conduct an efficient literature search; critically appraise the research evidence; and apply that evidence to patient care. However, treatment judgments often reflect clinician or societal values concerning whether intervention benefits are worth the cost. Many unanswered questions concerning how to elicit preferences and how to incorporate them in clinical encounters constitute an enormously challenging frontier for evidence-based medicine. Time limitation remains the biggest obstacle to evidence-based practice but clinicians should seek evidence from as high in the appropriate hierarchy of evidence as possible, and every clinical decision should be geared toward the particular circumstances of the patient. [ABSTRACT FROM AUTHOR]

Background: Elevated blood homocysteine is a risk factor for cardiovascular disease. A 5-Rmol/L increase is associated with an approximately 70% increase in relative risk of cardiovascular disease in adults. For patients with established risk factors, this risk is likely even greater. Objective: Effects of increased dietary folate and recommended intakes of vitamins B-12 and B-6 on serum total homocysteine (tHcy) were assessed in individuals at high risk of cardiovascular disease. Design: This trial was conducted at 10 medical research centers in the United States and Canada and included 491 adults with hypertension, dyslipidemia, type 2 diabetes, or a combination thereof. Participants were randomly assigned to follow a prepared meal plan (PMP; n = 244) or a self-selected diet (SSD; ii = 247) for 10 wk, which were matched for macronutrient content. The PMP was fortified to provide >/= 100% of the recommended dietary allowances for 23 micronutrients, including folate. Results: Mean folate intakes at 10 wk were 601 +/= 143 mu g/d with the PMP and 270 +/= 107 mu g/d with the SSD. With the PMP, serum tHcy concentrations fell from 10.8 +/= 5.8 to 9.3 +/= 4.9 mu mol/L (P < 0.0001) between weeks 0 and 10 and the change was associated with increased intakes of folate, vitamin B-12, and vitamin B-6 and with increased serum and red blood cell folate and serum vitamin B-12 concentrations. tHcy concentrations did not change significantly with the SSD. Conclusions: The PMP resulted in increased intakes and serum concentrations of folate and vitamin B-12. These changes were associated with reduced serum tHcy concentrations in persons at high risk of cardiovascular disease. Copyright (c) 1999 American Society for Clinical Nutrition [ABSTRACT FROM AUTHOR]

Context: Many computer software developers and vendors claim that their systems can directly improve clinical decisions. As for other health care interventions, such claims should be based on careful trials that assess their effects on clinical performance and, preferably, patient outcomes.Objective: To systematically review controlled clinical trials assessing the effects of computer-based clinical decision support systems (CDSSs) on physician performance and patient outcomes.Data Sources: We updated earlier reviews covering 1974 to 1992 by searching the MEDLINE, EMBASE, INSPEC, SCISEARCH, and the Cochrane Library bibliographic databases from 1992 to March 1998. Reference lists and conference proceedings were reviewed and evaluators of CDSSs were contacted.Study Selection: Studies were included if they involved the use of a CDSS in a clinical setting by a health care practitioner and assessed the effects of the system prospectively with a concurrent control.Data Extraction: The validity of each relevant study (scored from 0-10) was evaluated in duplicate. Data on setting, subjects, computer systems, and outcomes were abstracted and a power analysis was done on studies with negative findings.Data Synthesis: A total of 68 controlled trials met our criteria, 40 of which were published since 1992. Quality scores ranged from 2 to 10, with more recent trials rating higher (mean, 7.7) than earlier studies (mean, 6.4) (P<.001). Effects on physician performance were assessed in 65 studies and 43 found a benefit (66%). These included 9 of 15 studies on drug dosing systems, 1 of 5 studies on diagnostic aids, 14 of 19 preventive care systems, and 19 of 26 studies evaluating CDSSs for other medical care. Six of 14 studies assessing patient outcomes found a benefit. Of the remaining 8 studies, only 3 had a power of greater than 80% to detect a clinically important effect.Conclusions: Published studies of CDSSs are increasing rapidly, and their quality is improving. The CDSSs can enhance clinical performance for drug dosing, preventive care, and other aspects of medical care, but not convincingly for diagnosis. The effects of CDSSs on patient outcomes have been insufficiently studied. [ABSTRACT FROM AUTHOR]

Background: Low adherence of patients to prescribed, self-administered medical interventions is ubiquitous. Low adherence limits the benefits of current medical care. Efforts to assist patients to follow treatments might improve the efficiency of care and substantially enhance benefits. Our objective was to summarise the results of randomised controlled trials (RCTs) of interventions to help patients follow prescriptions for medications.Methods: A previous systematic review was updated through computerised searches in Medline, International Pharmaceutical Abstracts, Psychinfo, and HSTAR online databases; bibliographies in articles on patient adherence; articles in the reviewers' personal collections; and contact with authors. Articles were judged of interest if they reported original data concerning an unconfounded RCT of an intervention to improve adherence with prescribed medications, with one or more measure of medication adherence, one or more measure of treatment outcome, at least 80% follow-up of each group studied, and, for long-term treatments, at least 6 months of follow-up for studies with positive initial findings. Information on study design features, interventions and controls, and findings were extracted by one reviewer (RK) and checked by the other two reviewers.Findings: 1,553 relevant citations and abstracts were screened, 252 full text articles were reviewed in detail, and 13 RCTs met all criteria. The studies were too disparate in clinical problems, adherence interventions, measures and reporting of adherence, and the clinical outcomes studied to warrant meta-analysis. Seven of 15 interventions were associated with improvements in adherence and six interventions led to improvements in treatment outcomes. For short-term treatments, one study showed an effect on adherence and outcome of counselling and written information. The interventions that were effective for long-term care were complex, including various combinations of more convenient care, information, counselling, reminders, self-monitoring, reinforcement, family therapy, and other forms of additional supervision or attention. Even the most effective interventions did not lead to substantial improvements in adherence.Interpretation: Although adherence and treatment outcomes can be improved by certain-usually complex-interventions, full benefits of medications cannot be realised at currently achievable levels of adherence. It is time that additional efforts be directed towards developing and testing innovative approaches to assist patients to follow treatment prescriptions. [ABSTRACT FROM AUTHOR]

Study Objective: We introduced self-service access to the medical literature database, MEDLINE, into clinical settings to assess the frequency, patterns, purposes, and success of use.Design: Longitudinal descriptive study.Setting: Inpatient and outpatient services of a university medical center.Participants: All trainees and attending staff working at the service sites were invited to participate; 158 (84%) did so.Interventions: Free online access was provided to MEDLINE through GRATEFUL MED software. Participants were offered a 2-hour introduction to online searching and 2 hours of free search time.Measurements and Main Results: For each search, a computer program requested identification of the user and the question to be addressed. Search transactions were recorded automatically. Interviews were conducted after a random sample of searches, and search questions were given to more expert searchers to run for comparison with the original. Eighty-one percent of participants did searches on study computers, at a mean rate of 2.7 searches per month. On comparison searches, participants retrieved 55% of the number of relevant articles retrieved by reference librarians (P = 0.024) and 50% more irrelevant articles (P less than 0.001). Forty-seven percent of searches on patient problems affected clinical decisions, but often on scanty information.Conclusions: MEDLINE searching from clinical settings is feasible with brief training and affects clinical decisions. However, inexperienced searchers miss many relevant citations and search inefficiently. Further studies are needed to assess the impact of searching on physician performance and patient care. [ABSTRACT FROM AUTHOR]

Research is producing increasing amounts of important new evidence for health care, but there is a large gap between what this evidence shows can be done and the care that most patients actually receive. An important reason for this gap is the extensive processing that evidence requires before application. This article discusses a three-step model for bridging research evidence to management of clinical problems: getting the evidence straight, formulating evidence-based clinical policies, and applying evidence-based clinical policies at the right place and time. This model is purposely broad in scope and provides a framework for coordinating efforts to support evidence-based medical care. The authors' purpose is to represent the roles of health informatics in the context of the roles of all the key players, including health care researchers and practitioners, health care organizations, and the public. Health informatics has already made important contributions to bridging evidence to practice, including improving evidence retrieval, evaluation, and synthesis; new evidence-based information products; and computerized aids for facilitating the use of these products during clinical decision making. However, much more innovation and coordination are needed. The authors call for health informaticians to pay balanced attention to 1) the quality of evidence embodied in information innovations, 2) the performance of technologies and systems that retrieve, prepare, disseminate, and apply evidence, and 3) the fit of information tools to the specific clinical circumstances in which evidence is to be applied. Effective interdisciplinary teams that include health services researchers and other evidence experts, clinical practitioners, informaticians, and health care managers are needed to achieve success. Informaticians can make increasingly important contributions to the transfer of health care research by joining such teams. [ABSTRACT FROM AUTHOR]

Objective: To compare the performances of online and compact-disc (CD-ROM) versions of the National Library of Medicine's (NLM) MEDLINE database.Design: Analytic survey.Intervention: Clinical questions were drawn from 18 searches originally conducted spontaneously by clinicians from wards and clinics who had used Grateful Med Version 4.0. Clinicians' search strategies were translated to meet the specific requirements of 13 online and 14 CD-ROM MEDLINE systems. A senior librarian and vendors' representatives constructed independent searches from the clinicians' questions. The librarian and clinician searches were run through each system, in command mode for the librarian and menu mode for clinicians, when available. Vendor searches were run through the vendors' own systems only.Main Measurements: Numbers of relevant and irrelevant citations retrieved, cost (for online systems only), and time.Results: Systems varied substantially for all searches, and for librarian and clinician searches separately, with respect to the numbers of relevant and irrelevant citations retrieved (p < 0.001 for both) and the cost per relevant citation (p = 0.012), but not with respect to the time per search. Based on combined rankings for the highest number of relevant and the lowest number of irrelevant citations retrieved, the SilverPlatter CD-ROM MEDLINE clinical journal subset performed best for librarian searches, while the PaperChase online system worked best for clinician searches. For cost per relevant citation retrieved, Dialog's Knowledge Index performed best for both librarian and clinician searches.Conclusions: There were substantial differences in the performances of competing MEDLINE systems, and performance was affected by search strategy, which was conceived by a librarian or by clinicians. [ABSTRACT FROM AUTHOR]

Objective: To review the literature relating to the effectiveness of education strategies designed to change physician performance and health care outcomes.Data Sources: We searched MEDLINE, ERIC, NTIS, the Research and Development Resource Base in Continuing Medical Education, and other relevant data sources from 1975 to 1994, using continuing medical education (CME) and related terms as keywords. We manually searched journals and the bibliographies of other review articles and called on the opinions of recognized experts.Study Selection: We reviewed studies that met the following criteria: randomized controlled trials of education strategies or interventions that objectively assessed physician performance and/or health care outcomes. These intervention strategies included (alone and in combination) educational materials, formal CME activities, outreach visits such as academic detailing, opinion leaders, patient-mediated strategies, audit with feedback, and reminders. Studies were selected only if more than 50% of the subjects were either practicing physicians or medical residents.Data Extraction: We extracted the specialty of the physicians targeted by the interventions and the clinical domain and setting of the trial. We also determined the details of the educational intervention, the extent to which needs or barriers to change had been ascertained prior to the intervention, and the main outcome measure(s).Data Synthesis: We found 99 trials, containing 160 interventions, that met our criteria. Almost two thirds of the interventions (101 of 160) displayed an improvement in at least one major outcome measure: 70% demonstrated a change in physician performance, and 48% of interventions aimed at health care outcomes produced a positive change. Effective change strategies included reminders, patient-mediated interventions, outreach visits, opinion leaders, and multifaceted activities. Audit with feedback and educational materials were less effective, and formal CME conferences or activities, without enabling or practice-reinforcing strategies, had relatively little impact.Conclusion: Widely used CME delivery methods such as conferences have little direct impact on improving professional practice. More effective methods such as systematic practice-based interventions and outreach visits are seldom used by CME providers. [ABSTRACT FROM AUTHOR]