Search

BackgroundMen considering the prostate specific antigen (PSA) test for prostate cancer, an increasingly common male cancer, are encouraged to make informed decisions, as the test is limited in its accuracy and the natural history of the condition is poorly understood. The Web-based PSA decision aid, Prosdex, was developed as part of the UK Prostate Cancer Risk Management Programme in order to help men make such informed decisions. ObjectivesThe aim of this study was to evaluate the effect of the Web-based PSA decision aid, Prosdex, on informed decision making. MethodsA Web-based randomized controlled trial was conducted in South Wales, United Kingdom. Men aged 50 to 75 who had not previously had a PSA test were randomly allocated to two intervention and two control groups. Participants in the intervention groups either viewed Prosdex or were given a paper version of the text. The main outcome measures were the three components of informed decision making: (1) knowledge of prostate cancer and PSA, (2) attitude toward PSA testing, (3) behavior using a proxy measure, intention to undergo PSA testing. Decisional conflict and anxiety were also measured as was uptake of the PSA test. Outcomes were measured by means of an online questionnaire for the Prosdex group, the paper version group, and one of two control groups. Six months later, PSA test uptake was ascertained from general practitioners’ records, and the online questionnaire was repeated. Results are reported in terms of the Mann-Whitney U-statistic divided by the product of the two sample sizes (U/mm), line of no effect 0.50. ResultsParticipants were 514 men. Compared with the control group that completed the initial online questionnaire, men in the Prosdex group had increased knowledge about the PSA test and prostate cancer (U/mn 0.70; 95% CI 0.62 - 0.76); less favourable attitudes to PSA testing (U/mn 0.39, 95% CI 0.31 - 0.47); were less likely to undergo PSA testing (U/mn 0.40, 95% CI 0.32 - 0.48); and had less decisional conflict (U/mn 0.32, 95% CI 0.25 - 0.40); while anxiety level did not differ (U/mn 0.50, 95% CI 0.42 - 0.58). For these outcomes there were no significant differences between men in the Prosdex group and the paper version group. However, in the Prosdex group, increased knowledge was associated with a less favourable attitude toward testing (Spearman rank correlation [ρ] = -0.49, P < .001) and lower intention to undergo testing (ρ = -0.27, P = .02). After six months, PSA test uptake was lower in the Prosdex group than in the paper version and the questionnaire control group (P = .014). Test uptake was also lower in the control group that did not complete a questionnaire than in the control group that did, suggesting a possible Hawthorne effect of the questionnaire in favour of PSA testing. ConclusionsExposure to Prosdex was associated with improved knowledge about the PSA test and prostate cancer. Men who had a high level of knowledge had a less favourable attitude toward and were less likely to undergo PSA testing. Prosdex appears to promote informed decision making regarding the PSA test. Trial RegistrationISRCTN48473735; http://www.controlled-trials.com/ISRCTN48473735 (Archived by WebCite at http://www.webcitation.org/5r1TLQ5nK)

BackgroundWeb-based decision aids are known to have an effect on knowledge, attitude, and behavior; important components of informed decision making. We know what decision aids achieve in randomized controlled trials (RCTs), but we still know very little about how they are used and how this relates to the informed decision making outcome measures. ObjectiveTo examine men's use of an online decision aid for prostate cancer screening using website transaction log files (web-logs), and to examine associations between usage and components of informed decision making. MethodsWe conducted an observational web-log analysis of users of an online decision aid, Prosdex. Men between 50 and 75 years of age were recruited for an associated RCT from 26 general practices across South Wales, United Kingdom. Men allocated to one arm of the RCT were included in the current study. Time and usage data were derived from website log files. Components of informed decision making were measured by an online questionnaire. ResultsAvailable for analysis were 82 web-logs. Overall, there was large variation in the use of Prosdex. The mean total time spent on the site was 20 minutes. The mean number of pages accessed was 32 (SD 21) out of a possible 60 pages. Significant associations were found between increased usage and increased knowledge (Spearman rank correlation [ρ] = 0.69, P < .01), between increased usage and less favorable attitude towards PSA testing (ρ = -0.52, P < .01), and between increased usage and reduced intention to undergo PSA testing (ρ = -0.44, P < .01). A bimodal distribution identified two types of user: low access and high access users. ConclusionsIncreased usage of Prosdex leads to more informed decision making, the key aim of the UK Prostate Cancer Risk Management Programme. However, developers realistically have roughly 20 minutes to provide useful information that will support informed decision making when the patient uses a web-based interface. Future decision aids need to be developed with this limitation in mind. We recommend that web-log analysis should be an integral part of online decision aid development and analysis. Trial RegistrationISRCTN48473735; http://www.controlled-trials.com/ISRCTN48473735 (Archived by WebCite at http://www.webcitation.org/5pqeF89tS)

Background Field-testing is a quality assurance criterion in the development of patient decision-support technologies (PDSTs), as identified in the consensus statement of the International Patient Decision Aids Standards Collaboration. We incorporated field-testing into the development of a Web-based, prostate-specific antigen PDST called Prosdex, which was commissioned as part of the UK Prostate Cancer Risk Management Programme. Objectives The aim of this study was to develop a model for the future field-testing of PDSTs, based on the field-testing of Prosdex. Our objectives were (1) to explore the reactions of men to evolving prototypes of Prosdex, (2) to assess the effect of these responses on the development process, and (3) to develop a model for field-testing PDSTs based on the responses and their effect on the development process. Methods Semistructured interviews were conducted with the men after they had viewed evolving prototypes of Prosdex in their homes. The men were grouped according to the prototype viewed. Men between 40 and 75 years of age were recruited from two family practices in different parts of Wales, United Kingdom. In the interviews, the men were asked for their views on Prosdex, both as a whole and in relation to specific sections such as the introduction and video clips. Comments and technical issues that arose during the viewings were noted and fed back to the developers in order to produce subsequent prototypes. Results A total of 27 men were interviewed, in five groups, according to the five prototypes of Prosdex that were developed. The two main themes from the interviews were the responses to the information provided in Prosdex and the responses to specific features of Prosdex. Within these themes, two of the most frequently encountered categories were detail of the information provided and balance between contrasting viewpoints. Criticisms were encountered, particularly with respect to navigation of the site. In addition, we found that participants made little use of the decision-making scale. The introduction of an interactive contents page to prototype 2 was the main change made to Prosdex as a result of the field-testing. Based on our findings, a model for the field-testing of PDSTs was developed, involving an exploratory field-testing stage between the planning stage and the development of the first prototype, and followed by the prototype field-testing stage, leading to the final PDST. Conclusions In the field-testing of Prosdex, a Web-based prostate-specific antigen PDST, the responses of interviewed men were generally favorable. As a consequence of the responses, an interactive contents page was added to the site. We developed a model for the future field-testing of PDSTs, involving two stages: exploratory field-testing and prototype field-testing.

AbstractBackgroundMulti-source feedback (MSF) offers doctors feedback on their performance from peers (medical colleagues), coworkers and patients. Researchers increasingly point to the fact that only a small majority of doctors (60–70 percent) benefit from MSF. Building on medical education and social psychology literature, the authors identified several factors that may influence change in response to MSF. Subsequently, they quantitatively studied the factors that advance the use of MSF for practice change.MethodsThis observational study was set in 26 non-academic hospitals in the Netherlands. In total, 458 specialists participated in the MSF program. Besides the collation of questionnaires, the Dutch MSF program is composed of a reflective portfolio and a facilitative interview aimed at increasing the acceptance and use of MSF. All specialists who finished a MSF procedure between May 2008 and September 2010 were invited to complete an evaluation form. The dependent variable was self-reported change. Three categories of independent variables (personal characteristics, experiences with the assessments and mean MSF ratings) were included in the analysis. Multivariate regression analysis techniques were used to identify the relation between the independent variables and specialists’ reported change in actual practice.ResultsIn total, 238 medical specialists (response rate 52 percent) returned an evaluation form and participated in the study. A small majority (55 percent) of specialists reported to have changed their professional performance in one or more aspects in response to MSF. Regression analyses revealed that two variables had the most effect on reported change. Perceived quality of mentoring positively influenced reported change (regression coefficient beta = 0.527, p

Abstract Background There is a global need to assess physicians' professional performance in actual clinical practice. Valid and reliable instruments are necessary to support these efforts. This study focuses on the reliability and validity, the influences of some sociodemographic biasing factors, associations between self and other evaluations, and the number of evaluations needed for reliable assessment of a physician based on the three instruments used for the multisource assessment of physicians' professional performance in the Netherlands. Methods This observational validation study of three instruments underlying multisource feedback (MSF) was set in 26 non-academic hospitals in the Netherlands. In total, 146 hospital-based physicians took part in the study. Each physician's professional performance was assessed by peers (physician colleagues), co-workers (including nurses, secretary assistants and other healthcare professionals) and patients. Physicians also completed a self-evaluation. Ratings of 864 peers, 894 co-workers and 1960 patients on MSF were available. We used principal components analysis and methods of classical test theory to evaluate the factor structure, reliability and validity of instruments. We used Pearson's correlation coefficient and linear mixed models to address other objectives. Results The peer, co-worker and patient instruments respectively had six factors, three factors and one factor with high internal consistencies (Cronbach's alpha 0.95 - 0.96). It appeared that only 2 percent of variance in the mean ratings could be attributed to biasing factors. Self-ratings were not correlated with peer, co-worker or patient ratings. However, ratings of peers, co-workers and patients were correlated. Five peer evaluations, five co-worker evaluations and 11 patient evaluations are required to achieve reliable results (reliability coefficient ≥ 0.70). Conclusions The study demonstrated that the three MSF instruments produced reliable and valid data for evaluating physicians' professional performance in the Netherlands. Scores from peers, co-workers and patients were not correlated with self-evaluations. Future research should examine improvement of performance when using MSF.