Search

Objectives To investigate the general population’s view on artificial intelligence (AI) in medicine with specific emphasis on 3 areas that have experienced major progress in AI research in the past few years, namely radiology, robotic surgery, and dermatology. Methods For this prospective study, the April 2020 Online Longitudinal Internet Studies for the Social Sciences Panel Wave was used. Of the 3117 Longitudinal Internet Studies For The Social Sciences panel members contacted, 2411 completed the full questionnaire (77.4% response rate), after combining data from earlier waves, the final sample size was 1909. A total of 3 scales focusing on trust in the implementation of AI in radiology, robotic surgery, and dermatology were used. Repeated-measures analysis of variance and multivariate analysis of variance was used for comparison. Results The overall means show that respondents have slightly more trust in AI in dermatology than in radiology and surgery. The means show that higher educated males, employed or student, of Western background, and those not admitted to a hospital in the past 12 months have more trust in AI. The trust in AI in radiology, robotic surgery, and dermatology is positively associated with belief in the efficiency of AI and these specific domains were negatively associated with distrust and accountability in AI in general. Conclusions The general population is more distrustful of AI in medicine unlike the overall optimistic views posed in the media. The level of trust is dependent on what medical area is subject to scrutiny. Certain demographic characteristics and individuals with a generally positive view on AI and its efficiency are significantly associated with higher levels of trust in AI.

Purpose To evaluate the Dutch integrated nuclear medicine and radiology residency program from the perspective of nuclear medicine physicians and radiologists. Methods A survey was distributed among nuclear medicine physicians and radiologists in hospitals that participate in the Dutch integrated nuclear medicine and radiology training program. Results A total of 139 completed questionnaires were included. Nuclear medicine physicians (n = 36) assigned a mean score of 5.7 ± 2.0, and radiologists (n = 103) assigned a mean score of 6.5 ± 2.8 (on a 1–10 scale) to the success of the integrated training program in their hospital. On multiple regression, female gender of the survey participant (B = 2.22, P = 0.034), musculoskeletal radiology as subspecialty of the survey participant (B = 3.36, P = 0.032), and the survey participant’s expectancy of resident’s ability to handle workload after completion of residency were significantly associated with perceived success of the integrated training program (B = 1.16, P = 0.023). Perceived strengths of the integrated training program included broadening of expertise, a better preparation of future imaging specialists for hybrid imaging, increased efficiency in training residents, and increased efficiency in multidisciplinary meetings. Perceived weaknesses of the integrated training program included reduced exposure to nuclear medicine, less time for research and innovation, and concerns about its international recognition. Conclusion This study provided insights into the experiences of nuclear medicine physicians and radiologists with the Dutch integrated nuclear medicine and radiology residency program, which may be helpful to improve the program and similar residency programs in other countries.

Purpose: To explore reasons that influence a resident's choice for the nuclear medicine subspecialty in the integrated nuclear medicine and radiology residency program in the Netherlands. Methods: A web questionnaire was developed and distributed among residents in the Dutch integrated nuclear medicine and radiology training. Results: A total of 114 residents were included. The survey results revealed four categories of incentives to choose the nuclear medicine subspecialty: 1) Expertise of nuclear medicine physicians and their quality of supervision in the training hospital, 2) Opportunities to do scientific research during and after residency, 3) Diversity of pathology, radiotracers, examinations and therapies in the training hospital, and 4) The expectation that the role of hybrid imaging will increase in the future. They also revealed four groups of disincentives to choose the nuclear medicine subspecialty: 1) Lack of collaboration and integration between nuclear medicine and radiology in some training hospitals, 2) Imbalance between nuclear medicine and radiology during the first 2.5 years of basic training during residency at the expense of nuclear medicine, 3) Uncertainty regarding the international recognition of the nuclear medicine subspecialty training, and 4) Uncertain future of nuclear medicine regarding the chances of employment and the ratio of work activities of nuclear medicine to radiology. Conclusion: This study provided insight into residents' motives to pursue or refrain from nuclear medicine subspecialization in an integrated nuclear medicine and radiology residency program. Medical imaging specialists in training hospitals and developers of curricula for nuclear medicine and radiology training should take these motives into account to ensure a sufficient outflow of newly graduated nuclear medicine specialists.

OBJECTIVE: To investigate the general population's view on the use of artificial intelligence (AI) for the diagnostic interpretation of screening mammograms.METHODS: Dutch women aged 16 to 75 years were surveyed using the Longitudinal Internet Studies for the Social sciences panel, representative for the Dutch population. Attitude toward AI in mammography screening was measured by means of five items: necessity of a human check; AI as a selector for second reading; AI as a second reader; developer is responsible for error; and radiologist is responsible for error.RESULTS: Of the 922 participants included, 77.8% agreed with the necessity of a human check, whereas the item AI as a selector for a second reading was more heterogeneously answered, with 41.7% disagreement, 31.5% agreement, and 26.9% responding with "neither agree nor disagree." The item AI as a second reader was mostly responded with "neither agree nor disagree" (37.1%) and "agree" (37.6%), whereas the two last items on developer's and radiologist' responsibilities were mostly answered with "neither agree nor disagree" (44.6% and 39.2%, respectively).DISCUSSION: Despite recent breakthroughs in the diagnostic performance of AI algorithms for the interpretation of screening mammograms, the general population currently does not support a fully independent use of such systems without involving a radiologist. The combination of a radiologist as a first reader and an AI system as a second reader in a breast cancer screening program finds most support at present. Accountability in case of AI-related diagnostic errors in screening mammography is still an unresolved conundrum.

A method commonly used in health care research is the waiting room (WR) survey. While patients are waiting for their appointment, they are asked to complete a questionnaire measuring their attitudes, behaviors and other characteristics. In this paper we synthesize practical guidelines for WR surveys by comparing the method with two similar approaches: public intercept (PI) surveys and drop-off-pick-up (DOPU) surveys. In this comparison we use the Total Survey Error approach Groves (Survey Methodology, Wiley, New York, 2004); (Groves in Public Opinion Quarterly 74(5): 849-879, 2010) and apply it to three case examples in which one of the three surveys is used. We take into account measurement (validity, measurement- and processing error) and representation (coverage-, sampling- and nonresponse error). From our review, we conclude that waiting room surveys, though limited to patients and their caregivers, can provide useful information on patients’ perspective on health care. Response rates in waiting rooms are usually high, but often not even reported. We recommend adjustment for sampling bias by taking into account the number of visits to the hospital per respondent and sample times proportionate to the number of sample members expected on a particular time. These surveys also allow for collection of para-data; i.e., relevant information in the circumstances of a request to participate in survey research, and behavior of surveyors can easily be controlled, or investigated in an experimental design.

ObjectivesThe patients’ view on the implementation of artificial intelligence (AI) in radiology is still mainly unexplored territory. The aim of this article is to develop and validate a standardized patient questionnaire on the implementation of AI in radiology.MethodsSix domains derived from a previous qualitative study were used to develop a questionnaire, and cognitive interviews were used as pretest method. One hundred fifty-five patients scheduled for CT, MRI, and/or conventional radiography filled out the questionnaire. To find underlying latent variables, we used exploratory factor analysis with principal axis factoring and oblique promax rotation. Internal consistency of the factors was measured with Cronbach’s alpha and composite reliability.ResultsThe exploratory factor analysis revealed five factors on AI in radiology: (1) distrust and accountability (overall, patients were moderately negative on this subject), (2) procedural knowledge (patients generally indicated the need for their active engagement), (3) personal interaction (overall, patients preferred personal interaction), (4) efficiency (overall, patients were ambiguous on this subject), and (5) being informed (overall, scores on these items were not outspoken within this factor). Internal consistency was good for three factors (1, 2, and 3), and acceptable for two (4 and 5).ConclusionsThis study yielded a viable questionnaire to measure acceptance among patients of the implementation of AI in radiology. Additional data collection with confirmatory factor analysis may provide further refinement of the scale.Key Points• Although AI systems are increasingly developed, not much is known about patients’ views on AI in radiology.• Since it is important that newly developed questionnaires are adequately tested and validated, we did so for a questionnaire measuring patients’ views on AI in radiology, revealing five factors.• Successful implementation of AI in radiology requires assessment of social factors such as subjective norms towards the technology.

Although the past decade has shown enormous growth in the number of surveys conducted online, conducting surveys by means of telephone or face-to-face interviews is still a large research field. Es...

This paper shows how interaction coding of interviewer-respondent interactions was used to perform manipulation checks of CATI interviewer behavior in experimental studies. An experiment in which interviewers were instructed to persuade potential respondents by means of a personal style or a formal style showed no significant effects of the persuasion style on survey participation. By means of interviewer-respondent interaction analysis, we studied the interviews in more depth focusing on the compliance of interviewers with the instructions. First, we found that many respondents immediately complied, but when respondents were reluctant, using any form of persuasion was better than none. Second, interviewers also had success in gaining cooperation when they referred to an argument that they had not been instructed to use. In conclusion, we assume that interviewers using arguments in which they were trained develop too much of an unauthentic routine in expressing these arguments, whereas using arguments outside instructions are likely to be expressed in a more natural, spontaneous way and are therefore more convincing. In addition, this study shows that it is useful to include behavior coding as a manipulation check in experiments involving interviewer behavior.

This article examines how residential property and its surroundings influence day- and night-time residential burglary. Crime Prevention Through Environmental Design (CPTED) principles of territoriality, surveillance, access control, target hardening, image maintenance, and activity support underpin the study. Data were collected by observing 851 houses in the city of Enschede, half of which were burgled and half representing a random selection of houses not burgled. Multilevel multinomial regression models were estimated for predicting day- and night-time burglaries. The findings show that territoriality and access control predict daytime burglary while access control and target hardening predict night-time burglary. The analysis controls for offender availability, target attractiveness, and residential stability. The conclusion is that two separate burglary prevention frameworks are needed: one for day-and another one for night-time burglary.

Survey researchers sometimes face several options to formally define and draw random probability samples from their target population of individuals. Relatively little is known about the consequences for the quality of survey estimates when different sampling frames are used, for example frames that list addresses versus individuals While the initial choice for a sampling frame design may be based on diverse criteria, we argue that any decision has consequences for the quality of survey estimates. We hypothesize that knowing respondents’ names upfront decreases nonresponse and coverage error. This can be accomplished by either using person-based sampling frames or augmenting nonperson-based sampling frames with names. We systematically compare sampling frame designs in the context of face-to-face surveys in connection with the European Social Survey (ESS) with the help of three quasi-experimental datasets from a single country. Even the most conservative measures support our hypothesis that the presence of names in the sampling frames could improve response rates, noncontact rates, cooperation rates, and ineligibility rates by between 2.5 and 6 percentage points. Additionally, the accuracy of population estimates could increase. These results suggest that survey researchers collecting individual-level data would be best advised to use well-maintained sampling frame designs (augmented) with person-specific information.

Household surveys often require including proxy reporters to obtain information about other household members who cannot be interviewed. The participation of proxies can undermine survey data quality due to the fact that proxies must respond to questions thinking about other people. The objectives of the present study were to analyze the behaviour of proxy reporters and evaluate the convergence between the answers given by proxies and self-reporters by means of behaviour coding. This improves the evaluation of convergence, since only adequate (i.e., interpretable) answers given by both types of informant are taken into account. Responses to a disability questionnaire employed by an official statistical institute were analyzed. The questionnaire includes 11 questions about different limitations related to everyday activities. 16 self-reporter and 16 proxies formed 16 couples whose members lived together and supported a direct family relation. The results show a high percentage (52%) of convergence between both types of informant, although fluctuating across the questions and the couples. Proxies showed relatively more adequate behaviour during the interaction than self-reporters. From this we conclude that proxies can be considered at least as good informants as self-reporters from an interviewer-respondent interaction perspective. Future research should address the impact of proxy responses on survey validity.

Interaction analysis was used to analyze a total of 14,265 question-answer sequences of (Q-A Sequences) 80 questions that originated from two face-to-face and three telephone surveys. The analysis was directed towards the causes and effects of particular interactional problems. Our results showed that problematic respondent behavior is affected by the questionnaire design, whereas inadequate interviewer behavior is affected by respondent behavior, rather than directly by the questionnaire design. Two surveys used questions for which validating information was available. It appeared that the occurrence of such irregularities of interviewer and respondent behavior was related to the validity of the eventual responses. Explanations for the occurrence of problematic respondent behavior were proposed, concerning both cognitive and conversational factors, related to the wording of questions and response alternatives. © Springer 2006.

Although telephone interviewing is one of the major data collection methods used in survey research and response rates have been declining for years, the effects of the interviewers’ voice characteristics on the cooperation of respondents have hardly been studied. The decision to participate in a telephone survey results from a complex of factors (Dillman, Gallegos, & Rencher, 1976; Groves & Couper, 1998; Groves & McGonnacle, 2001). Yet, the interviewers’ voice characteristics may be particularly important, as visible aspects of communication are absent. Since our aim was to evaluate the impact of the interviewers’ voice characteristics as such, we restricted our study to the first stage of the introduction, namely the interviewer reading the introductory text. The great majority of refusals to participate in a telephone interview occur immediately after this first stage (Dijkstra & Smit, 2002; Maynard & Schaeffer, 1997; Oksenberg & Cannell, 1988). Because no persuasion techniques are applied during this stage, such voice characteristics as pitch or speech rate may therefore affect the first reaction of the recipient. The few studies that have been performed on this matter (Hufken & Schafer, 2003; three studies in Oksenberg & Cannell, 1988) concerned one or two of the following measures: (1) voice characteristics established by objective acoustic measures; (2) judges’ ratings of voice characteristics; and (3) judges’ ratings of the (supposed) recipients’ impression of personal characteristics of the interviewer. Our research project was designed to extend these studies by (a) utilizing each of the three measures jointly; (b) applying the measures to interview introductions from a large-scale household survey, and (c) relating the measures to the interviewers’ cooperation rates (being a specification of response rates, as explained later) actually obtained in that household survey as well as to the rated willingness of judges to grant an interview. Thus, our research question is formulated as follows: Do the (perceived) interviewers’ voice characteristics and personal characteristics relate to cooperation rates in telephone interviews, and if so, is there a plausible theoretical explanation for these relationships?

When survey respondents answer survey questions, they can also produce "paradata" (Couper 2000, 2008): behavioral evidence about their response process. The study reported here demonstrates that two kinds of respondent paradata - fluency of speech and gaze direction during answers - identify answers that are likely to be problematic, as measured by changes in answers during the interview or afterward on a post-interview questionnaire. Answers with disfluencies were less reliable both face to face and on the telephone than fluent answers, and particularly diagnostic of unreliability face to face. Interviewers' responsivity can affect both the prevalence and potential diagnosticity of paradata: both disfluent speech and gaze aversion were more frequent and diagnostic in conversational interviews, where interviewers could provide clarification if respondents requested it or the interviewer judged it was needed, than in strictly standardized interviews where clarification was not provided even if the respondent asked for it.

This paper examines how property (i. e. the house and ist ground) and nearby (i. e. the immediate surroundings of a property) characteristics influence residential burglary. Crime Prevention through Environmental Design (CPTED) principles of territoriality, surveillance, access control, target hardening, image- maintenance and activity support provide the underpinning theory. The reasoning is that the physical environment can be changed to impact criminal behavior resulting in a reduction in crime and fear of crime. Data were collected by observing 851 houses, of which approximately half had been burgled in 2008 according to police records. Property characteristics appear to be better at predicting burglary than nearby characteristics. They also show that the hierarchical order of the principles varies for property and nearby characteristics. A multilevel regression was elaborated to account for the variance between neighbourhoods. A number of property and nearby design recommendations is made based on the significant variables.

Interaction analysis of question–answer sequences from a telephone survey shows that so-called mismatch answers, i.e. answers that do not correspond to the required answering format, are the most frequently occurring problematic verbal behavior. They also are likely to trigger suggestive interviewer probing. Explanations for the occurrence of mismatch answers concern cognitive and conversational factors. In both a non-experimental and an experimental study it was found that questions with formal response alternatives yield more mismatch answers than questions with colloquial response alternatives (i.e., words that are frequently used in ordinary conversations). Effects of the wording of questions were only found in the non-experimental study, indicating that formal question wording yields fewer mismatch answers than colloquial question wording. The findings suggest that, especially in case of questions that are formulated as agree–disagree opinion assertions, the chance of mismatch answers is highly reduced when colloquial response alternatives are used.

This study assesses the effect of response-mode choices on response rates, and responsemode preferences of hard-to-survey populations: young adults, full-time workers, big city inhabitants, and non-Western immigrants. Using address-based sampling, a stratified sample of 3,496 households was selected. The first group of sample members was contacted face to face and could choose between a CAPI and web response mode. The second group, contacted by telephone, could choose between CATI and web. The third group, contacted by telephone, was randomly allocated to a response mode. Our address-based sampling technique was successful in reaching most of the hard-to-survey groups. Insufficient numbers of non- Western immigrants were reached; therefore this group was excluded from our analyses. In our mixed-effect models, no significant effects on the willingness to participate were found for mode choice. We found that full-time workers and young adults were significantly more likely to choose web over CAPI when contacted face to face.

The event history calendar (EHC) is usually a matrix with column headings indicating calendar years and/or months and rows representing different life domains. In EHC interviews, information is first collected on domains with relatively easy to recall events. This chapter describes how the quality of the fairly complex interviews conducted in multiple languages and countries could be verified. It evaluates the type of information used for cross‐checking across countries and also describes how it developed training and monitoring scheme adapted to EHC interviews in a large‐scale survey on smoking history. Since interviewer‐related bias may differ across countries, the chapter discusses interviewer effects and effectiveness of feedback based on monitoring across countries based on behavior coding data of interviews conducted in five countries. It also discusses the number of valid interviews, audio‐recorded interviews, and feedback processing speed.

This paper examines how property (i. e. the house and ist ground) and nearby (i. e. the immediate surroundings of a property) characteristics influence residential burglary. Crime Prevention through Environmental Design (CPTED) principles of territoriality, surveillance, access control, target hardening, image- maintenance and activity support provide the underpinning theory. The reasoning is that the physical environment can be changed to impact criminal behavior resulting in a reduction in crime and fear of crime. Data were collected by observing 851 houses, of which approximately half had been burgled in 2008 according to police records. Property characteristics appear to be better at predicting burglary than nearby characteristics. They also show that the hierarchical order of the principles varies for property and nearby characteristics. A multilevel regression was elaborated to account for the variance between neighbourhoods. A number of property and nearby design recommendations is made based on the significant variables.

Various studies have shown that social desirability bias and satisficing are more prevalent in CATI than in CAPI surveys. Although this difference has theoretically been explained in terms of rapport (Holbrook et al 2003), it has not systematically been studied whether interviewer-respondent interactions in CATI and CAPI surveys indeed show a difference in rapport. In our study we aim to fill this gap. We analyzed 60 CATI and 54 CAPI interviews that originated from a mixed-mode experiment using the European Social Survey questionnaire (Haan 2015). Analysis was based on a coding scheme developed by Garbarski, Dykema and Schaeffer (forthcoming, 2016), who define rapport in terms of responsiveness by interviewers and engagement by respondents. We found mixed differences with respect to behaviors related to rapport. For example, interviewer laughter appeared to be more common in CATI than in CAPI, but apologetic utterances such as ‘sorry’ occurred equally often in both modes. Furthermore, a significant difference was found in the number of words uttered. Question-answer sequences contained on average two more words in CATI than in CAPI. This effect is partly explained by the fact that for many questions in the CAPI survey show cards were used, and in those cases extension of interaction in CATI interviews is due to less efficient communication about response alternatives. Further analysis of extended interactions showed that respondents in CATI had more difficulty in formulating their response and had more difficulties with question wording than in CAPI. These task-related issues may contribute to the effect of decreased trust and motivation of respondents in CATI interviews, and may subsequently explain the increased level of satisficing and social desirability bias in this survey mode compared to CAPI.

In this prestentation we provide an overview of results of several Fake Good Fake Bad experiments. In such experiments respondents are asked to intentionally give either socially desirable answers (fake good) or socially undesirable answers (fake bad). Significant differences between these two groups are used as an indication that the questions indeed are sensitive and thus vulnerable to social desirability effects. Our first experiment, in a web survey (n=215) on alcohol consumption, showed that variance of the scores in the fake bad condition was systematically higher than in the fake good condition. Several possible explanations exist for this phenomenon. It may mean that respondents are less determined about what is socially undesirable than about what is socially desirable, it may mean that faking good is easier (to understand) than faking bad, or it may mean that respondents interpret the faking instructions differently. In order to increase comprehension of the faking task, in our second and third experiment, we tested the effects of visual and oral instructions. Only the oral instruction that preceded administration did yield lower variance in the fake bad group, but not for all questions. Another cause of high variance in fake scores could be the different social settings that respondents take into account while determining the socially desirable or undesirable position. Therefore, in the fourth experiment, we tested, in a web survey (n=224) on alcohol and drug use, the effects of steering respondents towards a social context by means of pictures. However, results showed no difference in respondent’s answers for the version with pictures that included social context (i.e., pictures of people consuming alcohol or drugs) versus a version that included no social context (i.e. pictures of alcoholic beverages or drugs). Finally, in a fifth experiment, we tested the possibility of allowing respondents to select multiple response options. The results showed that only a fraction of respondents selected more than one option, which may have been due to satisficing effects.