Search

BackgroundPrevalence of research misconduct, questionable research practices (QRPs) and their associations with a range of explanatory factors has not been studied sufficiently among academic researchers.Methods The National Survey on Research Integrity was aimed at all disciplinary fields and academic ranks in the Netherlands. The survey enquired about engagement in fabrication, falsification and 11 QRPs over the previous three years, and 12 explanatory factor scales. We ensured strict identity protection and used a randomized response method for questions on research misconduct. Results6,813 respondents completed the survey. Prevalence of fabrication was 4.3% (95% CI: 2.9, 5.7) and falsification 4.2% (95% CI: 2.8, 5.6). Prevalence of QRPs ranged from 0.6% (95% CI: 0.5, 0.9) to 17.5% (95 % CI: 16.4, 18.7) with 51.3% (95% CI: 50.1, 52.5) of respondents engaging frequently in ≥ 1 QRP. Being a PhD candidate or junior researcher increased the odds of frequently engaging in ≥ 1 QRP, as did being male. Scientific norm subscription (odds ratio (OR) 0.79; 95% CI: 0.63, 1.00) and perceived likelihood of detection by reviewers (OR 0.62, 95% CI: 0.44, 0.88) were associated with lower odds of research misconduct. Publication pressure was associated with higher odds of engaging frequently in ≥ 1 QRP (OR 1.22, 95% CI: 1.14, 1.30).ConclusionsWe found higher prevalence of misconduct than earlier surveys. Our results suggest that greater emphasis on scientific norm subscription, strengthening reviewers in their role as gatekeepers of research quality and curbing the “publish or perish” incentive system can promote research integrity.

Synthetic datasets simultaneously allow for the dissemination of research data while protecting the privacy and confidentiality of respondents. Generating and analyzing synthetic datasets is straightforward, yet, a synthetic data analysis pipeline is seldom adopted by applied researchers. We outline a simple procedure for generating and analyzing synthetic datasets with the multiple imputation software mice (Version 3.13.15) in R. We demonstrate through simulations that the analysis results obtained on synthetic data yield unbiased and valid inferences and lead to synthetic records that cannot be distinguished from the true data records. The ease of use when synthesizing data with mice along with the validity of inferences obtained through this procedure opens up a wealth of possibilities for data dissemination and further research on initially private data.

BackgroundThe aetiology of keratoconus (KC) remains poorly understood. KC has typically been described as a non-inflammatory disorder of the cornea. Nonetheless, there is increasing presumptive evidence for the role of the immune system in the pathogenesis of KC.AimTo evaluate the association between KC and immune-mediated diseases on a population level. We hypothesise that KC is immune-mediated rather than a predominantly degenerative disease.MethodsData were obtained from the largest health insurance provider in the Netherlands. Dutch residents are obligatorily insured. The data contained all medical claims and sociodemographic characteristics from all KC patients plus all those data from a 1:6 age-matched and sex-matched control group. The primary outcome was the association between KC and immune-mediated diseases, as assessed by conditional logistic regression.ResultsBased on our analysis of 2051 KC cases and 12 306 matched controls, we identified novel associations between KC and Hashimoto’s thyroiditis (OR=2.89; 95% CI: 1.41 to 5.94) and inflammatory skin conditions (OR=2.20; 95% CI: 1.37 to 3.53). We confirmed known associations between KC and atopic conditions, including allergic rash (OR=3.00; 95% CI: 1.03 to 8.79), asthma and bronchial hyperresponsiveness (OR=2.51; 95% CI: 1.63 to 3.84), and allergic rhinitis (OR=2.20; 95% CI: 1.39 to 3.49).ConclusionKeratoconus appears positively associated with multiple immune-mediated diseases, which provides a population-based argument that systemic inflammatory responses may influence its onset. The identification of these particular diseases might shed light on potential comparable pathways through which this proinflammatory state is achieved, paving the way for pharmacological treatment strategies.

Missing data in scientific research go hand in hand with assumptions about the nature of the missingness. When dealing with missing values, a set of beliefs has to be formulated about the extent to which the observed data may also hold for the missing parts of the data. It is vital that the validity of these missingness assumptions is verified, tested, and that assumptions are adjusted when necessary. In this article, we demonstrate how observed data structures could a priori indicate whether it is likely that our beliefs about the missingness can be trusted. To this end, we simulate complete data and generate missing values according several types of MCAR, MAR, and MNAR mechanisms. We demonstrate that in scenarios where the data correlations are either low or very substantial, strictly different mechanisms yield equivalent statistical inferences. In addition, we show that the choice of quantity of scientific interest together with the distribution of the nonresponse govern the validity of the missingness assumptions.

Hawley's influential resource control theory (RCT) posits that both coercive and prosocial strategies may yield social dominance, as indexed by resource control. Based on differences in youths’ relative use of these strategies, RCT a priori defines five distinct subtypes. Several studies by Hawley and colleagues have revealed substantial differences between subtypes in terms of obtained resource control and various social characteristics (e.g., agreeableness). The present longitudinal study (N = 394; Mage = 10.3; SD = 0.5) expands on previous work. Firstly, because several items used to assess strategies in RCT appear to confound strategy use with the resulting benefits (resource control), we disentangled between strategy use as such and obtained resource control. Secondly whereas previous work has been exclusively cross-sectional, the present study was longitudinal. ANOVAs comparing subgroups provided support for some core tenets of RCT, but not for others. For instance, bistrategic children scored high on both resource control and perceived popularity. However, bistrategics engaged in elevated bullying, and whereas Hawley asserts that they are proficient in balancing ‘getting ahead’ with ‘getting along’, their behavior appeared to evoke clear negative reactions in the peer group at large. Findings also showed that non-controllers did not experience more negative outcomes than their peers across all domains.

Supplemental Material, Pages_from_smr-17-0083 for The Dance of the Mechanisms: How Observed Information Influences the Validity of Missingness Assumptions by Rianne Margaretha Schouten, and Gerko Vink in Sociological Methods & Research

Supplemental Material, Figure8e for The Dance of the Mechanisms: How Observed Information Influences the Validity of Missingness Assumptions by Rianne Margaretha Schouten, and Gerko Vink in Sociological Methods & Research

Weighting methods are commonly used in situations of unit nonresponse with linked register data. However, several arguments in terms of valid inference and practical usability can be made against the use of weighting methods in these situations. Imputation methods such as sample and mass imputation may be suitable alternatives, as they lead to valid inference in situations of item nonresponse and have some practical advantages. In a simulation study, sample and mass imputation were compared to traditional weighting when dealing with unit nonresponse in linked register data. Methods were compared on their bias and coverage in different scenarios. Both, sample and mass imputation, had better coverage than traditional weighting in all scenarios. Imputation methods can therefore be recommended over weighting as they also have practical advantages, such as that estimates outside the observed data distribution can be created and that many auxiliary variables can be taken into account. The use of sample or mass imputation depends on the specific data structure.

Large scale assessment data often has a multilevel structure. When dealing with missing values, such structures need to be taken into account to prevent underestimation of the intraclass correlation. We evaluate predictive mean matching (PMM) as a multilevel imputation technique and compare it to other imputation approaches for multilevel data. We propose partitioned predictive mean matching (PPMM) as an extension to the PMM algorithm to divide the big data multilevel problem into manageable parts that can be solved by standard predictive mean matching. We show that PPMM can be a very effective imputation approach for large multilevel datasets and that both PPMM and PMM yield plausible inference for continuous, ordered categorical, or even dichotomous multilevel data. We conclude that both the performance of PMM and PPMM is often comparable to dedicated methods for multilevel data.

Many researchers face the problem of missing data in longitudinal research. Especially, high risk samples are characterized by missing data which can complicate analyses and the interpretation of results. In the current study, our aim was to find the most optimal and best method to deal with the missing data in a specific study with many missing data on the outcome variable. Therefore, different techniques to handle missing data were evaluated, and a solution to efficiently handle substantial amounts of missing data was provided. A simulation study was conducted to determine the most optimal method to deal with the missing data. Results revealed that multiple imputation (MI) using predictive mean matching was the most optimal method with respect to lowest bias and the smallest confidence interval (CI) while maintaining power. Listwise deletion and last observation carried backward also scored acceptable with respect to bias; however, CIs were much larger and sample size almost halved using these methods. Longitudinal research in high risk samples could benefit from using MI in future research to handle missing data. The paper ends with a checklist for handling missing data. http://www.tandfonline.com/toc/pedp20/12/4?nav=tocList http://dx.doi.org/10.1080/17405629.2015.1049526 http://www.tandfonline.com/doi/full/10.1080/17405629.2015.1049526

Multiple imputation methods properly account for the uncertainty of missing data. One of those methods for creating multiple imputations is predictive mean matching (PMM), a general purpose method. Little is known about the performance of PMM in imputing non-normal semicontinuous data (skewed data with a point mass at a certain value and otherwise continuously distributed). We investigate the performance of PMM as well as dedicated methods for imputing semicontinuous data by performing simulation studies under univariate and multivariate missingness mechanisms. We also investigate the performance on real-life datasets. We conclude that PMM performance is at least as good as the investigated dedicated methods for imputing semicontinuous data and, in contrast to other methods, is the only method that yields plausible imputations and preserves the original data distributions.

Because of the difficulty of measuring nanoplastics (NP), the use of NPs doped with trace metals has been proposed as a promising approach to detect NP in environmental media and biota. In the present study, the freshwater amphipod Gammarus pulex were exposed to palladium (Pd)-doped NP via natural sediment at six spiking concentrations (0, 0.3, 1, 3, 10 and 30 g plastic per kg of sediment dry weight) with the aim of assessing their uptake and chronic effects using 28 days standardized single species toxicity tests. NP concentrations were quantified based on Pd concentrations measured by ICP-MS on digests of the exposed organisms and faecal pellets excreted during a post-exposure 24 hour depuration period. Additionally, NP concentrations were measured in sediments and water to demonstrate accuracy of NP dosing and to quantify the resuspension of NP from the sediment caused by the organisms. A significant positive linear relationship between the uptake of NP by G. pulex and the concentration of NP in the sediments was observed, yet no statistically significant effects were found on the survival or growth of G. pulex. A biodynamic model fitted well to the data and suggested bioaccumulation would occur in two kinetic compartments, the major one being reversible with rapid depuration to clean medium. Model fitting yielded a mass based trophic transfer factor (TTF), conceptually similar to the traditional biota sediment accumulation factor, for NP in the gut of 0.031. This value is close to a TTF value of 0.025 that was obtained for much larger microplastic particles in a similar experiment performed previously. Mechanistically, this suggests that ingestion of plastic is limited by the total volume of ingested particles. We demonstrated that using metal-doped plastics provides opportunities for precise quantification of NP accumulation and exposure in fate and effect studies, which can be a clear benefit for NP risk assessment., Environmental Science: Nano, 8 (6), ISSN:2051-8153, ISSN:2051-8161

Joint modelling (JM) and fully conditional specification (FCS) are two widely used strategies for imputing multivariate missing data. JM involves specifying a multivariate distribution for the missing data and drawing imputations from their conditional distributions. The FCS approach specifies the distribution for each partially observed variable conditional on all other variables. The main advantage of FCS over JM is that FCS allows for tremendous flexibility in multivariate model design. However, there are often extra structures in the missing data that FCS cannot model properly in practice. Moreover, it is challenging to preserve the relations among multiple variables when performing the imputation on a variable-by-variable basis. This thesis aims to develop hybrid imputation that provides a strategy to specify hybrids of JM and FCS. To achieve this goal, I propose different solutions to missing data problems when applying FCS is not optimal. In chapter 2, I first discuss some general methods to impute squares. I improve the polynomial combination method and compare it with the substantive model compatible fully conditional specification method. Finally, I summarise the properties of both approaches. In chapter 3, I develop multivariate predictive mean matching, which allows simultaneous imputation of multiple missing variables. I combine the methodology of univariate predictive mean matching and canonical regression analysis. The advantage of this imputation method is the preservation of relations among a set of missing variables. Finally, I show the potential scenarios where multivariate predictive mean matching could be used and discuss the limitations. In chapter 4, I develop the hybrid imputation method to estimate individual treatment effects. The idea is that by imputing unobserved outcomes, we could calculate the differences between potential outcomes under different treatment conditions. However, there is a problem the data has no information about the correlation between potential outcomes. The proposed hybrid imputation method specifies the partial correlation and performs a sensitivity analysis to overcome this problem. Finally, I demonstrate the validity of the proposed hybrid imputation method and show how to apply it in practice. In chapter 5, I investigate the compatibility of FCS when the prior for conditional models are informative. Many authors illustrated the compatibility property of FCS when the prior for conditional models is non-informative. However, the compatibility property in the case of informative priors has not received much attention. I demonstrate that FCS under the normal linear model with an informative inverse-gamma prior is compatible with a joint distribution and provide the corresponding normal inverse-Wishart prior distribution for the joint distribution. In chapter 6, I develop a novel strategy to diagnose multiple imputation models based on posterior predictive checking. The general idea is that if the imputation model is congenial to the substantive model, the expected value of the observed data is in the centre of corresponding predictive posterior distributions. By applying the proposed diagnosis method, the researcher could compare the `over-imputed’ data with the observed data and evaluate the fitness of the imputation model.

In this dissertation it is discussed how one can capture and utilize alternative sources of (prior) information compared to traditional method in the social sciences such as survey research. Specific attention is paid to expert knowledge. In Chapter 2 we propose an elicitation methodology for a single parameter that does not rely on specifying quantiles of a distribution. The proposed method is evaluated using a user feasibility study, a partial validation study and an empirical example of the full elicitation method. In Chapter 3 it is investigated how experts’ knowledge, as alternative source of information, can be contrasted with traditional data collection methods. At the same time, we explore how experts can be assessed and ranked borrowing techniques from information theory. We use the information theoretical concept of relative entropy or Kullback-Leibler divergence which assesses a loss of information when approximating one distribution by another. For those familiar with the concept of model selection, Akaike’s Information Criterion is an approximation of this (Burnham & Anderson, 2002, Chapter 2). In Chapter 4 an alternative way of enhancing the amount of information in a model is proposed. We introduce Bayesian hierarchical modelling to the field of infants’ speech discrimination analysis. This technique is not new on it’s own but was not applied to this field. Implementing this type of modelling enables individual analyses within a group structure. By taking the hierarchical structure of the data into account we can make the most of the, on individual level, small noisy data sets. In Chapter 5 we reflect on issues that come along with the estimation of increasingly complicated models. We show how even with weakly informative priors, adding the information that is available to us, sometimes we do not get a solution with our analysis plan. We guide the reader on what to do when this occurs and where to look for clues and possible causes. We provide some guidance and a textbook example that for once shows things not working out the way you would like. We believe this is important as there are few examples of this. In Chapter 6 we combine the previous chapters. We take more complex models and get experts to specify beliefs with respect to these models. We extend the method developed in Chapter 2 to elicit experts’ beliefs with respect to a hierarchical model, which is used in Chapters 4 and 5. In specific, we concern ourselves with a Latent Growth Curve model and utilize the information theoretical measures from Chapter 3 to compare the (groups) of experts to one another and to data collected in a traditional way. We do this in the context of Posttraumatic Stress Symptoms development in children with burn injuries. In Chapter 7 I reflect on the work and explanations provided within the chapters of this dissertation, including this introduction.