Search

Diabetes is a chronic disease, which is characterized by abnormally high blood sugar levels. It may affect various organs and tissues, and even lead to life-threatening complications. Accurate prediction of diabetes can significantly reduce its incidence. However, the current prediction methods struggle to accurately capture the essential characteristics of nonlinear data, and the black-box nature of these methods hampers its clinical application. To address these challenges, we propose KCCAM_DNN, a diabetes prediction method that integrates Kendall's correlation coefficient and an attention mechanism within a deep neural network. In the KCCAM_DNN, Kendall's correlation coefficient is initially employed for feature selection, which effectively filters out key features influencing diabetes prediction. For missing values in the data, polynomial regression is utilized for imputation, ensuring data completeness. Subsequently, we construct a deep neural network (KCCAM_DNN) based on the self-attention mechanism, which assigns greater weight to crucial features affecting diabetes and enhances the model's predictive performance. Finally, we employ the SHAP model to analyze the impact of each feature on diabetes prediction, augmenting the model's interpretability. Experimental results show that KCCAM_DNN exhibits superior performance on both PIMA Indian and LMCH diabetes datasets, achieving test accuracies of 99.090% and 99.333%, respectively, approximately 2% higher than the best existing method. These results suggest that KCCAM_DNN is proficient in diabetes prediction, providing a foundation for informed decision-making in the diagnosis and prevention of diabetes. [ABSTRACT FROM AUTHOR]

The site regression model (SREG) is utilized by plant breeders for analyzing multi-environment trials (MET) to examine the relationships among test environments, genotypes (G), and genotype-by-environment interactions (GE). SREG explores a matrix of G and GE by performing a singular value decomposition on the residuals matrix from a one-way ANOVA, requiring complete data. As missing values are common in MET, we propose two new imputation methods that implement an Expectation Maximization algorithm to fit the SREG model. To evaluate the impact on SREG model parameter estimation of these proposed methods and other competing imputation methods available, we conducted two studies using different approaches. One study involved simulated data while the other used a real dataset. In both studies, different measures to verify whether the joint effect of G plus GE is altered by imputation of data, and the reproducibility of missing data were evaluated. We also incorporated situations not commonly addressed in the literature, such as non-random structures of missing values and a big data situation. The proposed procedures provided estimators with good performance, maintaining superiority in several aspects studied, even when the competing imputation methods did not achieve convergence. Therefore, the new methods enabled incomplete MET data to be effectively analyzed by a SREG model. [ABSTRACT FROM AUTHOR]

Imputation of missing data in high-dimensional datasets with more variables P than samples N, P ≫ N , is hampered by the data dimensionality. For multivariate imputation, the covariance matrix is ill conditioned and cannot be properly estimated. For fully conditional imputation, the regression models for imputation cannot include all the variables. Thus, the high dimension requires special imputation approaches. In this article, we provide an overview and realistic comparisons of imputation approaches for high-dimensional data when applied to a linear mixed modeling (LMM) framework. We examine approaches from three different classes using simulation studies: multiple imputation with penalized regression, multiple imputation with recursive partitioning and predictive mean matching; and multiple imputation with Principal Component Analysis (PCA). We illustrate the methods on a real case study where a multivariate outcome (i.e., an extracted set of correlated biomarkers from human urine samples) was collected and monitored over time and we discuss the proposed methods with more standard imputation techniques that could be applied by ignoring either the multivariate or the longitudinal dimension. Our simulations demonstrate the superiority of the recursive partitioning and predictive mean matching algorithm over the other methods in terms of bias, mean squared error and coverage of the LMM parameter estimates when compared to those obtained from a data analysis without missingness, although it comes at the expense of high computational costs. It is worthwhile reconsidering much faster methodologies like the one relying on PCA. [ABSTRACT FROM AUTHOR]

The identification of tumor-specific molecular dependencies is essential for the development of effective cancer therapies. Genetic and chemical perturbations are powerful tools for discovering these dependencies. Even though chemical perturbations can be applied to primary cancer samples at large scale, the interpretation of experiment outcomes is often complicated by the fact that one chemical compound can affect multiple proteins. To overcome this challenge, Batzilla et al. (PLoS Comput Biol 18(8): e1010438, 2022) proposed DepInfeR, a regularized multi-response regression model designed to identify and estimate specific molecular dependencies of individual cancers from their ex-vivo drug sensitivity profiles. Inspired by their work, we propose a Bayesian extension to DepInfeR. Our proposed approach offers several advantages over DepInfeR, including e.g. the ability to handle missing values in both protein-drug affinity and drug sensitivity profiles without the need for data pre-processing steps such as imputation. Moreover, our approach uses Gaussian Processes to capture more complex molecular dependency structures, and provides probabilistic statements about whether a protein in the protein-drug affinity profiles is informative to the drug sensitivity profiles. Simulation studies demonstrate that our proposed approach achieves better prediction accuracy, and is able to discover unreported dependency structures. [ABSTRACT FROM AUTHOR]

Statistical approaches that successfully combine multiple datasets are more powerful, efficient, and scientifically informative than separate analyses. To address variation architectures correctly and comprehensively for high-dimensional data across multiple sample sets (ie, cohorts), we propose multiple augmented reduced rank regression (maRRR), a flexible matrix regression and factorization method to concurrently learn both covariate-driven and auxiliary structured variations. We consider a structured nuclear norm objective that is motivated by random matrix theory, in which the regression or factorization terms may be shared or specific to any number of cohorts. Our framework subsumes several existing methods, such as reduced rank regression and unsupervised multimatrix factorization approaches, and includes a promising novel approach to regression and factorization of a single dataset (aRRR) as a special case. Simulations demonstrate substantial gains in power from combining multiple datasets, and from parsimoniously accounting for all structured variations. We apply maRRR to gene expression data from multiple cancer types (ie, pan-cancer) from The Cancer Genome Atlas, with somatic mutations as covariates. The method performs well with respect to prediction and imputation of held-out data, and provides new insights into mutation-driven and auxiliary variations that are shared or specific to certain cancer types. [ABSTRACT FROM AUTHOR]

The Cox regression analysis is used to determine the relationship between a dependent variable and covariates in survival analysis involving censored data. The proportional hazards assumption is one of the most important assumptions of Cox regression. Outliers may have a strong influence on the Cox regression model's parameter estimates and lead to violation of the proportional hazard assumption. Therefore, having outliers in the data set is a problem for researchers. In this case, robust estimations are commonly used to infer the parameters in a more robust way. However, we explore a new approach consisting of considering an outlier as missing data and replacing it by the multiple imputation method. The aim of this study is to compare these two methods through simulation. Furthermore, an analysis of a lung cancer data set is considered for illustration. According to the results of the study carried out based on simulated data sets and a real data set, the multiple imputation method, which is a missing data analysis method, solves the problem of outliers better than the robust estimation method, as the outcome is closer to the results obtained through original data. [ABSTRACT FROM AUTHOR]

Competing procedures, involving data smoothing, weighting, imputation, outlier removal, etc., may be available to prepare data for parametric model estimation. Often, however, little is known about the best choice of preparatory procedure for the planned estimation and the observed data. A machine learning‐based decision rule, an "oracle," can be constructed in such cases to decide the best procedure from a set C$$ \mathcal{C} $$ of available preparatory procedures. The oracle learns the decision regions associated with C$$ \mathcal{C} $$ based on training data synthesized solely from the given data using model parameters with high posterior probability. An estimator in combination with an oracle to guide data preparation is called an oracle estimator. Oracle estimator performance is studied in two estimation problems: slope estimation in simple linear regression (SLR) and changepoint estimation in continuous two‐linear‐segments regression (CTLSR). In both examples, the regression response is given to be increasing, and the oracle must decide whether to isotonically smooth the response data preparatory to fitting the regression model. A measure of performance called headroom is proposed to assess the oracle's potential for reducing estimation error. Experiments with SLR and CTLSR find for important ranges of problem configurations that the headroom is high, the oracle's empirical performance is near the headroom, and the oracle estimator offers clear benefit. [ABSTRACT FROM AUTHOR]

Background: The handling of missing data is a challenge for inference and regression modelling. A particular challenge is dealing with missing predictor information, particularly when trying to build and make predictions from models for use in clinical practice. Methods: We utilise a flexible Bayesian approach for handling missing predictor information in regression models. This provides practitioners with full posterior predictive distributions for both the missing predictor information (conditional on the observed predictors) and the outcome-of-interest. We apply this approach to a previously proposed counterfactual treatment selection model for type 2 diabetes second-line therapies. Our approach combines a regression model and a Dirichlet process mixture model (DPMM), where the former defines the treatment selection model, and the latter provides a flexible way to model the joint distribution of the predictors. Results: We show that DPMMs can model complex relationships between predictor variables and can provide powerful means of fitting models to incomplete data (under missing-completely-at-random and missing-at-random assumptions). This framework ensures that the posterior distribution for the parameters and the conditional average treatment effect estimates automatically reflect the additional uncertainties associated with missing data due to the hierarchical model structure. We also demonstrate that in the presence of multiple missing predictors, the DPMM model can be used to explore which variable(s), if collected, could provide the most additional information about the likely outcome. Conclusions: When developing clinical prediction models, DPMMs offer a flexible way to model complex covariate structures and handle missing predictor information. DPMM-based counterfactual prediction models can also provide additional information to support clinical decision-making, including allowing predictions with appropriate uncertainty to be made for individuals with incomplete predictor data. [ABSTRACT FROM AUTHOR]

Linear regression models are commonly used to determine the quantitative relationships between variables and utilize the resulting regression equations to make predictions. This paper proposes a fully informative multiple imputation method based on a linear regression model with a missing response variable, utilizing all observable data to obtain estimates of the regression coefficients and thereby the predicted values of the missing response variable. This not only provides a good explanation of the relationship between the response variable and their respective variables, but also effectively enhances the imputation accuracy of the response variable. The stability and sensitivity of the fiMI method are evaluated through a simulation study. Subsequently, the proposed method is applied to two real data sets, the admission prediction data set and the goalkeeper data set, and is discussed and analyzed. [ABSTRACT FROM AUTHOR]

There is a growing need for flexible general frameworks that integrate individual‐level data with external summary information for improved statistical inference. External information relevant for a risk prediction model may come in multiple forms, through regression coefficient estimates or predicted values of the outcome variable. Different external models may use different sets of predictors and the algorithm they used to predict the outcome Y given these predictors may or may not be known. The underlying populations corresponding to each external model may be different from each other and from the internal study population. Motivated by a prostate cancer risk prediction problem where novel biomarkers are measured only in the internal study, this paper proposes an imputation‐based methodology, where the goal is to fit a target regression model with all available predictors in the internal study while utilizing summary information from external models that may have used only a subset of the predictors. The method allows for heterogeneity of covariate effects across the external populations. The proposed approach generates synthetic outcome data in each external population, uses stacked multiple imputation to create a long dataset with complete covariate information. The final analysis of the stacked imputed data is conducted by weighted regression. This flexible and unified approach can improve statistical efficiency of the estimated coefficients in the internal study, improve predictions by utilizing even partial information available from models that use a subset of the full set of covariates used in the internal study, and provide statistical inference for the external population with potentially different covariate effects from the internal population. [ABSTRACT FROM AUTHOR]

Missing data is common in survival analysis. It is either removed or imputed using various methods. Expectation-maximization (EM) imputation is a popular method in Cox regression studies. This paper investigated the effect of different regression methods on Cox regression modeling within the framework of EM. A stratified Cox regression model was derived from a dataset of categorical and numerical variables. Missing data were imputed using the EM framework with five machine learning algorithms and then were compared to the full model. The results show that the recursive partition and regression tree (RPART) method performed better than others. However, all regression methods performed poorly in categorical covariate imputation. R code is available online. [ABSTRACT FROM AUTHOR]

Modern science is frequently based on the exploitation of large volumes of information storage in datasets and involving complex computational architectures. The statistical analyses of these datasets have to cope with specific challenges and frequently involve making informed but arbitrary decisions. Epidemiological papers have to be concise and focused on the underlying clinical or epidemiological results, not reporting the details behind relevant methodological decisions. In this work, we used an analysis of the cardiovascular-related measures tracked in 4–8-year-old children, using data from the INMA-Asturias cohort for illustrating how the decision-making process was performed and its potential impact on the obtained results. We focused on two particular aspects of the problem: how to deal with missing data and which regression model to use to evaluate tracking when there are no defined thresholds to categorize variables into risk groups. As a spoiler, we analyzed the impact on our results of using multiple imputation and the advantage of using quantile regression models in this context. [ABSTRACT FROM AUTHOR]

In modern biomedical datasets, it is common for recurrent outcomes data to be collected in an incomplete manner. More specifically, information on recurrent events is routinely recorded as a mixture of recurrent event data, panel count data, and panel binary data; we refer to this structure as general mixed recurrent event data. Although the aforementioned data types are individually well-studied, there does not appear to exist an established approach for regression analysis of the three component combination. Often, ad-hoc measures such as imputation or discarding of data are used to homogenize records prior to the analysis, but such measures lead to obvious concerns regarding robustness, loss of efficiency, and other issues. This work proposes a maximum likelihood regression estimation procedure for the combination of general mixed recurrent event data and establishes the asymptotic properties of the proposed estimators. In addition, we generalize the approach to allow for the existence of terminal events, a common complicating feature in recurrent event analysis. Numerical studies and application to the Childhood Cancer Survivor Study suggest that the proposed procedures work well in practical situations. [ABSTRACT FROM AUTHOR]

It is not uncommon for biological anthropologists to analyze incomplete bioarcheological or forensic skeleton specimens. As many quantitative multivariate analyses cannot handle incomplete data, missing data imputation or estimation is a common preprocessing practice for such data. Using William W. Howells' Craniometric Data Set and the Goldman Osteometric Data Set, we evaluated the performance of multiple popular statistical methods for imputing missing metric measurements. Results indicated that multiple imputation methods outperformed single imputation methods, such as Bayesian principal component analysis (BPCA). Multiple imputation with Bayesian linear regression implemented in the R package norm2, the Expectation–Maximization (EM) with Bootstrapping algorithm implemented in Amelia, and the Predictive Mean Matching (PMM) method and several of the derivative linear regression models implemented in mice, perform well regarding accuracy, robustness, and speed. Based on the findings of this study, we suggest a practical procedure for choosing appropriate imputation methods. [ABSTRACT FROM AUTHOR]

Navigating the intricate world of data analytics, one method has emerged as a key tool in confronting missing data: multiple imputation. Its strength is further fortified by its powerful variant, robust imputation, which enhances the precision and reliability of its results. In the challenging landscape of data analysis, non-robust methods can be swayed by a few extreme outliers, leading to skewed imputations and biased estimates. This can apply to both representative outliers—those true yet unusual values of your population—and non-representative outliers, which are mere measurement errors. Detecting these outliers in large or high-dimensional data sets often becomes as complex as unraveling a Gordian knot. The solution? Turn to robust imputation methods. Robust (imputation) methods effectively manage outliers and exhibit remarkable resistance to their influence, providing a more reliable approach to dealing with missing data. Moreover, these robust methods offer flexibility, accommodating even if the imputation model used is not a perfect fit. They are akin to a well-designed buffer system, absorbing slight deviations without compromising overall stability. In the latest advancement of statistical methodology, a new robust imputation algorithm has been introduced. This innovative solution addresses three significant challenges with robustness. It utilizes robust bootstrapping to manage model uncertainty during the imputation of a random sample; it incorporates robust fitting to reinforce accuracy; and it takes into account imputation uncertainty in a resilient manner. Furthermore, any complex regression or classification model for any variable with missing data can be run through the algorithm. With this new algorithm, we move one step closer to optimizing the accuracy and reliability of handling missing data. Using a realistic data set and a simulation study including a sensitivity analysis, the new alogorithm imputeRobust shows excellent performance compared with other common methods. Effectiveness was demonstrated by measures of precision for the prediction error, the coverage rates, and the mean square errors of the estimators, as well as by visual comparisons. [ABSTRACT FROM AUTHOR]

Multivariate time series measurements in plasma diagnostics present several challenges when training machine learning models: the availability of only a few labeled data increases the risk of overfitting, and missing data points or outliers due to sensor failures pose additional difficulties. To overcome these issues, we introduce a fast and robust regression model that enables imputation of missing points and data augmentation by massive sampling while exploiting the inherent correlation between input signals. The underlying Student‐t process allows for a noise distribution with heavy tails and thus produces robust results in the case of outliers. We consider the state space form of the Student‐t process, which reduces the computational complexity and makes the model suitable for high‐resolution time series. We evaluate the performance of the proposed method using two test cases, one of which was inspired by measurements of flux loop signals. [ABSTRACT FROM AUTHOR]

Dealing with missing values is an important issue in data observation or data recording process. In this paper, we consider a functional linear regression model with partially observed covariate and missing values in the response. We use a reconstruction operator that aims at recovering the missing parts of the explanatory curves, then we are interested in regression imputation method of missing data on the response variable, using functional principal component regression to estimate the functional coefficient of the model. We study the asymptotic behaviour of the prediction error when missing data are replaced by the imputed values in the original dataset. The practical behaviour of the method is also studied on simulated data and a real dataset. [ABSTRACT FROM AUTHOR]

Fully conditional specification (FCS) is a convenient and flexible multiple imputation approach. It specifies a sequence of simple regression models instead of a potential complex joint density for missing variables. However, FCS may not converge to a stationary distribution. Many authors have studied the convergence properties of FCS when priors of conditional models are non-informative. We extend to the case of informative priors. This paper evaluates the convergence properties of the normal linear model with normal-inverse gamma priors. The theoretical and simulation results prove the convergence of FCS and show the equivalence of prior specification under the joint model and a set of conditional models when the analysis model is a linear regression with normal inverse-gamma priors. [ABSTRACT FROM AUTHOR]

High-dimensional omics datasets frequently contain missing data points, which typically occur due to concentrations below the limit of detection (LOD) of the profiling platform. The presence of such missing values significantly limits downstream statistical analysis and result interpretation. Two common techniques to deal with this issue include the removal of samples with missing values and imputation approaches that substitute the missing measurements with reasonable estimates. Both approaches, however, suffer from various shortcomings and pitfalls. In this paper, we present "rox", a novel statistical model for the analysis of omics data with missing values without the need for imputation. The model directly incorporates missing values as "low" concentrations into the calculation. We show the superiority of rox over common approaches on simulated data and on six metabolomics datasets. Fully leveraging the information contained in LOD-based missing values, rox provides a powerful tool for the statistical analysis of omics data. [ABSTRACT FROM AUTHOR]

Sample surveys are often affected by missing observations and non-response caused by the respondents' refusal or unwillingness to provide the requested information or due to their memory failure. In order to substitute the missing data, a procedure called imputation is applied, which uses the available data as a tool for the replacement of the missing values. Two auxiliary variables create a chain which is used to substitute the missing part of the sample. The aim of the paper is to present the application of the Chain-type factor estimator as a means of source imputation for the non-response units in an incomplete sample. The proposed strategies were found to be more efficient and bias-controllable than similar estimation procedures described in the relevant literature. These techniques could also be made nearly unbiased in relation to other selected parametric values. The findings are supported by a numerical study involving the use of a dataset, proving that the proposed techniques outperform other similar ones. [ABSTRACT FROM AUTHOR]

• This study examined the associations between spanking experiences and children's subsequent reading and math scores. • Entropy balance matching was employed based on lifetime and recent incidence of spanking. • Lifetime experience of spanking by age 5 did not predict children's subsequent reading and math scores. • A recent incidence of spanking at the age of 5 was significantly associated with lower reading and math scores at ages 6 and 7, compared with those who had been spanked but not recently. Using the Early Childhood Longitudinal Study – Kindergarten Class of 2010–2011, this study examined the associations between spanking experiences and children's subsequent reading and math scores. Two different groups were matched on a range of family sociodemographics and children's initial reading and math scores using entropy balancing: not spanked vs spanked (Ns=17,171–17,537); and not recently vs recently spanked (Ns=10,393–10,724). Sample sizes were provided in ranges because they varied across multiple imputed data sets. The results of the lagged dependent variable regression analyses showed that a lifetime experience of spanking by age 5 did not predict children's subsequent reading and math scores. However, children who were recently spanked at the age of 5 showed significantly lower reading and math scores at ages 6 and 7 compared with those who were spanked but not recently. These results, replicated using different estimation methods (i.e., difference score analyses), strengthen the argument that spanking may impair early reading and math skills. [ABSTRACT FROM AUTHOR]

In many contemporary applications, large amounts of unlabelled data are readily available while labelled examples are limited. There has been substantial interest in semi‐supervised learning (SSL) which aims to leverage unlabelled data to improve estimation or prediction. However, current SSL literature focuses primarily on settings where labelled data are selected uniformly at random from the population of interest. Stratified sampling, while posing additional analytical challenges, is highly applicable to many real‐world problems. Moreover, no SSL methods currently exist for estimating the prediction performance of a fitted model when the labelled data are not selected uniformly at random. In this paper, we propose a two‐step SSL procedure for evaluating a prediction rule derived from a working binary regression model based on the Brier score and overall misclassification rate under stratified sampling. In step I, we impute the missing labels via weighted regression with nonlinear basis functions to account for stratified sampling and to improve efficiency. In step II, we augment the initial imputations to ensure the consistency of the resulting estimators regardless of the specification of the prediction model or the imputation model. The final estimator is then obtained with the augmented imputations. We provide asymptotic theory and numerical studies illustrating that our proposals outperform their supervised counterparts in terms of efficiency gain. Our methods are motivated by electronic health record (EHR) research and validated with a real data analysis of an EHR‐based study of diabetic neuropathy. [ABSTRACT FROM AUTHOR]

Missing data is a common problem in general applied studies, and specially in clinical trials. For implementing sensitivity analysis, several multiple imputation methods exist, like sequential imputation, which restricts to monotone missingness, and Bayesian, where the imputation and analysis models differ, entailing overestimation of variance. Also, full conditional specification provides a conditional interpretation of sensitivity parameters, requiring further calibration to get the desired marginal interpretation. We propose in this paper a multiple imputation procedure, based on a multivariate linear regression model, which keeps compatibility in sensitivity analysis under intermittent missingness, providing a marginal interpretation of the elicited parameters. Simulation studies show that the method behaves well with longitudinal data and remains robust under demanding constraints. We conclude the possibility of situations not covered by the existing methods and well suited for our proposal, which allows more efficient handling of a given multivariate linear regression structure. Its use is illustrated in a real case study, where a sensitivity analysis is accomplished. [ABSTRACT FROM AUTHOR]

This work presents a new approach, called Multiple Imputation of Sparsely‐sampled Functions at Irregular Times (MISFIT), for fitting generalized functional linear regression models with sparsely and irregularly sampled data. Current methods do not allow for consistent estimation unless one assumes that the number of observed points per curve grows sufficiently quickly with the sample size. In contrast, MISFIT is based on a multiple imputation framework, which, as we demonstrate empirically, has the potential to produce consistent estimates without such an assumption. Just as importantly, it propagates the uncertainty of not having completely observed curves, allowing for a more accurate assessment of the uncertainty of parameter estimates, something that most methods currently cannot accomplish. This work is motivated by a longitudinal study on macrocephaly, or atypically large head size, in which electronic medical records allow for the collection of a great deal of data. However, the sampling is highly variable from child to child. Using MISFIT we are able to clearly demonstrate that the development of pathologic conditions related to macrocephaly is associated with both the overall head circumference of the children as well as the velocity of their head growth. [ABSTRACT FROM AUTHOR]

Missing data is a common problem in real data analysis. In this paper, a Mallows model averaging method based on kernel regression imputation is proposed for the linear regression models with responses missing at random. We prove that our method asymptotically achieves the lowest possible squared error. Compared with the existing model averaging methods, the new method does not require the use of a parameter model to characterize the missing generation mechanism. The Monte Carlo simulation and a practical application demonstrate the usefulness of the proposed method. • Mallows model averaging method based on kernel regression imputation. • Asymptotic optimality in the sense of achieving the lowest possible squared error. • There is no need to use a parametric model to characterize the missing generation mechanism. [ABSTRACT FROM AUTHOR]

Purpose: Propensity score-weighting for confounder control and multiple imputation to counter missing data are both widely used methods in epidemiological research. Combination of the two is not trivial and requires a number of decisions to produce valid inference. In this tutorial, we outline the assumptions underlying each of the methods, present our considerations in combining the two, discuss the methodological and practical implications of our choices and briefly point to alternatives. Throughout we apply the theory to a research project about post-traumatic stress disorder in Syrian refugees. Patients and Methods: We detail how we used logistic regression-based propensity scores to produce "standardized mortality ratio"-weights and Substantive Model Compatible-Full Conditional Specification for multiple imputation of missing data to get the estimate of association. Finally, a percentile confidence interval was produced by bootstrapping. Results: A simple propensity score model with weight truncation at 1st and 99th percentile obtained acceptable balance on all covariates and was chosen as our model. Due to computational issues in the multiple imputation, two levels of one of the substantive model covariates and two levels of one of the auxiliary covariates were collapsed. This slightly modified propensity score model was the substantive model in the SMC-FCS multiple imputation, and regression models were set up for all partially observed covariates. We set the number of imputations to 10 and number of iterations to 40. We produced 999 bootstrap estimates to compute the 95-percentile confidence interval. Conclusion: Combining propensity score-weighting and multiple imputation is not a trivial task. We present considerations necessary to do so, realizing it is demanding in terms of both workload and computational time; however, we do not consider the former a drawback: it makes some of the underlying assumptions explicit and the latter may be a nuisance that will diminish with faster computers and better implementations. [ABSTRACT FROM AUTHOR]

The study is devoted to a comparison of three approaches to handling missing data of categorical variables: complete case analysis, multiple imputation (based on random forest), and the missing-indicator method. Focusing on OLS regression, we describe how the choice of the approach depends on the missingness mechanism, its proportion, and model specification. The results of a simulated statistical experiment show that each approach may lead to either almost unbiased or dramatically biased estimates. The choice of the appropriate approach should be primarily based on the missingness mechanism: one should choose CCA under MCAR, MI under MAR, and, again, CCA under MNAR. Although MIM produces almost unbiased estimates under MCAR and MNAR as well, it leads to inefficient regression coefficients—ones with too big standard errors and, consequently, incorrect p-values. [ABSTRACT FROM AUTHOR]

Analysis without adequate handling of missing values may lead to inconsistent and biased estimates. Despite multiple imputations becoming a widely used approach in handling missing data, manuscript researchers generally encounter missing data in their respective studies. In high-dimensional data, penalized regression is a popular technique for performing feature selection and coefficient estimation simultaneously. However, one of the most vital issues with high-dimensional data is that it often contains large quantities of missing data that common multiple imputation approaches may not work correctly. Therefore, this study uses imputations penalized regression models as an extension of the penalized methods to improve the performance and impute missing values in high-dimensional data. The method was applied to real-life highdimensional datasets for the different number of features, sample sizes, and missing dataset rates to evaluate its efficiency. The method was also compared with other existing imputation penalized methods for high-dimensional data. The comparative experimental results indicate that the proposed method outperforms its competitors by achieving higher sensitivity, specificity, and classification accuracy values. [ABSTRACT FROM AUTHOR]

• We develop a methodological framework to correct missingness in heterogeneous mobile data using a multi-task GP model. The resulting (repaired) data can be used for many transportation and mobility applications downstream. Our model considers correlations between users' coordinates and adjusts for individual-level differences in data characteristics; • We analyze our model's key hyperparameters (e.g., lengthscale parameters) and imputation accuracy concerning different types of trips (e.g. walking trips vs. highway trips). Specifically, we show the linkage between trip types and lengthscale parameters; • We introduce and demonstrate the combined use of smooth kernels (i.e., the rational quadratic kernel) and kernels with periodicities (i.e., the periodic kernel) in modeling human mobility data; and. • We benchmark our model against other missing data imputation methods, demonstrating its effectiveness under a range of missingness scenarios (short and long gaps). The prevalence of mobile devices and the ubiquity of network connectivity have generated a massive amount of temporally- and spatially-stamped data. A key characteristic of this mobile data is the prevalence of sparsity—for every recorded user, there is a significant amount of missing data. Sparsity leads to bias in the inferred mobility patterns and thus, correcting bias by imputing the missing data potentially creates opportunities for directly using the corrected mobile trajectory data for large-scale simulations in various applications. We propose a multi-task Gaussian process regression model to correct missingness in mobile data. Gaussian processes (GPs) allow for flexible modeling of diverse (i.e., non-linear, locally periodic) data patterns and quantify prediction uncertainty in an interpretable manner. We develop a methodological framework for applying GPs to mobile data. In doing so, we consider the correlations between users' coordinates (latitudes and longitudes) through multi-task learning and adjust for individual-level differences in data characteristics through parameter initialization and optimization. We introduce and demonstrate the use of smooth (i.e., rational quadratic) and periodic kernels in modeling human mobility data. Relatedly, we analyze our model's parameters and imputation accuracy with respect to different types of trips (e.g. slower vs faster trips). We also demonstrate our model's performance in two experiments with real app-based data, in which it outperforms alternative imputation methods. Our implementation is open-source at https://github.com/ekinugurel/GPSImpute. [ABSTRACT FROM AUTHOR]

Missing data is a prevailing problem in predictive analytics. In this paper, a winner‐take‐all (WTA) autoencoder‐based piecewise linear model is developed to solve the nonlinear regression problem under the missing value scenario, which consists of two parts: an overcomplete WTA autoencoder and a gated linear network. The overcomplete WTA autoencoder is a stacked denoising autoencoder (SDAE) designed to play two roles: (1) to estimate the missing values; (2) to realize a sophisticated partitioning by generating a broad set of binary gate control sequences. Besides, an iterative algorithm with renewed teacher signals is developed to train the SDAE. On the other hand, the gated linear network with the generated binary gate control sequences implements a flexible piecewise linear model for nonlinear regression. By composing a quasi‐linear kernel based on the gate control sequences, the piecewise linear model is then identified in the same way as a support vector regression. Experimental results have shown that our proposed hybrid model has a better performance than traditional models. © 2021 Institute of Electrical Engineers of Japan. Published by Wiley Periodicals LLC. [ABSTRACT FROM AUTHOR]

Multiple imputation is a well-established general technique for analyzing data with missing values. A convenient way to implement multiple imputation is sequential regression multiple imputation, also called chained equations multiple imputation. In this approach, we impute missing values using regression models for each variable, conditional on the other variables in the data. This approach, however, assumes that the missingness mechanism is missing at random, and it is not well-justified under not-at-random missingness without additional modification. In this paper, we describe how we can generalize the sequential regression multiple imputation imputation procedure to handle missingness not at random in the setting where missingness may depend on other variables that are also missing but not on the missing variable itself, conditioning on fully observed variables. We provide algebraic justification for several generalizations of standard sequential regression multiple imputation using Taylor series and other approximations of the target imputation distribution under missingness not at random. Resulting regression model approximations include indicators for missingness, interactions, or other functions of the missingness not at random missingness model and observed data. In a simulation study, we demonstrate that the proposed sequential regression multiple imputation modifications result in reduced bias in the final analysis compared to standard sequential regression multiple imputation, with an approximation strategy involving inclusion of an offset in the imputation model performing the best overall. The method is illustrated in a breast cancer study, where the goal is to estimate the prevalence of a specific genetic pathogenic variant. [ABSTRACT FROM AUTHOR]

The primary analysis of time‐to‐event data typically makes the censoring at random assumption, that is, that—conditional on covariates in the model—the distribution of event times is the same, whether they are observed or unobserved. In such cases, we need to explore the robustness of inference to more pragmatic assumptions about patients post‐censoring in sensitivity analyses. Reference‐based multiple imputation, which avoids analysts explicitly specifying the parameters of the unobserved data distribution, has proved attractive to researchers. Building on results for longitudinal continuous data, we show that inference using a Tobit regression imputation model for reference‐based sensitivity analysis with right censored log normal data is information anchored, meaning the proportion of information lost due to missing data under the primary analysis is held constant across the sensitivity analyses. We illustrate our theoretical results using simulation and a clinical trial case study. [ABSTRACT FROM AUTHOR]

The paper deals with the scenario where some covariates are observed by design for a subset of the observations only. In the example treated in the paper this occurs with a two phase sampling scheme where in the first phase a relatively large sample is drawn to record a response variable Y and a set of (cheap) covariates x. In a second phase a smaller sample is drawn from the first phase sample where additional (usually expensive) covariates z are also recorded. The second phase can be drawn with unequal probability sampling, where the sampling weights depend on the observed Y and x. The overall intention is to fit a regression model of Y on both, x and z. Due to the design of the data collection we are faced with missing values for z for a majority of observations. We propose an approximate estimation approach using semi-parametric mean and variance regression of Y on x only and augment this fit with a full regression model of Y on x and z. The idea extends the approach of Little (1992) towards non-normal data and non-linear models. The proposed estimation is numerically rather simple and performs convincingly well in simulation studies compared to alternatives such as complete-case and multiple imputation analysis. [ABSTRACT FROM AUTHOR]

• Identified factors affecting imputation accuracy and examined effects on various methods. • Developed a robust imputation model using dynamic weighting based on missingness scenarios. • Experiments on real-world water-quality data show superior accuracy of proposed method. • Proposed method's robustness highlighted by outperforming baselines in various scenarios. Water-quality monitoring and management are crucial for ensuring the safety and sustainability of water resources. However, missing data is a frequent problem in water-quality datasets, which can result in biased results in hydrological modeling and data analysis. While classic statistical methods and emerging machine/deep learning methods have been applied for imputing missing values, most existing studies perform well in specific missing scenarios, but not in universal scenarios. Therefore, existing imputation methods often fail to robustly impute missing values across various scenarios. To address the problem, we propose an imputation method that uses a context-aware voting-ensemble model to dynamically select optimal weights to integrate various imputation models across different missingness scenarios. For first identify the attributes of missingness scenarios that influence imputation accuracy. Then after introducing missing values in collected data according to the missingness scenarios, we measure the accuracy of various imputation models across the missingness scenarios. Weights of imputation models are optimized by estimating non-linear functions with regression model that can capture relationships between missingness scenarios and imputation accuracies of models. The final imputed value of the ensemble model for a missing scenario can be determined by multiplying each imputation model's weight by its imputed value, then summing the products. The method inherits the advantages of state-of-art imputation models, including the ability to learn long-term dependencies in time series, as well as the flexibility of using a dynamic weighting strategy to process various missingness scenarios. To validate the superiority of our method, we evaluate on real-world water-quality data from a river in South Korea. The proposed method achieves higher accuracy and lower variation of imputed values than baseline models across various missingness scenarios. Furthermore, we showed the applicability of our method to various hydrological environment by validating our method on industrial water quality dataset. This study highlights the potential value of the ensemble model with dynamic weighting in robust imputation of water-quality data. [Display omitted] [ABSTRACT FROM AUTHOR]

Rebound hardness (RHN) has become a widely applied rock mechanical parameter in the petroleum industry due to economic and convenient testing procedures. However, the RHN data can be under-utilized when lacking detailed integration with other rock properties. Targeting the unconventional "Mississippian Limestone"/STACK play in north-central Oklahoma, USA, and outcrops of the Vaca Muerta Formation in Argentina, this study aims to test the value of RHN in predicting rock properties. RHN data from the "Mississippian Limestone"/STACK cores show correlative trends with mineralogy and porosity. All the correlations show clusters by facies groups with overlaps being present among different clusters. Within these correlations, mineralogy and porosity show variable significance levels in affecting RHN among different facies groups. Leverage analysis suggests that bulk clay content and porosity exhibits the most significant control on RHN for the MISS/STACK data, with variabilities being present in different facies groups. These partitioning patterns of data by facies groups imply that facies variability affects the statistical pattern and that RHN can assist in rock typing, and hence, sample selection for detailed laboratory analyses. Forward regression analysis reveals that the confidence level of predicting porosity and sonic velocity can be enhanced using RHN. In addition to the correlative trends between RHN and rock properties, results from forward regression analysis indicate that RHN can help estimate these properties in a faster, cheaper, and non-destructive way relative to conventional laboratory analyses. Correlative trends are also observed in Vaca Muerta data, suggesting the value of RHN in characterizing similar types of mixed carbonate-siliciclastic reservoirs. • Rebound hardness (RHN) can help estimate bulk clay content, porosity, sonic velocity, and dynamic elastic parameters. • RHN may help estimate static rock mechanical properties, but more data are needed for further investigation. • RHN cluster by facies and thus can help design an integrated rock typing and sample selection scheme. • Multivariate methods indicate RHN is affected by multiple factors and can help apply RHN to predict rock properties. • A facies-based, integrated approach with a well-designed testing protocol is critical for using RHN in reservoir analysis. [ABSTRACT FROM AUTHOR]

We propose a metasurface-based solar absorber design using machine learning. The absorption analysis for two complementary metasurface-based designs is presented. The complementary circular array metasurface design and circular array metasurface design are investigated for visible, infrared, and ultraviolet regions with a wavelength range of 0.2 μm–0.8 μm. The highest average absorption is observed for complementary circular array metasurface design. This design is further investigated for different parameter variations like resonator thickness, SiO 2 height, SiO 2 width, and graphene chemical potential. All these parameter variations and their absorption results are also predicted with machine learning algorithms. Experiments are performed using different degrees of polynomial regression models for predicting the absorption values for missing/intermediate wavelengths. Two test cases R-30 and R-50 are designed to test the regressor models and R2 Score metric is used to test the prediction efficiency of the regressor model. It is observed from the experimental results that, prediction efficiency of more than 0.99 (R2) can be achieved using higher degree polynomial regression models. The proposed metasurface-based solar absorber design can be used for solar energy harvesting applications. • Highly efficient metasurface based solar absorber is designed. • Machine learning approach is used for prediction of absorption for variation in different parameters. • Polynomial regressor is used for predicting the values. • Highest average absorption of 89% is achieved for visible region. • The highest prediction efficiency of 0.99 (R2) is achieved. [ABSTRACT FROM AUTHOR]

Missing observational data pose an unavoidable problem in the hydrological field. Deep learning technology has recently been developing rapidly, and has started to be applied in the hydrological field. Being one of the network architectures used in deep learning, Long Short-Term Memory (LSTM) has been applied largely in related research, such as flood forecasting and discharge prediction, and the performance of an LSTM model has been compared with other deep learning models. Although the tuning of hyperparameters, which influences the performance of an LSTM model, is necessary, no sufficient knowledge has been obtained. In this study, we tuned the hyperparameters of an LSTM model to investigate the influence on the model performance, and tried to obtain a more suitable hyperparameter combination for the imputation of missing discharge data of the Daihachiga River. A traditional method, linear regression with an accuracy of 0.903 in Nash–Sutcliffe Efficiency (NSE), was chosen as the comparison target of the accuracy. The results of most of the trainings that used the discharge data of both neighboring and estimation points had better accuracy than the regression. Imputation of 7 days of the missing period had a minimum value of 0.904 in NSE, and 1 day of the missing period had a lower quartile of 0.922 in NSE. Dropout value indicated a negative correlation with the accuracy. Setting dropout as 0 had the best accuracy, 0.917 in the lower quartile of NSE. When the missing period was 1 day and the number of hidden layers were more than 100, all the compared results had an accuracy of 0.907–0.959 in NSE. Consequently, the case, which used discharge data with backtracked time considering the missing period of 1 day and 7 days and discharge data of adjacent points as input data, indicated better accuracy than other input data combinations. Moreover, the following information is obtained for this LSTM model: 100 hidden layers are better, and dropout and recurrent dropout levels equaling 0 are also better. The obtained optimal combination of hyperparameters exceeded the accuracy of the traditional method of regression analysis. [ABSTRACT FROM AUTHOR]

Digital camera monitoring data on recreational boating traffic are often manually interpreted and the reading cost can be expensive. Typically, these data are used along with other periodic survey information and camera data between these surveys may not be read, creating gaps in the time series. We predicted recreational boating traffic during these 'gap' periods using historical camera data and covariates to complete the time series data. Predictive models were built in a Bayesian regression modelling framework to determine the daily distribution of recreational boating traffic at two ramps in Western Australia based on climatic variables (temperature, humidity, wind speed, direction and gust, and sea level pressure) and some temporal classifications (month and day type). Two observed year-long datasets of boating traffic were used, with a year-long gap between them. One set was used to build models, and the other set was used for validation purposes. Models were developed using leave-one-out cross-validation, and ensemble prediction. Fitted models explained 50% [95% credible interval (CI) of R 2 : 0.40–0.58] and 62% [95% CI of R 2 : 0.58–0.66] of the variabilities in the daily number of boat launches at the two ramps. Subsequently, using data for the preceding period where camera data were read, we imputed plausible estimates for the period between readings. Imputed values generally aligned well with the observed data, with some temporal biases at the bulk and upper tail of the distributions. The 95% credible intervals adequately reflected the observed data at both ramps. Data for the constructed periods depicted the general trends for the observed periods. Our results provide useful insights into using climatic factors to predict boating traffic to 'fill in the gaps' between survey years which could assist in the ongoing monitoring to promote sustainable management of recreational fisheries. • Data on boating traffic often missing in between surveys, creating gaps in time series. • Bayesian regression modelling framework adequately described plausible distribution for missing periods. • Imputed values for missing periods aligned well with data for observed periods. • Relevant auxiliary information can provide support for continuous monitoring of recreational boating traffic. [ABSTRACT FROM AUTHOR]