Search

OBJECTIVE: This study evaluates regularization variants in logistic regression (L1, L2, ElasticNet, Adaptive L1, Adaptive ElasticNet, Broken adaptive ridge [BAR], and Iterative hard thresholding [IHT]) for discrimination and calibration performance, focusing on both internal and external validation. MATERIALS AND METHODS: We use data from 5 US claims and electronic health record databases and develop models for various outcomes in a major depressive disorder patient population. We externally validate all models in the other databases. We use a train-test split of 75%/25% and evaluate performance with discrimination and calibration. Statistical analysis for difference in performance uses Friedmans test and critical difference diagrams. RESULTS: Of the 840 models we develop, L1 and ElasticNet emerge as superior in both internal and external discrimination, with a notable AUC difference. BAR and IHT show the best internal calibration, without a clear external calibration leader. ElasticNet typically has larger model sizes than L1. Methods like IHT and BAR, while slightly less discriminative, significantly reduce model complexity. CONCLUSION: L1 and ElasticNet offer the best discriminative performance in logistic regression for healthcare predictions, maintaining robustness across validations. For simpler, more interpretable models, L0-based methods (IHT and BAR) are advantageous, providing greater parsimony and calibration with fewer features. This study aids in selecting suitable regularization techniques for healthcare prediction models, balancing performance, complexity, and interpretability.

We have previously shown that bilingual Spanish and English-learning infants can segment English iambs, two-syllable words with final stress (e.g., guiTAR), earlier than their monolingual peers. This is consistent with accelerated development in bilinguals and was attributed to bilingual infants' increased exposure to iambs through Spanish; about 10% of English content words start with an unstressed syllable, compared to 40% in Spanish. Here, we evaluated whether increased exposure to a stress pattern alone is sufficient to account for acceleration in bilingual infants. In English, 90% of content words start with a stressed syllable (e.g., KINGdom), compared to 60% in Spanish. However, we found no evidence for accelerated segmentation of Spanish trochees by Spanish-English bilingual infants compared to their monolingual Spanish-learning peers. Based on this finding, we argue that merely increased exposure to a linguistic feature in one language does not result in accelerated development in the other. Instead, only the acquisition of infrequent patterns in one language may be accelerated due to the additive effects of the other language.

Summary: In this article we deal with the problem of determining a non‐homogeneous N$$ N $$‐valued heat conductivity profile in a steady‐state heat conduction boundary‐value problem with mixed Dirichlet‐Neumann boundary conditions over a bounded domain in ℝn$$ {\mathbb{R}}^n $$, from the knowledge of the temperature field over the whole domain. In a previous work we developed a method based on a variational approach of the PDE leading to an optimality equation which is then projected into a finite dimensional space. Discretization of the optimality equation then yields a linear although severely ill‐posed equation which is then regularized via appropriate ad‐hoc penalizers based upon a‐priori information about the conductivities of all materials present. This process results in a generalized Tikhonov‐Phillips functional whose global minimizer yields our approximate solution to the inverse problem. In our previous work we showed that this approach yields quite satisfactory results in the cases of two different conductivities. We considered here an appropriate extension of that approach for the N$$ N $$ materials case and show a few numerical examples for the case N=3$$ N=3 $$ in which the method is able to produce very good reconstructions of the exact solution. [ABSTRACT FROM AUTHOR]

We consider the inverse conductivity problem with discontinuous conductivities. We show in a rigorous way, by a convergence analysis, that one can construct a completely discrete minimization problem whose solution is a good approximation of a solution to the inverse problem. The minimization problem contains a regularization term which is given by a total variation penalization and is characterized by a regularization parameter. The discretization involves at the same time the boundary measurements, by the use of the complete electrode model, the unknown conductivity and the solution to the direct problem. The electrodes are characterized by a parameter related to their size, which in turn controls the number of electrodes to be used. The discretization of the unknown and of the solution to the direct problem is characterized by another parameter related to the size of the mesh involved. In our analysis we show how to precisely choose the regularization, electrodes size and mesh size parameters with respect to the noise level in such a way that the solution to the discrete regularized problem is meaningful. In particular we obtain that the electrodes and mesh size parameters should decay polynomially with respect to the noise level. [ABSTRACT FROM AUTHOR]

In the presence of spacetime torsion, the momentum components do not commute; therefore, in quantum field theory, summation over the momentum eigenvalues will replace integration over the momentum. In the Einstein–Cartan theory of gravity, in which torsion is coupled to spin, the separation between the eigenvalues increases with the magnitude of the momentum. Consequently, this replacement regularizes divergent integrals in Feynman diagrams with loops by turning them into convergent sums. In this article, we apply torsional regularization to the self-energy of a charged lepton in quantum electrodynamics. We show that torsion eliminates the ultraviolet divergence of the standard self-energy. We also show that the infrared divergence is absent. In the end, we calculate the finite bare masses of the electron, muon, and tau lepton: 0.4329 MeV , 90.95 MeV , and 1543 MeV , respectively. These values constitute about 85% of the observed, re-normalized masses. [ABSTRACT FROM AUTHOR]

This article is devoted to solving a backward problem for general nonlinear parabolic equations in Sobolev spaces. The problem is hardly solved by computation since it is severely ill‐posed in Hadamard's sense. Using the Fourier transform and the truncation of high‐frequency components, we construct a regularized solution for the problem from the data given inexactly. As usual for ill‐posed problems, the rate of convergence can be obtained under additional smoothness assumptions on the regularity of the exact solution, the so‐called source conditions. By using a source condition in a generalized form, we prove a convergence estimate in a Sobolev space Hq(ℝn)$$ {H}^q\left({\mathrm{\mathbb{R}}}^n\right) $$. Corresponding to different levels of the source condition, the convergence rates are improved gradually. We apply our theory to the backward problem with a convection–diffusion operator and a cubic nonlinearity. Finally, the numerical results are presented to test the validity of the proposed regularization method. [ABSTRACT FROM AUTHOR]

Results on continuous dependence on parameters, as well as on regularization, of solutions to linear systems of parabolic partial differential equations of second order with delay are given. One of the main features is that the topology on the zero order and delay coefficients is the weak-* topology on an L ∞ space, whereas the assumptions on the second- and first-order coefficients are slightly stronger. This is important in the context of generation of linear skew-product dynamical systems by such equations. [ABSTRACT FROM AUTHOR]

We consider a nonsmooth nonlinear system governed by a set-valued maximal monotone operator in Hilbert spaces. The novelty brought by our study is the involvement of the Caputo fractional derivative. In our paper, we aim to achieve three primary objectives. The first one is to show how a reduction approach with fractional differential equations allows us to establish the unique solvability of the initial value problem and give some important properties of the solution as the continuous dependence with respect to the data. The second objective is to prove the existence of optimal solution to an optimal control problem involving the nonsmooth fractional dynamical system in finite dimensions. The third aim is to put into practice our obtained results in the analysis of a non-regular electrical circuit, including a non-regular electronic component such as a Zener diode, as well as a fractional inductor. This application constitutes an additional contribution to our paper. [ABSTRACT FROM AUTHOR]

This paper investigates evolutionary quasi-variational inequalities that involve multi-valued monotone and pseudo-monotone maps. The purpose of including the pseudo-monotone map is to encompass generalized derivatives of certain nonconvex locally Lipschitz functionals as a specific instance. Consequently, the considered evolutionary quasi-variational inequalities subsume evolutionary quasi-hemi-variational inequalities as a particular case. We present an existence result wherein the key novelty lies in the variational selection that separates the monotone and pseudo-monotone components, thus eliminating the conventional assumption that their sum is monotone. While we continue to employ the Minty formulation, its necessity is limited to evolutionary monotone variational inequalities alone. Furthermore, we offer new applications to optimal control problems governed by evolutionary quasi-variational inequalities. [ABSTRACT FROM AUTHOR]

This paper deals with the problem of identification of a Robin coefficient (also known as impedance coefficient) in a parabolic PDE from terminal observations of the temperature distributions. The problem is ill-posed in the sense that small perturbation in the observation may lead to a large deviation in the solution. Thus, in order to obtain stable approximations, we employ the Tikhonov-regularization. We propose a weak source condition motivated by the work of Engl and Zou (2000) and obtain a convergence rate of O (δ 1 2) , where δ is the noise level of the observed data. The obtained rate is better than some of the previous known rates. Moreover, the advantage of the proposed source condition is that the above mentioned convergence rate is obtained without the need for characterizing the range space of modelling operator and its Fréchet derivative, which is in contrast to the general convergence theory of Tikhonov-regularization for non linear operators. [ABSTRACT FROM AUTHOR]

Feature importance is an important technique of solving the pattern of prediction and the regression tasks. There is no need to train the model with all the features in the dataset. Minimizing the features reduces the load during the prediction phase. This study proposes an improved regularisation technique to reduce the error and solve the over fitting issues to identify the relative importance of features. The more important feature the more weight and connected to the corresponding input neurons during the training of the deep learning model. We compared the proposed with seven state of the art feature importance techniques on different data sets. The proposed regularisation function outperforms the other state of the art feature importance techniques. The Proposed Approach achieves superior performance metrics with an accuracy of 93.78%.This method stands out due to its ability to deliver highly accurate, precise, and comprehensive results, reflecting its advanced regularization and dynamic updates. Its exceptional performance underscores its effectiveness in refining feature importance and enhancing model interpretability. [ABSTRACT FROM AUTHOR]

Despite considerable achievements of deep learning-based side-channel analysis, overfitting represents a significant obstacle in finding optimized neural network models. This issue is not unique to the side-channel domain. Regularization techniques are popular solutions to overfitting and have long been used in various domains. At the same time, the works in the side-channel domain show sporadic utilization of regularization techniques. What is more, no systematic study investigates these techniques' effectiveness. In this paper, we aim to investigate the regularization effectiveness on a randomly selected model, by applying 4 powerful and easy-to-use regularization techniques to 8 combinations of datasets, leakage models, and deep learning topologies. The investigated techniques are L 1 , L 2 , dropout, and early stopping. Our results show that while all these techniques can improve performance in many cases, L 1 and L 2 are the most effective. Finally, if training time matters, early stopping is the best technique. [ABSTRACT FROM AUTHOR]

Let X be a reduced complex space of pure dimension. We consider divergent integrals of certain forms on X that are singular along a subvariety defined by the zero set of a holomorphic section of some holomorphic vector bundle E → X . Given a choice of Hermitian metric on E we define a finite part of the divergent integral. Our main result is an explicit formula for the dependence on the choice of metric of the finite part. [ABSTRACT FROM AUTHOR]

Copyright of Reviews of Geophysics & Planetary Physics is the property of Editorial Office of Reviews of Geophysics & Planetary Physics and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

We consider the stability of bound‐state solutions of a family of regularized nonlinear Schrödinger equations which were introduced by Dumas et al. as models for the propagation of laser beams. Among these bound‐state solutions are ground states, which are defined as solutions of a variational problem. We give a sufficient condition for existence and orbital stability of ground states, and use it to verify that ground states exist and are stable over a wider range of nonlinearities than for the nonregularized nonlinear Schrödinger equation. We also give another sufficient and almost necessary condition for stability of general bound states, and show that some stable bound states exist which are not ground states. [ABSTRACT FROM AUTHOR]

This article proposes penalized Mallow's model averaging (pMMA) in the linear regression framework given non nested candidate models. Compared to the MMA, additional constraints are imposed on model weights. We introduce a general framework and allow for non convex constraints such as SCAD, MCP, and TLP. We establish the asymptotic optimality of our proposed penalized MMA (pMMA) estimator and show that the pMMA can achieve a higher sparsity level than the classic MMA. A coordinate-wise descent algorithm has been developed to compute the pMMA estimator efficiently. We conduct simulation and empirical studies to show that our pMMA estimator produces a more sparse weight vector than the MMA, but with better out-of-sample performance. [ABSTRACT FROM AUTHOR]

New epidemics encourage the development of new mathematical models of the spread and forecasting of infectious diseases. Statistical epidemiology data are characterized by incomplete and inexact time series, which leads to an unstable and non-unique forecasting of infectious diseases. In this paper, a model of a conditional generative adversarial neural network (CGAN) for modeling and forecasting COVID-19 in St. Petersburg is constructed. It takes 20 processed historical statistics as a condition and is based on the solution of the minimax problem. The CGAN builds a short-term forecast of the number of newly diagnosed COVID-19 cases in the region for 5 days ahead. The CGAN approach allows modeling the distribution of statistical data, which allows obtaining the required amount of training data from the resulting distribution. When comparing the forecasting results with the classical differential SEIR-HCD model and a recurrent neural network with the same input parameters, it was shown that the forecast errors of all three models are in the same range. It is shown that the prediction error of the bagging model based on three models is lower than the results of each model separately. [ABSTRACT FROM AUTHOR]

In the face of escalating threats to Armenian cultural heritage in Artsakh due to armed conflicts and destruction, urgent measures are imperative to safeguard this invaluable legacy. The Digital Humanities Institute at the EPFL (École polytechnique fédérale de Lausanne, Switzerland) is leading an effort to digitize the Armenian epigraphic heritage in Artsakh, where inscriptions and toponyms serve as cultural identifiers. Documenting endangered inscriptions and using the , and tags safeguard historical integrity. Integrating GeoNames and Pleiades enhances accessibility and accuracy, bridging perspectives and preserving heritage. The project's bilingual nature amplifies complexity, as English and Armenian representations are layered with intricate grammar nuances. Lemmatization and regularization ensure consistent proper names, particularly across diverse grammatical cases. In a landscape where cultural heritage preservation is needed, the marriage of external resources, Armenian toponyms, lemmatization and regularization ensures historical accuracy and accessibility. This academic set-up clarifies the methodologies and standards used, emphasizing the preservation of Armenian cultural heritage through digital epigraphy. The set-up of the corpus allows for future enrichment by incorporating additional inscriptions, more detailed historical background information and etymological clarifications about the toponyms. This flexibility ensures that the corpus can continue to grow and provide comprehensive insights into the cultural heritage of Artsakh. [ABSTRACT FROM AUTHOR]

We study symmetric periodic orbits near collision in a nonautonomous restricted planar four-body problem. The restricted problem consists of a massless particle moving under the gravitational influence due to three bodies with the same positive mass (the primaries), following the figure-eight choreography. We use regularized coordinates, in order to deal numerically with motions near collision between the massless particle and one of the primaries. By means of reversing symmetries, we characterize the symmetric periodic orbits near collision. The initial conditions for these orbits were computed by solving numerically some boundary value problems. We explain theoretically, and confirm numerically, how different parts of the diagram of initial conditions are related due to the symmetry of the figure-eight choreography. [ABSTRACT FROM AUTHOR]

How to improve discriminative feature learning is central in classification. Existing works address this problem by explicitly increasing inter-class separability and intra-class compactness by constructing positive and negative pairs for contrastive learning or posing tighter class separating margins. These methods do not exploit the similarity between different classes as they adhere to independent identical distributions assumption in data. In this paper, we embrace the real-world data distribution setting in that some classes share semantic overlaps due to their similar appearances or concepts. Regarding this hypothesis, we propose a novel regularization to improve discriminative learning. We first calibrate the estimated highest likelihood of one sample based on its semantically neighboring classes, then encourage the overall likelihood predictions to be deterministic by imposing an adaptive exponential penalty. As the gradient of the proposed method is roughly proportional to the uncertainty of the predicted likelihoods, we name it adaptive discriminative regularization (ADR), trained along with a standard cross entropy loss in classification. Extensive experiments demonstrate that it can yield consistent and non-trivial performance improvements in a variety of visual classification tasks (over 10 benchmarks). Furthermore, we find it is robust to long-tailed and noisy label data distribution. Its flexible design enables its compatibility with mainstream classification architectures and losses. [ABSTRACT FROM AUTHOR]

A controlled system of differential equations under the action of an unknown disturbance is considered. The problem discussed in the paper consists in constructing algorithms for forming a control that provides the realization of a prescribed motion for any admissible disturbance. Namely these algorithms should provide the closeness in the metric of the space of differentiable functions of a phase trajectory of a given controlled system and some etalon trajectory of an analogous system functioning when any outer actions are absent. As the space of admissible disturbances, we take the space of measurable square integrable (with respect to the Euclidean norm) functions. The cases of inaccurate measurements of phase trajectories of both systems at all times and at discrete times are under study. Two computer oriented algorithms for solving the problem are designed. The algorithms are based on the (well-known in the theory of guaranteed control) method of extremal shift. In the process, its local (at each time of control correction) regularization is performed by the method of smoothing functional (the Tikhonov method). In addition, estimates for algorithm's convergence rate are presented. [ABSTRACT FROM AUTHOR]

The aim of this paper is to improve the parameter estimation accuracy of the system to be identified by using measurements from a known system. By introducing the transfer gain matrix and setting the effective identification criterion, a novel transfer sparse identification method is raised, which deals with the sparse issues more precise. Besides, the unbiased form is given in the parameter analysis and the recursion form can prevent the dimension catastrophe related problems. Moreover, in order to test the effects of the transfer and avoid bad performance, a negative transfer analysis condition is carried out. Finally, the simulation verifies the enhancements and benefits of the proposed transfer sparse identification method, confirming that the transfer performance outperforms better than that of no transfer, especially on the zero parameters identification. [ABSTRACT FROM AUTHOR]

In this paper, we propose a general distributionally robust regression model based on distributionally robust optimization theory. The proposed model has a piecewise linear loss function and elastic net penalty term, and it generalizes many other regression models. We prove the piecewise linear property of the optimal solutions to this model, which enables us to develop a solution path algorithm for the hyperparameter tuning. A Doubly regularized Least Absolute Deviations (DrLAD) regression model is proposed based on this framework, and a solution path algorithm is developed to speed up the tuning of two hyperparameters in this model. Numerical experiments are implemented to validate the performance of this model and the computational efficiency of the solution path algorithm. [ABSTRACT FROM AUTHOR]

One of the most important needs in neuroimaging is brain dynamic source imaging with high spatial and temporal resolution. EEG source imaging estimates the underlying sources from EEG recordings, which provides enhanced spatial resolution with intrinsically high temporal resolution. To ensure identifiability in the underdetermined source reconstruction problem, constraints on EEG sources are essential. This paper introduces a novel method for estimating source activities based on spatio-temporal constraints and a dynamic source imaging algorithm. The method enhances time resolution by incorporating temporal evolution of neural activity into a regularization function. Additionally, two spatial regularization constraints based on L 1 and L 2 norms are applied in the transformed domain to address both focal and spread neural activities, achieved through spatial gradient and Laplacian transform. Performance evaluation, conducted quantitatively using synthetic datasets, discusses the influence of parameters such as source extent, number of sources, correlation level, and SNR level on temporal and spatial metrics. Results demonstrate that the proposed method provides superior spatial and temporal reconstructions compared to state-of-the-art inverse solutions including STRAPS, sLORETA, SBL, dSPM, and MxNE. This improvement is attributed to the simultaneous integration of transformed spatial and temporal constraints. When applied to a real auditory ERP dataset, our algorithm accurately reconstructs brain source time series and locations, effectively identifying the origins of auditory evoked potentials. In conclusion, our proposed method with spatio-temporal constraints outperforms the state-of-the-art algorithms in estimating source distribution and time courses. [ABSTRACT FROM AUTHOR]

The problem of maximizing the range of a propeller-driven aircraft in a level flight cruise is analyzed within the framework of optimal control. The specific fuel consumption and propeller efficiency of its propulsive system are characterized by functions of the velocity and engine power (full model), in contrast to previous works, where they were considered to be constant. To conduct the study, a notional Piper Cherokee PA-28 is selected as representative of light aircraft, defining both the airplane and mission features. Two simplified models are also derived: the Von Mises model, with constant specific fuel consumption and propeller efficiency, and the Parget and Ardema model, defined by constant specific fuel consumption and propeller efficiency depending on the velocity. The problem is solved numerically by means of a direct transcription method. Since the optimal problems of the Von Mises and Parget and Ardema models are singular, it is necessary to incorporate a regularization term. Such a numerical algorithm is validated against the analytical solution given by the Breguet formulation. In this context, the velocity and mass (state variables), the power throttle (control), and the best range are determined. The full model provides a maximum range of 1492 km. The differences between the Von Mises and Parget and Ardema models are about 24 km and 1 km, respectively. A non-optimal steady cruise is also analyzed, providing a significant reduction in the flight time, with a decrease of about 2% of the range. The evolution of the state variables and control in the steady cruise, however, separates from the full model. On the other hand, the Parget and Ardema model almost reproduces the full model results, leading to a clear image of the physics involved: the best range comes from maximizing the product of the propeller and aerodynamic efficiencies with respect to the velocity, which determines the optimal arc. [ABSTRACT FROM AUTHOR]

The Tsetlin Machine (TM) is a novel machine learning approach that implements propositional logic to perform various tasks such as classification and regression. The TM not only achieves competitive accuracy in these tasks but also provides results that are explainable and easy to implement using simple hardware. The TM learns using clauses based on the features of the data, and final classification is done using a combination of these clauses. In this paper, we propose the novel idea of adding regularizers to the TM, referred to as Regularized TM (RegTM), to improve generalization. Regularizers have been widely used in machine learning to enhance accuracy. We explore different regularization strategies and their influence on performance. We demonstrate the feasibility of our methodology through various experiments on benchmark datasets. [ABSTRACT FROM AUTHOR]

This study employs a two-dimensional and incompressible flow of Herschel–Bulkley visco-plastic materials in order to investigate the hydrodynamic forces that are acting on a barrier that is located close to the inlet of a channel. As the benchmark configuration, the flow domain that has been selected is a channel that still contains the impediment. The two important parameters of the Herschel–Bulkley Model (HBM) are the yield stress τ y and power law index n. Obtaining special situations within the HBM, such as Newtonian, power-law, and Bingham fluids, can be accomplished by assigning certain values to these parameters at the appropriate times. Utilizing a numerical strategy grounded in the Finite Element Method (FEM), we tackle the nonlinearity of the governing equations as well as the viscosity models. As a result of this nonlinearity, FEM becomes an essential tool. The generation of a refined hybrid mesh is done in order to guarantee accuracy in the computations. The stable finite element pair ( ℙ 2 ∕ ℙ 1 ) has been selected for discretization purposes. The discretized nonlinear system is linearized with Newton's method and subsequently, a direct linear solver PARDISO has been employed in the inner iterations. The pressure, velocity, and viscosity profiles are plotted for various values of n and Bingham number (Bn). In addition, the velocity behavior is observed along the y-direction in a channel through line graphs. Code validation is done as a special case Bn = 0 and a good agreement is found with the results available in the literature. Finally, a correlation analysis has been performed for the drag coefficient C d and lift coefficient C l . [ABSTRACT FROM AUTHOR]

Over the past few years, there has been a surge in research attention towards tasks involving graph data, largely due to the impressive performance demonstrated by graph neural networks (GNNs) in handling such information. Currently, out-of-distribution (OOD) detection in graphs is a hot research topic. The goal of graph OOD detection is to identify nodes or new graphs that differ from the training data distribution, primarily in terms of attributes and structures. OOD detection is crucial for enhancing the stability, security, and robustness of models. In various applications, such as biological networks and financial fraud, graph OOD detection can help models identify anomalies or unforeseen situations, thereby enabling appropriate responses. In node-level OOD detection, existing models typically only consider first-order neighbors. This paper introduces graph diffusion to the OOD detection task for the first time, proposing the HOOD model, a graph diffusion-based OOD node detection algorithm. Specifically, the original graph is processed through graph diffusion to obtain a new graph that can directly capture high-order neighbor information, overcoming the limitation that message passing must go through first-order neighbors. The new graph is then sparsified using a top-k approach. Based on entropy information, regularization is employed to ensure the uncertainty of OOD nodes, thereby giving these nodes higher scores and enabling the model to effectively detect OOD nodes while ensuring the accuracy of in-distribution node classification. Experimental results demonstrate that the HOOD model outperforms existing methods in both node classification and OOD detection tasks on multiple benchmarks, highlighting its robustness and effectiveness. [ABSTRACT FROM AUTHOR]

Count regression models, particularly negative binomial regression (NBR), are widely used in various fields, including biometrics, ecology, and insurance. Over-dispersion is likely when dealing with count data, and NBR has gained attention as an effective tool to address this challenge. However, multicollinearity among covariates and the presence of outliers can lead to inflated confidence intervals and inaccurate predictions in the model. This study proposes a comprehensive approach integrating robust and regularization techniques to handle the simultaneous impact of multicollinearity and outliers in the negative binomial regression model (NBRM). We investigate the estimators' performance through extensive simulation studies and provide analytical comparisons. The simulation results and the theoretical comparisons demonstrate the superiority of the proposed robust hybrid KL estimator (M-NBKLE) with predictive accuracy and stability when multicollinearity and outliers exist. We illustrate the application of our methodology by analyzing a forestry dataset. Our findings complement and reinforce the simulation and theoretical results. [ABSTRACT FROM AUTHOR]

The primary goal of this article is to extend the reciprocal LASSO for applications to binary and survival outcomes. We consider the least squares approximation (LSA) as a solver for the reciprocal LASSO problem. The LSA is a general theoretical framework that includes generalized linear models, Cox regression, and many others as special cases. By applying LSA to reciprocal LASSO regularization, we transfer the original reciprocal LASSO problem into an asymptotically equivalent least squares problem. While the existing literature on reciprocal LASSO has mostly focused on linear models, our algorithm can be easily implemented for general likelihoods, providing a flexible framework for variable selection using reciprocal penalties. To handle the computational burden of implementing the resulting procedure, we employ a scalable stochastic search method called Simplified Shotgun Stochastic Search with Screening (S5), which is easy to implement, without requiring any sophisticated optimization package other than a linear equation solver. We examine the effectiveness of our procedure through Monte Carlo simulations and real data analyses. [ABSTRACT FROM AUTHOR]

This article addresses the deconvolution problem of estimating a square-integrable probability density from observations contaminated with additive measurement errors having a known density. The estimator begins with a density estimate of the contaminated observations and minimizes a reconstruction error penalized by an integrated squared mth derivative. Theory for deconvolution has mainly focused on kernel- or wavelet-based techniques, but other methods including spline-based techniques and this smoothness-penalized estimator have been found to outperform kernel methods in simulation studies. This article fills in some of these gaps by establishing asymptotic guarantees for the smoothness-penalized approach. Consistency is established in mean integrated squared error, and rates of convergence are derived for Gaussian, Cauchy, and Laplace error densities, attaining some lower bounds already in the literature. The assumptions are weak for most results; the estimator can be used with a broader class of error densities than the deconvoluting kernel. Our application example estimates the density of the mean cytotoxicity of certain bacterial isolates under random sampling; this mean cytotoxicity can only be measured experimentally with additive error, leading to the deconvolution problem. We also describe a method for approximating the solution by a cubic spline, which reduces to a quadratic program. for this article are available online. [ABSTRACT FROM AUTHOR]

Copyright of Journal of Guangdong University of Technology is the property of Journal of Guangdong University of Technology and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Purpose: To improve image quality, mitigate quantification biases and variations for free‐breathing liver proton density fat fraction (PDFF) and R2*$$ {\mathrm{R}}_2^{\ast } $$ quantification accelerated by radial k‐space undersampling. Methods: A free‐breathing multi‐echo stack‐of‐radial MRI method was developed with compressed sensing with multidimensional regularization. It was validated in motion phantoms with reference acquisitions without motion and in 11 subjects (6 patients with nonalcoholic fatty liver disease) with reference breath‐hold Cartesian acquisitions. Images, PDFF, and R2*$$ {\mathrm{R}}_2^{\ast } $$ maps were reconstructed using different radial view k‐space sampling factors and reconstruction settings. Results were compared with reference‐standard results using Bland–Altman analysis. Using linear mixed‐effects model fitting (p < 0.05 considered significant), mean and SD were evaluated for biases and variations of PDFF and R2*$$ {\mathrm{R}}_2^{\ast } $$, respectively, and coefficient of variation on the first echo image was evaluated as a surrogate for image quality. Results: Using the empirically determined optimal sampling factor of 0.25 in the accelerated in vivo protocols, mean differences and limits of agreement for the proposed method were [−0.5; −33.6, 32.7] s−1 for R2*$$ {\mathrm{R}}_2^{\ast } $$ and [−1.0%; −5.8%, 3.8%] for PDFF, close to those of a previous self‐gating method using fully sampled radial views: [−0.1; −27.1, 27.0] s−1 for R2*$$ {\mathrm{R}}_2^{\ast } $$ and [−0.4%; −4.5%, 3.7%] for PDFF. The proposed method had significantly lower coefficient of variation than other methods (p < 0.001). Effective acquisition time of 64 s or 59 s was achieved, compared with 171 s or 153 s for two baseline protocols with different radial views corresponding to sampling factor of 1.0. Conclusion: This proposed method may allow accelerated free‐breathing liver PDFF and R2*$$ {\mathrm{R}}_2^{\ast } $$ mapping with reduced biases and variations. [ABSTRACT FROM AUTHOR]

This study examines the planning challenges and opportunities in conserving national trails, focusing on the Israel National Trail. National trails offer crucial benefits, including health promotion, social connectivity, cultural education, ecological conservation, and economic growth. Despite their value, these trails face sustainability challenges from environmental impacts, resource constraints, and competing interests, often exacerbated by weak statutory protections. Using a case study approach, this study analyzes three decades of case law and planning committee decisions, uncovering real-life conflicts and challenges in trail conservation. This study uncovers issues like difficulties in preserving the trail's national identity, risks of route diversions, failure to realize ecological and economic potential, and inefficiencies in planning due to a lack of statutory footing. This study contributes to the emerging field of national trail research by proposing a retrospective methodology for identifying sustainability challenges based on practical realities and by emphasizing the need for comprehensive and transparent planning to ensure the sustainable future of national trails. Legal case studies prove to be a valuable tool for identifying conservation challenges and a significant database for developing a sustainable planning strategy. This methodology serves as a useful and globally relevant tool. [ABSTRACT FROM AUTHOR]

The paper aims to propose a two-step iterated method, which is derived from a regularized dynamical system of extragradient-type in terms of time discretizing, for solving an equilibrium problem. We prove that the iterative sequence generated by the method converges strongly to a solution of the equilibrium problem. Some numerical experiments are given to illustrate and compare the behavior of the new method with several other methods. [ABSTRACT FROM AUTHOR]

Semantic nuclei segmentation is a challenging area of computer vision. Accurate nuclei segmentation can help medics in diagnosing many diseases. Automatic nuclei segmentation can help medics in diagnosing many diseases such as cancer by providing automatic tissue analysis. Deep learning algorithms allow automatic feature extraction from medical images, however, hematoxylin and eosin (H&E) stained images are challenging due to variability in staining and textures. Using pre-trained models in deep learning speeds up development and improves their performance. This paper compares Deeplabv3+ and U-Net deep learning methods with the pre-trained models ResNet-50 and EfficientNetB4 embedded in their architecture. In addition, different regularization and dropout parameters are applied to prevent overtraining. The experiment was conducted on the PanNuke dataset consisting of nearly 8,000 histological images and annotated nuclei. As a result, the ResNet50-based DeepLabV3+ model with L2 regularization of 0.02 and dropout of 0.7 showed efficiency with dice coefficient (DCS) of 0.8356, intersection over union (IOU) of 0.7280, and loss of 0.3212 on the test set. [ABSTRACT FROM AUTHOR]

Waste generation has seen a significant surge in the last decade, presenting an urgent need for efficient and sustainable waste management strategies. The mounting piles of landfill waste underscore the criticality of segregating recyclable from non-recyclable waste, a measure that could alleviate numerous global environmental challenges. The increasing necessity to differentiate waste into specific categories such as paper, plastic, and metal is becoming evident; these categories demand distinct disposal and recycling methods. Addressing this automatic detection and segregation issue calls for an automated garbage classification system, achievable through computer vision. This paper introduces a deep learning and computer vision-based Smart Ensembled Framework for Waste Management (SEFWaM) to categorize garbage into various classes for improved waste management. This innovative model employs a fusion of transfer learning—a deep learning technique and boosting to devise an ensembled approach for efficient waste classification. Our proposed approach, trained on the Trashnet 2.0 dataset, has demonstrated superior performance over competing algorithms in terms of Weighted Macro Precision (WMP), Weighted Macro Recall (WMR), Weighted Macro F1-Score (WMF), and test accuracy. The proposed SEFWaM model achieves an accuracy of 94.2% for the considered dataset, proving its superior efficiency over other deep learning-based models. This research thereby contributes to a pressing environmental issue by offering an automated, efficient solution for waste management. [ABSTRACT FROM AUTHOR]

Deep neural networks (DNNs) are prominent in predictive analytics for accurately forecasting target variables. However, inherent uncertainties necessitate constructing prediction intervals for reliability. The existing literature often lacks practical methodologies for creating predictive intervals, especially for time series with trends and seasonal patterns. This paper explicitly details a practical approach integrating dual-output Monte Carlo Dropout (MCDO) with DNNs to approximate predictive means and variances within a Bayesian framework, enabling forecast interval construction. The dual-output architecture employs a custom loss function, combining mean squared error with Softplus-derived predictive variance, ensuring non-negative variance values. Hyperparameter optimization is performed through a grid search exploring activation functions, dropout rates, epochs, and batch sizes. Empirical distributions of predictive means and variances from the MCDO demonstrate the results of the dual-output MCDO DNNs. The proposed method achieves a significant improvement in forecast accuracy, with an RMSE reduction of about 10% compared to the seasonal autoregressive integrated moving average model. Additionally, the method provides more reliable forecast intervals, as evidenced by a higher coverage proportion and narrower interval widths. A case study on Thailand's durian export data showcases the method's utility and applicability to other datasets with trends and/or seasonal components. [ABSTRACT FROM AUTHOR]

Earth's magnetic field is generated through the dynamo action in the liquid outer core. Using observational data from geomagnetic satellites and observatories, we can construct geomagnetic models that describe spatial and temporal variations of the core field. Due to the limited temporal and spatial resolution of observations and incomplete parameterization of the model, the inversion problem of geomagnetic field modeling is non-unique. Therefore, we need to incorporate regularization constraints based on prior information to alleviate the non-uniqueness of the inversion problem for geomagnetic modeling. For the core field, the non-uniqueness of modeling inversion manifests in the temporal variations of the field. Studies on the influence of regularization can help us build more reliable core field models, especially on how to suppress artificial secular variations through regularizations. In this study, we construct a series of models based on different regularization parameters within the framework of CHAOS modeling to explore the impact of regularization on the core field modeling. Our results indicate that it is necessary to use regularization constraints for the core field modeling based solely on satellite data. By comparing models with different regularization intensities of the third time derivative of the core field, we show that regularization of the third time derivative with appropriate intensity can effectively suppress artificial signals caused by overfitting of the model to observational data. However, too strong regularizations will reduce the temporal resolution of small-scale secular variations.

In this work, we introduce a novel two-point Landweber-type method to solve the non-smooth ill-posed problems in Banach spaces. The method comprises of inner solvers and two-point acceleration strategy based on iteratively regularized Landweber iteration method. With respect to penalty terms in every step, we use inner solvers to solve certain minimization problems. However, if the minimization problems are explicitly solvable, the inner solvers are same as the exact solvers. The design of the method is such that it allows various types of noises in the given data of non-smooth inverse problems. We study the convergence analysis of our method along with the convergence rates and error estimates by using the standard assumptions that hold without the reflexivity of the image space and G âteaux differentiability of the forward operator. We highlight that this paper is the first advancement in the direction of deducing the convergence rates of a two-point Landweber method. Finally, we present the numerical simulations to show the practicality of the method. [ABSTRACT FROM AUTHOR]

To enhance the accuracy of breast cancer diagnosis, current practices rely on biopsies and microscopic examinations. However, this approach is known for being time-consuming, tedious, and costly. While convolutional neural networks (CNNs) have shown promise for their efficiency and high accuracy, training them effectively becomes challenging in real-world learning scenarios such as class imbalance, small-scale datasets, and label noises. Angular margin-based softmax losses, which concentrate on the angle between features and classifiers embedded in cosine similarity at the classification layer, aim to regulate feature representation learning. Nevertheless, the cosine similarity’s lack of a heavy tail impedes its ability to compactly regulate intra-class feature distribution, limiting generalization performance. Moreover, these losses are constrained to target classes when margin penalties are applied, which may not always optimize effectiveness. Addressing these hurdles, we introduce an innovative approach termed MF-BAM (Mises-Fisher Similarity-based Boosted Additive Angular Margin Loss), which extends beyond traditional cosine similarity and is anchored in the von Mises-Fisher distribution. MF-BAM not only penalizes the angle between deep features and their corresponding target class weights but also considers angles between deep features and weights associated with non-target classes. Through extensive experimentation on the BreaKHis dataset, MF-BAM achieves outstanding accuracies of 99.92%, 99.96%, 100.00%, and 98.05% for magnification levels of ×40, ×100, ×200, and ×400, respectively. Furthermore, additional experiments conducted on the BACH dataset for breast cancer classification, as well as on the LFW and YTF datasets for face recognition, affirm the generalization capability of our proposed loss function. [ABSTRACT FROM AUTHOR]

Deep neural networks (DNNs) are prominent in predictive analytics for accurately forecasting target variables. However, inherent uncertainties necessitate constructing prediction intervals for reliability. The existing literature often lacks practical methodologies for creating predictive intervals, especially for time series with trends and seasonal patterns. This paper explicitly details a practical approach integrating dual-output Monte Carlo Dropout (MCDO) with DNNs to approximate predictive means and variances within a Bayesian framework, enabling forecast interval construction. The dual-output architecture employs a custom loss function, combining mean squared error with Softplus-derived predictive variance, ensuring non-negative variance values. Hyperparameter optimization is performed through a grid search exploring activation functions, dropout rates, epochs, and batch sizes. Empirical distributions of predictive means and variances from the MCDO demonstrate the results of the dual-output MCDO DNNs. The proposed method achieves a significant improvement in forecast accuracy, with an RMSE reduction of about 10% compared to the seasonal autoregressive integrated moving average model. Additionally, the method provides more reliable forecast intervals, as evidenced by a higher coverage proportion and narrower interval widths. A case study on Thailand’s durian export data showcases the method’s utility and applicability to other datasets with trends and/or seasonal components.

Global in time weak solution to a regularized periodic three-dimensional Boussinesq system is proved to exist in energy spaces. This solution depends continuously on the initial data. In particular, it is unique. The main novelty is the global in time aspect of this solution. The proofs use the coupling between the temperature and the velocity of the fluid, energy methods, and compactness argument.

Aiming at the problem of poor generalization ability in hand-crafted architectures that overly rely on expert experience, a neural network architecture search method with an adaptive smoothness strategy was proposed. Firstly, an improved candidate operation selection strategy and a continuous relaxation method were used to convert discrete search space into continuous space, and a weight-sharing mechanism was employed to enhance search efficiency. Secondly, a regularization operation with an adaptive smoothness strategy was added to the loss function, whose smoothness degree was controlled by a temperature parameter. Finally, the loss function was calculated using an exponential normalization method to avoid loss value overflow. Experimental results on 3D point cloud datasets and protein-protein interaction datasets showed that the proposed method achieved higher classification accuracy and more stable performance under the same training samples and iterations.

Abstract A new method for estimating the first and second derivatives of discrete audio signals intended to achieve higher computational precision in analyzing the performance and characteristics of digital audio systems is presented. The method could find numerous applications in modeling nonlinear audio circuit systems, e.g., for audio synthesis and creating audio effects, music recognition and classification, time-frequency analysis based on nonstationary audio signal decomposition, audio steganalysis and digital audio authentication or audio feature extraction methods. The proposed algorithm employs the ordinary 7 point-stencil central-difference formulas with improvements that minimize the round-off and truncation errors. This is achieved by treating the step size of numerical differentiation as a regularization parameter, which acts as a decision threshold in all calculations. This approach requires shifting discrete audio data by fractions of the initial sample rate, which was obtained by fractional delay FIR filters designed with modified 11-term cosine-sum windows for interpolation and shifting of audio signals. The maximum relative error in estimating first and second derivatives of discrete audio signals are respectively in order of $$10^{-13}$$ 10 - 13 and $$10^{-10}$$ 10 - 10 over the entire audio band, which is close to double-precision floating-point accuracy for the first and better than single-precision floating-point accuracy for the second derivative estimation. Numerical testing showed that this performance of the proposed method is not influenced by the type of signal being differentiated (either stationary or nonstationary), and provides better results than other known differentiation methods, in the audio band up to 21 kHz.