Search

In this paper, we propose to extend the standard Convolutional Dictionary Learning problem to a tensor representation where the activations are constrained to be “low-rank” through a Canonical Polyadic decomposition. We show that this additional constraint increases the robustness of the CDL with respect to noise and improve the interpretability of the final results. In addition, we discuss in detail the advantages of this representation and introduce two algorithms, based on ADMM or FISTA, that efficiently solve this problem. We show that by exploiting the low rank property of activations, they achieve lower complexity than the main CDL algorithms. Finally, we evaluate our approach on a wide range of experiments, highlighting the modularity and the advantages of this tensorial low-rank formulation. [ABSTRACT FROM AUTHOR]

With growth in the number of smart devices and advancements in their hardware, in recent years, data-driven machine learning techniques have drawn significant attention. However, due to privacy and communication issues, it is not possible to collect this data at a centralized location. Federated learning is a machine learning setting where the centralized location trains a learning model over remote devices. Federated learning algorithms cannot be employed in the real world scenarios unless they consider unreliable and resource-constrained nature of the wireless medium. In this paper, we propose a federated learning algorithm that is suitable for cellular wireless networks. We prove its convergence, and provide a sub-optimal scheduling policy that improves the convergence rate. We also study the effect of local computation steps and communication steps on the convergence of the proposed algorithm. We prove, in practice, federated learning algorithms may solve a different problem than the one that they have been employed for if the unreliability of wireless channels is neglected. Finally, through numerous experiments on real and synthetic datasets, we demonstrate the convergence of our proposed algorithm. [ABSTRACT FROM AUTHOR]

A globally convergent optimization algorithm for solving large nonlinear optimal power flow (OPF) problems is presented. As power systems become heavily loaded, there is an increasing need for globally convergent OPF algorithms. By global convergence, one means the optimization algorithm being able to converge to an OPF solution, if at least one exists, for any choice of initial point. The globally convergent OPF presented is based on an infinity-norm trust region approach, using interior-point methods to solve the trust region subproblems. The performance of the proposed trust region interior-point OPF algorithm, when applied to the IEEE 30-, 57-, 118-, and 300-bus systems, and to an actual 1211-bus system, is compared with that of two widely used nonlinear interior-point methods, namely, a pure primal-dual and its predictor-corrector variant. [ABSTRACT FROM PUBLISHER]

Estimation of the regularization parameter, which strikes a balance between the data fidelity and regularity, is essential for successfully solving ill-posed image restoration problems. Based on the classical total variation (TV) model and prevalent alternating direction method of multipliers, we hammer out a fast algorithm being able to simultaneously estimate the regularization parameter and restore the degraded image. By applying variable splitting technique to both the regularization term and data fidelity term, we overcome the nondifferentiability of TV and achieve a closed form to update the regularization parameter in each iteration. The solution is guaranteed to satisfy Morozov’s discrepancy principle. Furthermore, we present a convergence proof for the proposed algorithm on the premise of a variable regularization parameter. Experimental results demonstrate that the proposed algorithm is superior in speed and competitive in accuracy compared with several state-of-the-art methods. Besides, the proposed method can be smoothly extended to the multichannel image restoration. [ABSTRACT FROM PUBLISHER]

An implementation of the inverse vector Jiles-Atherton model for the solution of non-linear hysteretic finite element problems is presented. The implementation applies the fixed point method with differential reluctivity values obtained from the Jiles-Atherton model. Differential reluctivities are usually computed using numerical differentiation, which is ill-posed and amplifies small perturbations causing large sudden increases or decreases of differential reluctivity values, which may cause numerical problems. A rule based algorithm for conditioning differential reluctivity values is presented. Unwanted perturbations on the computed differential reluctivity values are eliminated or reduced with the aim to guarantee convergence. Details of the algorithm are presented together with an evaluation of the algorithm by a numerical example. The algorithm is shown to guarantee convergence, although the rate of convergence depends on the choice of algorithm parameters. [ABSTRACT FROM AUTHOR]

The particle filter has become an important tool in solving nonlinear filtering problems for dynamic systems. This correspondence extends our recent work, where we proved that the particle filter converges for unbounded functions, using L^4-convergence. More specifically, the present contribution is that we prove that the particle filter converge for unbounded functions in the sense of L^p-convergence, for an arbitrary p\geq 2. [ABSTRACT FROM PUBLISHER]