Search

Nonconvex constraints are valuable regularizers in many optimization problems. In particular, sparsity constraints have had a significant impact on sampling theory, where they are used in compressed sensing and allow structured signals to be sampled far below the rate traditionally prescribed. Nearly, all of the theory developed for compressed sensing signal recovery assumes that samples are taken using linear measurements. In this paper, we instead address the compressed sensing recovery problem in a setting where the observations are nonlinear. We show that, under conditions similar to those required in the linear setting, the iterative hard thresholding algorithm can be used to accurately recover sparse or structured signals from few nonlinear observations. Similar ideas can also be developed in a more general nonlinear optimization framework. In the second part of this paper, we therefore present related result that shows how this can be done under sparsity and union of subspaces constraints, whenever a generalization of the restricted isometry property traditionally imposed on the compressed sensing system holds. [ABSTRACT FROM PUBLISHER]

This paper investigates the dynamic access point (AP) clustering and precoding problem in the downlink of user-centric virtual cell networks. The goal is to maximize the weighted sum spectral efficiency (SE) while satisfying the power constraints and AP clustering constraints in adjacent time slots (TSs). By adopting the random walk mobility to model the mobile user equipments’ movement behaviors, we consider dynamic and time-varying channel conditions. Therefore, the weighted sum SE maximization programming takes the form of discrete-time sequence of mixed-integer non-convex optimization problems. In this paper, we propose to solve this sequential problem in two stages. In the first stage, a dynamic AP clustering approach based on discrete particle swarm optimization is developed. This approach takes the advantage of the channel correlation by exploiting the relationship between AP clustering solutions in adjacent TSs to improve the SE performance and reduce complexity. In the second stage, given the AP clustering solution obtained in the first stage, a distributed precoding algorithm is devised via applying the weighted minimum mean square error method. By combining these two stages, we propose a novel dynamic AP clustering and precoding algorithm (DAPC-Pre). The effectiveness of the proposed DAPC-Pre algorithm is verified by the simulation results. In particular, the proposed algorithm converges fast and significantly outperforms benchmark algorithms in terms of sum SE under different dynamic environments. [ABSTRACT FROM AUTHOR]

Rate control typically involves two steps: bit allocation and bitrate control. The bit allocation step can be implemented in various fashions depending on how many levels of allocation are desired and whether or not an optimal rate–distortion (R-D) performance is pursued. The bitrate control step has a simple aim in achieving the target bitrate as precisely as possible. In our recent research, we have developed a \lambda -domain rate control algorithm that is capable of controlling the bitrate precisely for High Efficiency Video Coding (HEVC). The initial research showed that the bitrate control in the \lambda -domain can be more precise than the conventional schemes. However, the simple bit allocation scheme adopted in this initial research is unable to achieve an optimal R-D performance reflecting the inherent R-D characteristics governed by the video content. In order to achieve an optimal R-D performance, the bit allocation algorithms need to be developed taking into account the video content of a given sequence. The key issue in deriving the video-content-guided optimal bit allocation algorithm is to build a suitable R-D model to characterize the R-D behavior of the video content. In this paper, to complement the R- \lambda model developed in our initial work, a D- \lambda model is properly constructed to complete a comprehensive framework of \lambda -domain R-D analysis. Based on this comprehensive \lambda -domain R-D analysis framework, a suite of optimal bit allocation algorithms are developed. In particular, we design both picture-level and basic-unit-level bit allocation algorithms based on the fundamental R-D optimization theory to take full advantage of the content-guided principles. The proposed algorithms are implemented in HEVC reference software, and the experimental results demonstrate that they can achieve an obvious R-D performance improvement with a smaller bitrate control error. The proposed bit allocation algorithms have already been adopted by the Joint Collaborative Team on Video Coding and integrated into the HEVC reference software. [ABSTRACT FROM PUBLISHER]

This paper focuses on developing an appropriate combinatorial optimization technique for solving the optimal sizing problem of hybrid ac–dc microgrids. A novel two-stage iterative approach is proposed. In the first stage, a meta-heuristic technique based on a tailor-made genetic algorithm is used to tackle the optimal sizing problem, while, in the second, a non-linear solver is deployed to solve the operational problem subject to the obtained design/investment decisions. The proposed approach, being able to capture technical characteristics such as voltage and frequency through a detailed power flow algorithm, provides accurate solutions and, therefore, can address operational challenges of microgrids. Its capability to additionally capture contingencies ensures that the proposed sizing solutions are suitable both during normal operation and transient states. Finally, the genetic algorithm provides convergence of the model with relative computational simplicity. The proposed model is applied to a generalizable microgrid comprising of ac and dc generators and loads, as well as various types of storage technologies in order to demonstrate the benefits. The load and natural resources data correspond to real data. [ABSTRACT FROM AUTHOR]

This paper proposes a general framework for determining the effect of communication delays on the convergence of certain distributed frequency regulation (DFR) protocols for prosumer-based energy systems, where prosumers are serving as balancing areas. DFR relies on iterative and distributed optimization algorithms to obtain an optimal feedback law for frequency regulation. But, it is, in general, hard to know beforehand how many iterations suffice to ensure stability. This paper develops a framework to determine a lower bound on the number of iterations required for two distributed optimization protocols. This allows prosumers to determine whether they can compute stabilizing control strategies within an acceptable time frame by taking communication delays into account. The efficacy of the method is demonstrated on two realistic power systems. [ABSTRACT FROM PUBLISHER]

Dynamic network architectures (DNAs) have been developed under the assumption that some terminals can be converted into temporary access points (APs) anytime when connected to the Internet. In this paper, we consider the problem of assigning a group of users to a set of potential APs with the aim to maximize the downlink system throughput of DNA networks, subject to total transmit power and users’ quality of service (QoS) constraints. In our first method, we relax the integer optimization variables to be continuous. The resulting non-convex continuous optimization problem is solved using successive convex approximation framework to arrive at a sequence of second-order cone programs (SOCPs). In the next method, the selection process is viewed as finding a sparsity constrained solution to our problem of sum rate maximization. It is demonstrated in numerical results that while the first approach has better data rates for dense networks, the sparsity oriented method has a superior speed of convergence. Moreover, for the scenarios considered, in addition to comprehensively outperforming some well-known approaches, our algorithms yield data rates close to those obtained by branch and bound method. [ABSTRACT FROM AUTHOR]

This paper presents a decentralized solution algorithm for network-constrained unit commitment (NCUC) in multiregional power systems. The proposed algorithm is based on our previous work in which a local NCUC was formulated for each control entity (i.e., region) and an analytical target cascading (ATC) based distributed but partially parallelized algorithm requiring a central coordinator was presented. The primary objective of this paper is to present a decentralized approach that relaxes the need for any form of central coordinator in ATC and allows fully parallelized solutions of the local NCUCs. To achieve this objective, we formulate a bilevel optimization problem for each control entity. While the upper level solves the NCUC problem of the control entity, the lower level seeks to coordinate the control entity with its neighboring regions. The lower level is a convex optimization, which can be further replaced in the upper level problem by the Karush–Kuhn–Tucker conditions. The control entities communicate directly with each other and synchronously solve their local NCUCs. Having no need for any form of central coordinator, the proposed algorithm is potentially less vulnerable to cyber-attacks and communication failures than the distributed methods utilizing a coordinator. [ABSTRACT FROM AUTHOR]

Power system congestion is a major problem that the system operator (SO) would face in the post-deregulated era. Therefore, investigation of techniques for congestion-free wheeling of power is of paramount interest. One of the most practiced and an obvious technique of congestion management is rescheduling the power outputs of generators in the system. However, all generators in the system need not take part in congestion management. Development of sound formulation and appropriate solution technique for this problem is aimed in this paper. Contributions made in the present paper are twofold. Firstly a technique for optimum selection of participating generators has been introduced using generator sensitivities to the power flow on congested lines. Secondly this paper proposes an algorithm based on particle swarm optimization (PSO) which minimizes the deviations of rescheduled values of generator power outputs from scheduled levels. The PSO algorithm, reported in this paper, handles the binding constraints by a technique different from the traditional penalty function method. The effectiveness of the proposed methodology has been analyzed on IEEE 30-bus and 118-bus systems and the 39-bus New England system. [ABSTRACT FROM AUTHOR]

This paper studies the convergence properties of the well-known message-passing algorithm for convex optimisation. Under the assumption of pairwise separability and scaled diagonal dominance, asymptotic convergence is established and a simple bound for the convergence rate is provided for message-passing. In comparison with previous results, our results do not require the given convex program to have known convex pairwise components and that our bound for the convergence rate is tighter and simpler. When specialised to quadratic optimisation, we generalise known results by providing a very simple bound for the convergence rate. [ABSTRACT FROM AUTHOR]

This paper addresses the problem of semantic segmentation, where the possible class labels are from a predefined set. We exploit top-down guidance, i.e., the coarse localization of the objects and their class labels provided by object detectors. For each detected bounding box, figure–ground segmentation is performed and the final result is achieved by merging the figure–ground segmentations. The main idea of the proposed approach, which is presented in our preliminary work, is to reformulate the figure–ground segmentation problem as sparse reconstruction pursuing the object mask in a nonparametric manner. The latent segmentation mask should be coherent subject to sparse error caused by intra-category diversity; thus, the object mask is inferred by making use of sparse representations over the training set. To handle local spatial deformations, local patch-level masks are also considered and inferred by sparse representations over the spatially nearby patches. The sparse reconstruction coefficients and the latent mask are alternately optimized by applying the Lasso algorithm and the accelerated proximal gradient method. The proposed formulation results in a convex optimization problem; thus, the global optimal solution is achieved. In this paper, we provide theoretical analysis of the convergence and optimality. We also give an extended numerical analysis of the proposed algorithm and a comprehensive comparison with the related semantic segmentation methods on the challenging PASCAL visual object class object segmentation datasets and the Weizmann horse dataset. The experimental results demonstrate that the proposed algorithm achieves a competitive performance when compared with the state of the arts. [ABSTRACT FROM PUBLISHER]

Matrix factorization is a popular approach for large-scale matrix completion. The optimization formulation based on matrix factorization, even with huge size, can be solved very efficiently through the standard optimization algorithms in practice. However, due to the non-convexity caused by the factorization model, there is a limited theoretical understanding of whether these algorithms will generate a good solution. In this paper, we establish a theoretical guarantee for the factorization-based formulation to correctly recover the underlying low-rank matrix. In particular, we show that under similar conditions to those in previous works, many standard optimization algorithms converge to the global optima of a factorization-based formulation and recover the true low-rank matrix. We study the local geometry of a properly regularized objective and prove that any stationary point in a certain local region is globally optimal. A major difference of this paper from the existing results is that we do not need resampling (i.e., using independent samples at each iteration) in either the algorithm or its analysis. [ABSTRACT FROM PUBLISHER]

The combination of non-orthogonal multiple access (NOMA) and intelligent reflecting surface (IRS) is an efficient solution to significantly enhance the energy efficiency of the wireless communication system. In this paper, a downlink multi-cluster NOMA network is considered, where each cluster is supported by one IRS. This paper aims to minimize the transmit power by jointly optimizing the beamforming, the power allocation and the phase shift of each IRS. The formulated problem is non-convex and challenging to be solved due to the coupled variables, i.e., the beamforming vector, the power allocation coefficient and the phase shift matrix. To address this non-convex problem, an alternating optimization based algorithm is proposed. Specifically, the primal problem is divided into two subproblems for beamforming optimization and phase shifting feasiblity, where the two subproblems are solved iteratively. Moreover, to guarantee the feasibility of the beamforming optimization problem, an iterative algorithm is proposed to search the feasible initial points. To reduce the complexity, a simplified algorithm based on partial exhaustive search for this system model is also proposed. Simulation results demonstrate that the proposed alternating algorithm can yield a better performance gain than the partial exhaustive search algorithm, NOMA with random IRS phase shift scheme and OMA-IRS scheme. [ABSTRACT FROM AUTHOR]

The aim of this paper is to discuss electrical machines building and computation while taking into account the change of reluctance network (RN) topology required in an optimization process. Indeed, as electrical machine RN changes during an electrical period, this model has to consider several rotor positions to analyze harmonic influence on machine performance (e.g., its torque and losses). Such a requirement can also be important in applications where machine geometry changes shortly during sizing process by optimization. These two cases are addressed in this paper. Using established independent meshes of the initial RN, this paper proposes an algorithm to deal with all topologies necessary for an optimization process. This aims to reduce the computation time, increase the model, and improve the solving stability. An output selectivity approach is also applied on the RN modeling to improve the computation time of the optimization process. The simulation results are compared to finite-element methods and the optimization performance is presented. [ABSTRACT FROM AUTHOR]

This paper compares the application of two deterministic and three nondeterministic optimization algorithms to global transformer design optimization (TDO). Two deterministic optimization algorithms (mixed-integer nonlinear programming and heuristic algorithm) are compared to three nondeterministic approaches (harmony search, differential evolution, and genetic algorithm). All these algorithms are integrated in design optimization software applied and verified in the manufacturing industry. The comparison yields significant conclusions on the efficiency of the algorithms and the selection of the most suitable one for the TDO problem. [ABSTRACT FROM AUTHOR]

With the increase in the number of optimization objectives, balancing the convergence and diversity in evolutionary multiobjective optimization becomes more intractable. So far, a variety of evolutionary algorithms have been proposed to solve many-objective optimization problems (MaOPs) with more than three objectives. Most of the existing algorithms, however, find difficulties in simultaneously counterpoising convergence and diversity during the whole evolutionary process. To address the issue, this paper proposes to solve MaOPs via multistage evolutionary search. To be specific, a two-stage evolutionary algorithm is developed, where the convergence and diversity are highlighted during different search stages to avoid the interferences between them. The first stage pushes multiple subpopulations with different weight vectors to converge to different areas of the Pareto front. After that, the nondominated solutions coming from each subpopulation are selected for generating a new population for the second stage. Moreover, a new environmental selection strategy is designed for the second stage to balance the convergence and diversity close to the Pareto front. This selection strategy evenly divides each objective dimension into a number of intervals, and then one solution having the best convergence in each interval will be retained. To assess the performance of the proposed algorithm, 48 benchmark functions with 7, 10, and 15 objectives are used to make comparisons with five representative many-objective optimization algorithms. [ABSTRACT FROM AUTHOR]

Generating units, participating in the secondary frequency control of a control area, are usually spinning units already connected to the network and operating outside their range of optimal performance. This paper deals with an alternative method of providing secondary frequency control called Rapid-Start (RS). It consists in assigning a regulation band to several off-line units (RS units) which are capable of being started and connected rapidly, therefore allowing the online units to operate closer to their nominal power. As RS operation may have economic benefits, an appropriate algorithm to start up an RS unit needs to be developed. This paper proposes a methodology to evaluate, compare, and choose the most appropriate RS algorithm among the ones developed for a certain AGC control area. An optimization model provides a reference by determining the hypothetically ideal start-ups and shut-downs of RS units. In addition, the definition of performance indexes to evaluate, compare, and choose the different RS algorithms is proposed. The proposed methodology is illustrated for a secondary frequency control zone within the Spanish power system by using real data signals. [ABSTRACT FROM PUBLISHER]

This paper presents a subgradient-based neural network to solve a nonsmooth nonconvex optimization problem with a nonsmooth nonconvex objective function, a class of affine equality constraints, and a class of nonsmooth convex inequality constraints. The proposed neural network is modeled with a differential inclusion. Under a suitable assumption on the constraint set and a proper assumption on the objective function, it is proved that for a sufficiently large penalty parameter, there exists a unique global solution to the neural network and the trajectory of the network can reach the feasible region in finite time and stay there thereafter. It is proved that the trajectory of the neural network converges to the set which consists of the equilibrium points of the neural network, and coincides with the set which consists of the critical points of the objective function in the feasible region. A condition is given to ensure the convergence to the equilibrium point set in finite time. Moreover, under suitable assumptions, the coincidence between the solution to the differential inclusion and the "slow solution" of it is also proved. Furthermore, three typical examples are given to present the effectiveness of the theoretic results obtained in this paper and the good performance of the proposed neural network. [ABSTRACT FROM AUTHOR]

This paper considers the networked system optimization problem by cooperatively finding an approximately optimal solution to the overall network convex cost function, which is the sum of the individual cost functions of nodes (agents) in a networked system. A new distributed gradient descent algorithm is proposed based on the distributed estimation of the sum of gradients of individual cost functions using a consensus-type coordination algorithm. The proposed algorithm can address unknown directed communication topologies and only requires limited communications and information exchanges among nodes in the networked system. Under the assumption that the communication graph is strongly connected, the convergence of the proposed algorithm is rigorously analyzed. Simulation examples are presented to demonstrate the applicability and effectiveness of the proposed algorithm. [ABSTRACT FROM AUTHOR]

In the restructured power industry, bulk energy storage may play a crucial role to provide the flexibility required by system operators to cater for the unprecedented levels of uncertainty. Within the context of co-optimized electricity markets for energy and reserves under wind uncertainty, this paper addresses the incorporation of bulk energy storage units in day-ahead network-constrained energy and reserve scheduling. A novel two-stage robust optimization approach is presented whereby the nonconvex and time-coupled operation of storage devices is precisely modeled while accounting for the anticipativity of the two-stage setting. The resulting robust counterpart is cast as a mixed-integer trilevel program with lower-level binary variables. In order to address the nonconvexity of the recourse problem, this paper proposes the application of an exact nested column-and-constraint generation algorithm. Numerical results illustrate the effective performance of the proposed approach. [ABSTRACT FROM AUTHOR]

In this correspondence paper, an underlay cognitive radio multicast network, consisting of a cognitive base station (CBS) and multiple multicast groups of secondary users (SUs), is considered. All SUs, belonging to a particular multicast group, are served by the CBS using a common primary user (PU) channel. The goal is to maximize the energy efficiency (EE) of the system, through dynamic adaptation of target rate and transmit power for each multicast group, under the PUs’ individual interference constraint. The optimization problem formulated for this is proved to be nonquasi-concave with respect to the joint variation of the CBS's transmit power and target rate. An efficient iterative algorithm for EE maximization is proposed along with its complexity analysis. Simulation results illustrate the performance gain of our proposed scheme. [ABSTRACT FROM AUTHOR]

In this paper, we study the user pairing in a downlink non-orthogonal multiple access (NOMA) network, where the base station allocates the power to the pairwise users within the cluster. In the considered NOMA network, a user with poor channel condition is paired with a user with good channel condition, when both their rate requirements are satisfied. Specifically, the quality of service for weak users can be guaranteed, since the transmit power allocated to strong users is constrained following the concept of cognitive radio. A distributed matching algorithm is proposed in the downlink NOMA network, aiming to optimize the user pairing and power allocation between weak users and strong users, subject to the users’ targeted rate requirements. Our results show that the proposed algorithm outperforms the conventional orthogonal multiple access scheme and approaches the performance of the centralized algorithm, despite its low complexity. In order to improve the system’s throughput, we design a practical adaptive turbo trellis coded modulation scheme for the considered network, which adaptively adjusts the code rate and the modulation mode based on the instantaneous channel conditions. The joint design work leads to significant mutual benefits for all the users as well as the improved system throughput. [ABSTRACT FROM PUBLISHER]

Motivated by the work of Dahrouj and Yu in applying the Han-Kobayashi transmission strategy for mitigating the intercell interference in a multi-cell multi-user multiple-input single-output interference network (MISO IN), this paper considers splitting messages into private and common parts in a multi-cell multi-user MIMO IN. Specifically, the covariances of the private messages and common messages are designed to optimize either the sum rate or the minimal rate. The common messages and private messages are decoded in sequence using successive decoding. This paper shows how these difficult optimization problems can be adequately solved by means of d.c. (difference of concave functions) optimization over a simple convex set. Numerical and simulation results also reveal the great advantage of our proposed solutions for various types of INs. In particular, the proposed solutions are shown to outperform the algorithm developed by Dahrouj and Yu for the simpler case of the MISO IN. [ABSTRACT FROM PUBLISHER]

In this paper, we study an unmanned aerial vehicle (UAV) enabled video streaming system, where a rotary-wing UAV is dispatched as a mobile base station to serve multiple ground users (GUs) with dynamic adaptive streaming over HTTP (DASH). By introducing the Quality of Experience (QoE) utility model, we investigate the joint design of transmit power and bandwidth allocation as well as UAV trajectory for maximization of minimum utility among all GUs, subject to information-causality constraints for video playing and UAV total energy budget, which consists of both communication related energy and UAV propulsion energy. The formulated problem is non-convex and difficult to be solved directly. An efficient algorithm is proposed to obtain the suboptimal solution by applying the successive convex approximation and alternating optimization techniques. Simulation results show that the proposed solution can achieve significant gains in terms of QoE utility over benchmark schemes for energy-efficient video streaming. [ABSTRACT FROM AUTHOR]

The application mapping problem is an NP-hard combinatorial optimization problem in network-on-chip (NoC) design. Applications of size ($n$ $ >$ 30) cannot be solved optimally by an exact algorithm in reasonable time, and the evolutionary algorithms have drawn the attention of NoC researchers. In this paper, we propose a new effective optimization method based on the discrete particle swarm optimization framework, which includes the novel principles for representation, velocity computing, and position-updating of the particles. In our proposed method, particles are allowed to swing between elite and regular pools, and a simple local search procedure is applied on elite particles to exploit the promising solutions. Extensive computational studies using standard benchmark instances and task graphs for free (TGFF) random instances reveal that the proposed optimization algorithm is able to attain the best results, and thus competes very favorably with the previously proposed heuristic approaches. A stability analysis and the two-sided Wilcoxon rank sum tests are also presented to shed light on the robust behavior of the algorithm. [ABSTRACT FROM AUTHOR]

Mobile video traffic has experienced exponential growth in recent years due to increasing prevalence of mobile devices and continuous advancement of wireless communications. However, network fluctuations often occur when transmitting video data, which greatly impact the quality of experience (QoE) of mobile users. Buffering technique has been widely adopted to mitigate the effect of network fluctuations on QoE for mobile users by prefetching certain video data to mobile devices in advance. However, mobile users often abort video watching before the videos are fully watched and such early departure behavior can result in considerable wastage of buffered video data. In this paper, we study buffer-aware resource allocation for multiuser mobile video streaming system by jointly considering video users early departure behavior and wireless channel fluctuation property. We formulate a stochastic optimization problem in which the objective is to reduce both the amount of wasted buffered data and the video re-buffering time. The problem is then transformed into a series of deterministic per-slot problems by using Lyapunov optimization theory. We propose an online buffer-aware resource allocation algorithm to solve the per-slot optimization problems. After proving the convexity of the per-slot optimization problem, we further design a fast-convergent iterative algorithm based on Alternating Direction Method of Multipliers (ADMM) to perform each of the per-slot resource allocations. Simulation results show that our proposed algorithm has very low running time, near optimal performance, and is able to achieve a good trade-off between QoE improvement and data wastage reduction. [ABSTRACT FROM AUTHOR]

Space debris has become a great threat to space activities. We study and optimize space missions to remove multiple space debris. These missions are efficient and economical in stabilizing the orbital environment. In this paper, we propose an intelligent global optimization algorithm named the evolving elitist club algorithm (EECA), and we study its application in multiple debris removal missions. The crucial design element of EECA is the elitist club, which is a population created using ant colony optimization (ACO) and then evolved using genetic algorithm operators. We describe two types of multiple debris removal missions: 1) single spacecraft removal mission; and 2) multiple spacecraft removal mission. We optimize them using EECA. The proposed algorithm is compared with the conventional tree search method and other ACO algorithms. We show that EECA is more efficient than other algorithms. Furthermore, a time distribution (TD) EECA is proposed to handle time-dependent problems, and the time-continuous update mechanism of time-varying pheromone in TD EECA presents a novel idea for combinatorial-continuous problems. [ABSTRACT FROM AUTHOR]

This paper considers stochastic convex optimization problems with two sets of constraints: (a) deterministic constraints on the domain of the optimization variable, which are difficult to project onto; and (b) deterministic or stochastic constraints that admit efficient projection. Problems of this form arise frequently in the context of semidefinite programming as well as when various NP-hard problems are solved approximately via semidefinite relaxation. Since projection onto the first set of constraints is difficult, it becomes necessary to explore projection-free algorithms, such as the stochastic Frank-Wolfe (FW) algorithm. On the other hand, the second set of constraints cannot be handled in the same way, and must be incorporated as an indicator function within the objective function, thereby complicating the application of FW methods. Similar problems have been studied before; however, they suffer from slow convergence rates. This work, equipped with momentum based gradient tracking technique, guarantees fast convergence rates on par with the best-known rates for problems without the second set of constraints. Zeroth-order variants of the proposed algorithms are also developed and again improve upon the state-of-the-art rate results. We further propose the novel trimmed FW variants that enjoy the same convergence rates as their classical counterparts, but are empirically shown to require significantly fewer calls to the linear minimization oracle speeding up the overall algorithm. The efficacy of the proposed algorithms is tested on relevant applications of sparse matrix estimation, clustering via semidefinite relaxation, and uniform sparsest cut problem. [ABSTRACT FROM AUTHOR]

Edge federated learning (FL) is an emerging paradigm that trains a global parametric model from distributed datasets based on wireless communications. This paper proposes a unit-modulus over-the-air computation (UMAirComp) framework to facilitate efficient edge federated learning, which simultaneously uploads local model parameters and updates global model parameters via analog beamforming. The proposed framework avoids sophisticated baseband signal processing, leading to low communication delays and implementation costs. Training loss bounds of UMAirComp FL systems are derived and two low-complexity large-scale optimization algorithms, termed penalty alternating minimization (PAM) and accelerated gradient projection (AGP), are proposed to minimize the nonconvex nonsmooth loss bound. Simulation results show that the proposed UMAirComp framework with PAM algorithm achieves a smaller mean square error of model parameters’ estimation, training loss, and test error compared with other benchmark schemes. Moreover, the proposed UMAirComp framework with AGP algorithm achieves satisfactory performance while reduces the computational complexity by orders of magnitude compared with existing optimization algorithms. Finally, we demonstrate the implementation of UMAirComp in a vehicle-to-everything autonomous driving simulation platform. It is found that autonomous driving tasks are more sensitive to model parameter errors than other tasks since the neural networks for autonomous driving contain sparser model parameters. [ABSTRACT FROM AUTHOR]

We present a conditional random field approach to tracking-by-detection in which we model pairwise factors linking pairs of detections and their hidden labels, as well as higher order potentials defined in terms of label costs. To the contrary of previous papers, our method considers long-term connectivity between pairs of detections and models similarities as well as dissimilarities between them, based on position, color, and as novelty, visual motion cues. We introduce a set of feature-specific confidence scores, which aim at weighting feature contributions according to their reliability. Pairwise potential parameters are then learned in an unsupervised way from detections or from tracklets. Label costs are defined so as to penalize the complexity of the labeling, based on prior knowledge about the scene like the location of entry/exit zones. Experiments on PETS'09, TUD, CAVIAR, Parking Lot, and Town Center public data sets show the validity of our approach, and similar or better performance than recent state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]

This paper presents a generic strategy for short-term load forecasting (STLF) based on the support vector regression machines (SVR). Two important improvements to the SVR based load forecasting method are introduced, i.e., procedure for generation of model inputs and subsequent model input selection using feature selection algorithms. One of the objectives of the proposed strategy is to reduce the operator interaction in the model-building procedure. The proposed use of feature selection algorithms for automatic model input selection and the use of the particle swarm global optimization based technique for the optimization of SVR hyper-parameters reduces the operator interaction. To confirm the effectiveness of the proposed modeling strategy, the model has been trained and tested on two publicly available and well-known load forecasting data sets and compared to the state-of-the-art STLF algorithms yielding improved accuracy. [ABSTRACT FROM PUBLISHER]

This paper presents a model predictive control-based obstacle avoidance algorithm for autonomous ground vehicles at high speed in unstructured environments. The novelty of the algorithm is its capability to control the vehicle to avoid obstacles at high speed taking into account dynamical safety constraints through a simultaneous optimization of reference speed and steering angle without a priori knowledge about the environment and without a reference trajectory to follow. Previous work in this specific context optimized only the steering command. In this paper, obstacles are detected using a planar light detection and ranging sensor. A multi-phase optimal control problem is then formulated to simultaneously optimize the reference speed and steering angle within the detection range. Vehicle acceleration capability as a function of speed, as well as stability and handling concerns such as preventing wheel lift-off, are included as constraints in the optimization problem, whereas the cost function is formulated to navigate the vehicle as quickly as possible with smooth control commands. Simulation results show that the proposed algorithm is capable of safely exploiting the dynamic limits of the vehicle while navigating the vehicle through sensed obstacles of different sizes and numbers. It is also shown that the proposed variable speed formulation can significantly improve performance by allowing navigation of obstacle fields that would otherwise not be cleared with steering control alone. [ABSTRACT FROM PUBLISHER]

In this paper, a novel algorithm “firework optimization” (FO) is introduced, as well as its hybridization with generating set search (GSS). FO is an exploration algorithm, which intends to explore a vast region within the search space in order to determine regions that may contain a regional optimum. As the regions with potential are defined, GSS, the exploitation algorithm is applied to determine whether regions determined by FO contain a local or a global optimum. The validity of FO and GSS hybridization algorithm is verified using Branin and Six-Hump Camel test functions, and the hybridization algorithm is applied to an interior permanent magnet synchronous motor, in order to minimize torque ripple. [ABSTRACT FROM AUTHOR]

Community detection is one of the fundamental tasks in graph mining, which aims to identify group assignment of nodes in a complex network. Recently, network embedding techniques have demonstrated their strong power in advancing the community detection task and achieve better performance than various traditional methods. Despite their empirical success, most of the existing algorithms directly leverage the observed coarse network structure for community detection. Therefore, they often lead to suboptimal performance as the observed connections fail to capture the essential tie strength information among nodes precisely and account for the impact of noisy links. In this paper, an optimal network structure for community detection is introduced to characterize the fine-grained tie strength information between connected nodes and alleviate the adverse effects of noisy links. To obtain an expressive node representation for community detection, we learn the optimal network structure and network embeddings in a joint framework, instead of using a two-stage approach to derive the node embeddings from the coarse network topology. In particular, we formulate the joint framework as an optimization problem and an alternating optimization algorithm is exploited to solve the proposed optimization problem. Additionally, theoretical analyses regarding the computational complexity and the convergence of the optimization algorithm are also provided. Extensive experiments on both synthetic and real-world networks demonstrate the effectiveness and superiority of the proposed framework. [ABSTRACT FROM AUTHOR]

Inter-prediction based on block-based motion estimation (ME) is used in most video codecs. The closer the prediction to the target block, the lower the residual, and thus more efficient compression can be achieved. In this paper, a new technique called enhanced inter-prediction (EIP) is proposed to improve the prediction candidates using an additional transformation acting while performing ME. A parametric transformation acts within the coding loop of each block to modify the prediction for each motion vector candidate. The EIP is validated in the particular case of a single-parameter shifting transformation. This paper presents an efficient algorithm to compute the best shift for each prediction candidate and a model to select the optimal prediction based on minimum cost integrating the approach with existing rate-distortion optimization techniques in the H.264/AVC video codec. Results show significant improvements with an average of 6% bit-rate reduction compared to the original H.264/AVC. [ABSTRACT FROM PUBLISHER]

As technology scales and frequencies increase, a new hybrid design style emerges, wherein designs contain a mixture of random logic and datapath standard-cell components. This paper demonstrates that conventional half-perimeter wirelength driven placers underperform in terms of regularity and Steiner wirelength (StWL) for such hybrid designs. In addition, the quality gap between manual and automatic placement is more pronounced as the designs become more datapath oriented. To effectively handle hybrid designs, this paper proposes a new unified placement flow that simultaneously places random logic and datapath cells. This flow is built on the top of a leading academic force-directed placer and significantly improves the quality of datapath placement while leveraging the speed and flexibility of existing random-logic placement algorithms. It consists of a suite of novel global and detailed placement techniques, collectively called structure-aware placement techniques (SAPT). These techniques effectively integrate alignment constraints into placement, thereby overcoming the deficiencies of existing random-logic placers when handling designs with embedded datapaths. Compared to other state-of-the-art placers, SAPT improves total StWL by more than 28% and total routing overflow by over six times on the ISPD 2011 datapath benchmark suite. In addition, it improves total StWL by 5.8% on industrial hybrid designs. [ABSTRACT FROM AUTHOR]

Based on our previous work, this paper presents a dynamic hybrid framework, called DyHF, for solving constrained optimization problems. This framework consists of two major steps: global search model and local search model. In the global and local search models, differential evolution serves as the search engine, and Pareto dominance used in multiobjective optimization is employed to compare the individuals in the population. Unlike other existing methods, the above two steps are executed dynamically according to the feasibility proportion of the current population in this paper, with the purpose of reasonably distributing the computational resource for the global and local search during the evolution. The performance of DyHF is tested on 22 benchmark test functions. The experimental results clearly show that the overall performance of DyHF is highly competitive with that of a number of state-of-the-art approaches from the literature. [ABSTRACT FROM AUTHOR]

The end-of-life (EOL) disassembly sequencing problem (DSP) has become increasingly important in the process of handling EOL products. This paper proposes a solution procedure for the “EOL DSP”; the procedure is based on a novel soft-computing algorithm that utilizes modified “simplified swarm optimization,” and the procedure combines the precedence preservative operator, feasible solution generator, self-adaptive parameter control, and repetitive pairwise exchange procedures. By taking into consideration the non-deterministic polynomial time (NP)-complete nature of the problem, the proposed algorithm efficiently seeks the optimal disassembly sequence with a novel approach; this approach involves reducing the initial solution space and using a combination of soft-computing algorithms for achieving higher computational efficiency and solution quality. The results presented in this paper show that the proposed algorithm outperforms the existing algorithms in terms of solution quality achieved in a limited computation time. [ABSTRACT FROM PUBLISHER]

In this paper, an optimal design for nuclear magnetic resonance and magnetic resonance imaging based multiphase flow meter is presented. The overall apparatus consists of an electromagnetic coil surrounded by 12 rings of Halbach arrays of 12 magnets each. Both the coil and the magnets arrays were simultaneously and optimally designed using a three-dimensional (3-D) finite-element method (FEM) package and particle swarm optimization algorithm. The aim of the design is to uniformly prepolarize the hydrogen spins of the atoms composing the flowing fluid, with a predefined static magnetic field, before they enter into the measurement area within which they are homogenously polarized with a perpendicular ac magnetic field. Cheap and lightweight hardware are the other two design parameters of the design. Results of extensive 3-D simulations of the design indicate that an optimized and homogenous static magnetic field distribution could be achieved within an area of 40 mm diameter and 606 mm length. In addition, using a multiturn coil of 6 cm diameter and 2000 turns, an ac magnetic field of 13 mT amplitude and 112 ppm homogeneity could be achieved, which is enough to handle fluids flowing at speed of up to 2 m/s. Experimental validation, which was done using newly constructed two Halbach arrays of cuboid and trapezoid magnet elements, respectively, indicates a good match with FEM simulations. [ABSTRACT FROM AUTHOR]

Estimating the probability of failures or accidents with aerospace systems is often necessary when new concepts or designs are introduced, as it is being done for autonomous aircraft. If the design is safe, as it is supposed to be, accident cases are hard to find. Such analysis needs some variance reduction technique and several algorithms exist for that; however, specific model features may cause difficulties in practice, such as the case of system models where independent agents have to autonomously accomplish missions within finite time, and likely with the presence of human agents. For handling these scenarios, this paper presents a novel estimation approach, based on the combination of the well-established variation reduction technique of interacting particles system with the long-standing optimization algorithm denominated DIviding RECTangles. When combined, these two techniques yield statistically significant results for extremely low probabilities. In addition, this novel approach allows the identification of intermediate events and simplifies the evaluation of sensitivity of the estimated probabilities to certain system parameters. [ABSTRACT FROM AUTHOR]

This paper presents a new method based on recent optimization technique to detect slow-moving landslides (<150m/year) in time series of displacement field generated by satellite images. Sparse optimization is applied simultaneously on the 3-D data set in space as well as in time. The proposed method takes into account the distinctive signal physical properties in space and time, by enforcing a sparse representation by blocks in space, but a continuing and monotonous representation in time of the landslides. As a result, we show that a mixed $\ell _{1,2}$ -norm is the most suitable norm for this detection problem, compared to pure $\ell _{1}$ -norm or $\ell _{2}$ -norm. Moreover, an outlier estimation step is included that sets apart the Gaussian noise from locally sparse processing errors in the data. The performance of this approach is tested by applying it both on synthetic data and on a time series of displacements fields over 16 dates in the Colca Valley, Peru. This detection presents commission and omission errors for landslides of 29% and 14%, respectively, using a medium resolution (10 m) data set of optical satellite images. It detects all important landslides, already known from field investigations. Moreover, it also points out other smaller or unknown landslides, increasing the existing slow-moving landslide inventory by +50%. [ABSTRACT FROM AUTHOR]

Batched sparse (BATS) codes are a promising technique for reliable data transmission in multihop wireless networks. A BATS code consists of an outer code and an inner code, the design of which can be separated. In this paper, we investigate the design of the inner code and focus on maximizing the expected batch transfer matrix rank normalized by the total number of packets transmitted by both the source and intermediate nodes. By allowing different recoding decisions at different nodes, the problem is formulated as a nonlinear integer programming (NLIP) problem, which is non-deterministic polynomial (NP)-hard in general. We derive a noniterative formula to simplify the evaluation of the expected batch transfer matrix rank. By considering large finite fields and relaxing the integer constraints, we obtain an upper bound on the optimal value of the original maximization NLIP problem. We also derive a centralized and a decentralized algorithm to find suboptimal solutions of the NLIP problem, with different tradeoffs between complexity and performance. Numerical results show that our proposed inner codes outperform the standard BATS, and achieve very close to the upper bound, which verifies the near optimality of our algorithms. [ABSTRACT FROM AUTHOR]

In this paper, an adaptive synthesis using the particle swarm optimization (PSO) for implementations of resonator-coupled filters is proposed. The coupling matrix of in-band filtering response is achieved and optimized by the PSO-based synthesis. Meanwhile, the stopband coupling matrix of the filter is predicted based on the combination of extra resonant nodes representing stopband spurious and parasitic effect of input/output ports. In addition, an enhanced accurate prediction of filter performance is calculated by the proposed approach, considering the practical fabrication tolerance on filter design. To verify principles mentioned earlier, various resonator-coupled filters are implemented. The calculation, EM-simulation, and measurement of filters show good agreements in both passband and stopband. [ABSTRACT FROM AUTHOR]

The tensor completion issues have obtained a great deal of attention in the past few years. However, the data fidelity part minimizes a squared loss function, which may be inappropriate for the case of noisy one-bit observations. In this paper, we alleviate the mentioned difficulty by drawing on the experience of matrix scenarios. Based on the convex relation to $\ell _{1}$ norm of the tensor multi-rank, we propose a novel optimization model trying to recover the underlying tensor in case of one-bit observations. The feasibility of this model is proved by theoretical derivations. Furthermore, an alternating direction method of multipliers based algorithm is designed to find the solution. The numerical experiments demonstrate the effectiveness of our method. [ABSTRACT FROM AUTHOR]

In this paper, several irregularly shaped microstrip antenna structures are designed using a new version of Binary Particle Swarm Optimization (BPSO) algorithm in which the velocity calculation is modified towards a more accelerated and still robust search procedure, particularly aimed for software-defined radio (SDR) applications. The optimization results are compared using both the modified and the conventional BPSO algorithms. Pros and cons are studied in terms of optimization length, convergence speed and final design conformability to desired objectives. It is depicted that the modified BPSO achieves the design criterion considerably faster than the conventional one, at the cost of slightly limiting particle exploration ability. [ABSTRACT FROM PUBLISHER]

This paper develops a dynamically adaptive stochastic tunneling (DAST) algorithm to avoid the “freezing” problem commonly found when using simulated annealing for circuit placement on field-programmable gate arrays (FPGAs). The main objective is to reduce the placement runtime and improve the quality of final placement. We achieve this by allowing the DAST placer to tunnel energetically inaccessible regions of the potential solution space, adjusting the stochastic tunneling schedule adaptively by performing detrended fluctuation analysis, and selecting move types dynamically by a multi-modal scheme based on Gibbs sampling. A prototype annealing-based placer, called DAST, was developed as part of this paper. It targets the same computer-aided design flow as the standard versatile placement and routing (VPR) but replaces its original annealer with the DAST algorithm. Our experimental results using the benchmark suite and FPGA architecture file which comes with the Toronto VPR5 software package have shown a 18.3% reduction in runtime and a 7.2% improvement in critical-path delay over that of conventional VPR. [ABSTRACT FROM AUTHOR]

This paper presents a dynamic predictive-optimization framework of a nonlinear temporal process. Data-mining (DM) and evolutionary strategy algorithms are integrated in the framework for solving the optimization model. DM algorithms learn dynamic equations from the process data. An evolutionary strategy algorithm is then applied to solve the optimization problem guided by the knowledge extracted by the DM algorithm. The concept presented in this paper is illustrated with the data from a power plant, where the goal is to maximize the boiler efficiency and minimize the limestone consumption. This multiobjective optimization problem can be either transformed into a single-objective optimization problem through preference aggregation approaches or into a Pareto-optimal optimization problem. The computational results have shown the effectiveness of the proposed optimization framework. [ABSTRACT FROM AUTHOR]

Capacitor mismatch can generally result from two sources of error: random mismatch and systematic mismatch. Random mismatch is caused by process variation, while systematic mismatch is mainly due to an asymmetrical layout and processing gradients. A common centroid structure may be used to reduce systematic mismatch errors, but not random mismatch errors. Based on the spatial correlation model, this paper formulates the placement optimization problem of analog circuits using switched-capacitor techniques. A placement with higher correlation coefficients of the unit capacitors results in a higher acceptance rate, or chip yield. This paper proposes a heuristic algorithm that quickly and automatically derives the placement of the unit capacitors with the highest, or near-highest, correlation coefficients for yield improvement. Results show that the resultant placement derived from the proposed algorithm achieves better yield improvement than that from a common centroid approach. The proposed heuristic algorithm can be applied for any arbitrary capacitor ratios, i.e., more than two capacitors. [ABSTRACT FROM AUTHOR]

We study power-allocation problems in wireless systems through a network utility maximization framework. In this framework, the type of utility function represents the characteristics of each service. Hence, to deal with multiclass services in the system, it is important to accommodate various types of utility functions. In this paper, we consider four types of utility functions that can represent most of the services in wireless networks. We first develop a simple algorithm that solves a general optimization problem with those four types of utility function. We show that, even though the proposed algorithm might not provide the optimal solution, it provides an asymptotically optimal solution, which could be a good approximation to the optimal solution. The proposed algorithm can be applied to various resource-allocation problems in wireless systems. Among them, in this paper, we show that the proposed algorithm can be applied to both uplink and downlink power-allocation problems. [ABSTRACT FROM AUTHOR]

This paper solves the variation-aware decoupling capacitance (decap) budgeting problem. Unlike previous works which only consider worst case design, for the first time, we consider the input of both process variation and operation variation for decap budgeting. A novel stochastic current model is proposed that efficiently and accurately captures temporal correlation between clock cycles, logic-induced correlation between ports, and current variation due to process variation with spatial correlation. An iterative alternative programming algorithm that is applicable to a variety of current models is then developed. Compared with the baseline model which assumes maximum current peaks at all ports, the model considering temporal correlation reduces noise by up to 5×, and the model considering both temporal and logic-induced correlations reduces noise by up to 17×. Compared with using deterministic process parameters, considering process variation (in particular Leff variation) reduces the mean noise by up to 4× and 3σ noise by up to 13× when both applying the current model with temporal and logic-induced correlations. Note that stochastic optimization has been used mainly for process variation in the literature, but this paper convincingly demonstrate that stochastic optimization considering operation variation is effective to reduce overdesign introduced by worst case design for power integrity. Such stochastic optimization has a wide scope of applications to design problems. To the best of our knowledge, this is the first in-depth study on decap insertion for power network design considering current correlations including process variation. [ABSTRACT FROM AUTHOR]

The first step in a reliability optimization process is to make a reliability assessment for each component in the system. If this assessment is made in a qualitative way, by grouping together components with the same reliability, and establishing a prevalence order among groups, is there a way to decide which components have the greatest Birnbaum measure without computing the exact value of this measure? In this paper, three relations between components are introduced and studied, and it is proved that they are useful for selecting the components that have the biggest effect on the system reliability in the sense of Birnbaum. An algorithm that uses the results in the paper to select these important components is also provided. [ABSTRACT FROM AUTHOR]