Search

This paper presents an extensive study of linear and logistic regression algorithms implemented with 1T1R memristor crossbars arrays. Using a sophisticated simulation platform that wraps circuit-level simulations of 1T1R crossbars and physics-based models of RRAM (memristors), we elucidate the impact of device variability on algorithm accuracy, convergence rate and precision. Moreover, a smart pulsing strategy is proposed for practical implementation of synaptic weight updates that can accelerate training in real crossbar architectures. Stochastic multi-variable linear regression shows robustness to memristor variability in terms of prediction accuracy but reveals impact on convergence rate and precision. Similarly, the stochastic logistic regression crossbar implementation reveals immunity to memristor variability as determined by negligible effects on image classification accuracy but indicates an impact on training performance manifested as reduced convergence rate and degraded precision. [ABSTRACT FROM AUTHOR]

In this paper, a unified framework is proposed to address the synchronization problem of memristor chaotic systems (MCSs) via the sliding-mode control method. By employing the presented unified framework, the finite-time and fixed-time synchronization of MCSs can be realized simultaneously. On the one hand, based on the Lyapunov stability and sliding-mode control theories, the finite-/fixed-time synchronization results are obtained. It is proved that the trajectories of error states come near and get to the designed sliding-mode surface, stay on it accordingly and approach the origin in a finite/fixed time. On the other hand, we develop an image encryption algorithm as well as its implementation process to show the application of the synchronization. Finally, the theoretical results and the corresponding image encryption application are carried out by numerical simulations and statistical performances. [ABSTRACT FROM AUTHOR]

This paper addresses the finite-time and fixed-time bipartite average tracking (BAT) problems in multi-agent systems (MASs) subject to bounded disturbances. A novel non-smooth protocol is first constructed on the basis of utilizing the finite-time control method, which can realize the finite-time BAT with structurally balanced graph. Then, the fixed-time BAT problem is dealt with nonlinear fixed-time algorithm, the setting time of which is obtained without depending on initial states. By employing Lyapunov stability theory, some sufficient criteria are obtained to achieve the finite-time and fixed-time BAT for MASs with disturbances. Numerical examples are finally developed for illustration. [ABSTRACT FROM AUTHOR]

Piecewise affine (PWA) systems are attractive models that can represent various hybrid systems with local affine subsystems and polyhedral regions due to their universal approximation properties. The identification problem of PWA systems amounts to estimating the number of subsystems, parameters of each subsystem, and the corresponding polyhedral partitions via state-input vectors. In this paper, we propose a novel approach to address the online identification problem of continuous-time PWA systems in state-space form. Specifically, an online active mode recognition algorithm and a generalized integral concurrent learning identifier are presented to acquire the number of subsystems, the switching sequence, and the parameter of each subsystem. In addition, we develop the optimization problem for the polyhedral partition estimation, which is solved by using the estimated switching sequence and subsystem parameters. The effectiveness of the proposed identification approach is demonstrated via simulation results. [ABSTRACT FROM AUTHOR]

Deep Neural Networks (DNNs) are increasingly being used in a variety of applications. However, DNNs have huge computational and memory requirements. One way to reduce these requirements is to sparsify DNNs by using smoothed LASSO (Least Absolute Shrinkage and Selection Operator) functions. In this paper, we show that irrespective of error profile, the sparsity values obtained using various smoothed LASSO functions are similar, provided the maximum error of these functions with respect to the LASSO function is the same. We also propose a layer-wise DNN pruning algorithm, where the layers are pruned based on their individual allocated accuracy loss budget, determined by estimates of the reduction in number of multiply-accumulate operations (in convolutional layers) and weights (in fully connected layers). Further, the structured LASSO variants in both convolutional and fully connected layers are explored within the smoothed LASSO framework and the tradeoffs involved are discussed. The efficacy of proposed algorithm in enhancing the sparsity within the allowed degradation in DNN accuracy and results obtained on structured LASSO variants are shown on MNIST, SVHN, CIFAR-10, and Imagenette datasets and on larger networks such as ResNet-50 and Mobilenet. [ABSTRACT FROM AUTHOR]

Sparsified kernel adaptive filters (SKAFs) is an attractive filtering solution with low memory and computational complexity. Most of existing SKAFs are based on the mean square error (MSE) criterion under Gaussian noise assumption for its simplicity and convenience. When the assumption deviates largely from the underlying truth, the performance of these methods could degrade significantly. In this paper, we propose a novel SKAF, named as projected kernel least mean p-power algorithm (PKLMP), based on the mean p-power error (MPE) criterion and vector projection (VP) method. We provide convergence analyses in terms of the stead-state MSE, based on a Taylor expansion method, and derive the lower and upper bounds for the steady-state excess MSE. We also conduct mean convergence analysis for PKLMP, and derive convergence conditions. To exploit the information in the desired outputs, we further derive a modified PKLMP by smoothing the desired signal. Finally, a simple and effective online variable kernel centers strategy is proposed to improve the filtering performance of the proposed KAFs. Simulation results under a static function estimation, a chaotic time-series prediction, and two real-world time-series predictions are conducted and validate the effectiveness of the proposed PKLMP algorithms. [ABSTRACT FROM AUTHOR]

This paper presents a COordinate Rotation Digital Computer (CORDIC)-based architecture for the computation of Nth root and proves its feasibility by hardware implementation. The proposed architecture performs the task of Nth root simply by shift-add operations and enables easy tradeoff between the speed (or precision) and the area. Technically, we divide the Nth root computation into three different subtasks, and map them onto three different classes of the CORDIC accordingly. To overcome the drawback of narrow convergence range of the CORDIC algorithm, we adopt several innovative methods to yield a much improved convergence range. Subsequently, in terms of convergence range and precision, a flexible architecture is developed. The architecture is validated using MATLAB with extensive vector matching. Finally, using a pipelined structure with fixed-point input data, we implement the example circuits of the proposed architecture with radicand ranging from zero to one million, and achieve an average mean of approximately 10−7 for the relative error. The design is modeled using Verilog HDL and synthesized under the TSMC 40-nm CMOS technology. The report shows a maximum frequency of 2.083 GHz with $197421.00~{\mu }\text{m}^{2}$ area. The area decreases to $169689.98~{\mu }\text{m}^{2}$ when the frequency lowers to 1.00 GHz. [ABSTRACT FROM AUTHOR]

This paper presents a family of robust set-membership normalized subband adaptive filtering (RSM-NSAF) algorithms for acoustic echo cancellation (AEC). By using a new robust set-membership error bound, the RSM-NSAF algorithm obtains improved robustness against impulsive noises and decreased steady-state misalignment relative to the conventional set-membership NSAF (SM-NSAF) algorithm. To exploit the sparsity of the impulse response, the L0 norm constraint robust set-membership NSAF ( L0 -RSM-NSAF), robust set-membership improved proportionate NSAF (RSM-IPNSAF), and L0 norm constraint robust set-membership improved proportionate NSAF ( L0 -RSM-IPNSAF) algorithms are derived by minimizing a differentiable cost function that utilizes the Riemannian distance between the updated and previous weight vectors as well as the L0 norm of the weighted updated weight vector. Simulations in AEC application confirm the improvements of the proposed algorithms in performance. [ABSTRACT FROM PUBLISHER]

This article proposes a robust method for the synthesis and design of optimal linear group delay filters with prescribed bandwidth and dispersion properties. The proposed filters are based on a cascade of second-order all-pass filter cells, for which all the parameters are optimized in order to reach the desired wideband linear group delay characteristic with positive slope. Compared to the previously published synthesis method, the proposed approach offers appropriate initialization enabling convergence and aiming for the optimal solution. The method’s convergence and robustness are proved through a 21-cells synthesis, which is the highest number of cascaded cells reported to date, due to the usual convergence problem. Then the electronic feasibility is illustrated through the measurement results of a lumped-elements linear group-delay filter prototype dimensioned with this method. The measured group delay presents a positive slope of 8 ns GHz−1 in the frequency range [100–725] MHz. It is, to the best of our knowledge, the highest positive slope reported to date with an electronic implementation (i.e except SAW and waveguide devices). [ABSTRACT FROM AUTHOR]

The convergence of the waveform relaxation (WR) method is demonstrated for a class of circuits: Chains of identical and symmetrical passive subcircuits. The WR algorithm uses resistive coupling to implement the iteration. Every part is modeled as a symmetric and reciprocal linear two-port network. The iteration matrices of the WR operator are constructed for the Gauss-Jacobi and Gauss-Seidel relaxations in the Fourier domain. An upperbound estimate of the spectral radius of the WR operator is presented. It demonstrates the convergence of the method independently of the number of cascaded parts in the chain and the coupling resistance. [ABSTRACT FROM AUTHOR]

Predefined mymargin finite-time output containment control problem for nonlinear multi-agent systems with multiple dynamical leaders under directed topology is investigated, where the outputs of followers can converge to the predefined convex hull formed by the multiple leaders within a finite time, and the leaders can have unknown control inputs. Firstly, for the directed topological structure among the followers, a distributed adaptive observer is designed to estimate the whole states of all the leaders under the influences of the leaders’ unknown inputs. By utilizing Hardy’s inequality and common Lyapunov theory, the finite-time convergence of the proposed observer is proved. On the basis of this conclusion, a predefined distributed containment control protocol including the desired convex combinations of the leaders is developed for each follower by using the given weights. Then an algorithm is proposed to design the control parameters in the proposed containment control protocol. With the help of the output regulation theory, the finite-time output containment criterion for nonlinear multi-agent systems in the presence of the leaders’ unknown inputs is derived. Finally, a numerical simulation example is presented to demonstrate the effectiveness of the theoretical results. [ABSTRACT FROM AUTHOR]

This paper discusses consensus problems for multiagent networks under directed communication graphs. The motions of agents are described by impulsive differential equations, and thus, consensus algorithms can be designed in terms of impulsive systems. Different from the standard consensus algorithms which rely on continuous-time or discrete-time models, the proposed algorithms based on impulsive systems take advantages of instantaneous information. It is shown that the proposed algorithms have a faster convergence speed than the standard consensus algorithms. Moreover, conditions under which all agents reach consensus with the desired performance are presented for the multiagent networks with external disturbances. Simulation results demonstrate the effectiveness of the proposed algorithms. [ABSTRACT FROM AUTHOR]

This paper studies the statistical behavior of the normalized subband adaptive filtering (NSAF) algorithm. An accurate statistical model of the NSAF algorithm is obtained. In the derivation, we focus on Gaussian correlated input signals. By assuming that the analysis filter bank is paraunitary and taking into account the full band adaptation mechanism of the NSAF, expressions for the first and the second moments of the adaptive filter weights are derived without invoking the slow adaptation assumption. In the derivations, several hyperelliptic integrals appear. To tackle those integrals induced by Gaussian correlated inputs, we first give a solution by resorting to the adaptive Lobatto quadrature. By invoking the averaging principle, two other approximation methods, the chi-square method and the partial fraction expansion method, are presented to approximate the statistical model as well. Monte Carlo (MC) simulation results corroborate our predictions. The Lobatto quadrature method achieves a good agreement with the MC simulation results, even for a relatively large step size. Compared with the chi-square method and the partial fraction expansion method, the Lobatto quadrature method gives better performance in terms of predicting the mean square error when the length of the adaptive filters is small to medium. The chi-square approximation method and the partial fraction expansion method give a satisfactory performance with a relatively low computational complexity when the filter length is large. [ABSTRACT FROM PUBLISHER]

An adaptive filtering algorithm is proposed in this paper to remove I/Q mismatch, dc offsets, flicker noise, and intersymbol interference (ISI) simultaneously in a direct-conversion receiver. I/Q mismatch is cancelled by a real valued adaptive mismatch canceller, and dc offsets are removed with one complex tap. In addition, flicker noise is modeled as a complex autoregressive (AR) random process so the system to be identified transforms to an ARX model. After estimating the coefficients in the model during the training period, the desired signal can be estimated using the decision feedback method. To accelerate the convergence of the algorithm and to reduce the estimation variance, an internal iterative algorithm is introduced. The convergence analysis of the proposed algorithm is also given, and the closed form of the minimum mean square error of the proposed algorithm is derived. Simulation results are provided to verify the superior performance of the proposed algorithm. [ABSTRACT FROM AUTHOR]

The statistical performances of the conventional adaptive Fourier analyzers, such as the least mean square (LMS), the recursive least square (RLS) algorithms, and so forth, may degenerate significantly, if the signal frequencies given to the analyzers are different from the true signal frequencies. This difference is referred to as frequency mismatch (FM). In this paper, we analyze extensively the performance of the conventional LMS Fourier analyzer in the presence of FM. Difference equations governing the dynamics and closed-form steady-state expression for the estimation mean square error (MSE) of the algorithm are derived in detail. It is revealed that the discrete Fourier coefficient (DFC) estimation problem in the LMS eventually reduces to a DFC tracking one due to the FM, and an additional term derived from DFC tracking appears in the closed-form MSE expression, which essentially deteriorates the performance of the algorithm. How to derive the optimum step size parameters that minimize or mitigate the influence of the FM is also presented, which can be used to perform robust design of step size parameters for the LMS algorithm in the presence of FM. Extensive simulations are conducted to reveal the validity of the analytical results. [ABSTRACT FROM AUTHOR]

CORDIC algorithm is suitable to implement sine/cosine function, but the large number of iterations lead to great delay and overhead. Moreover, due to finite bit-width of operands and number of iterations, the relative error of floating-point sine or cosine is terrible when the input angle is close to 0 or $\pi /2$ , respectively. To overcome these shortcomings, TCORDIC algorithm, which combines low latency CORDIC and Taylor algorithm, is presented. After analyzing the latency of traditional CORDIC, low latency CORDIC is proposed, which adopts the technique of sign prediction, compressive iterations, and parallel iterations. Besides, the calculating boundary ( N$ ), which is used for determining whether Taylor algorithm is selected or not in TCORDIC algorithm, is evaluated to achieve a trade-off between area and delay. Truncated multipliers are used to reduce the area further. Finally, Using TCORDIC algorithm, pipelined and iterative structures are implemented for IEEE-754 double precision floating-point sine/cosine with the input Z\epsilon [0,\pi /2]$ . Under typical condition (1V, 25 °C), our designs are synthesized with 40 nm standard cell library. For a pipelined structure, the frequency is up to 1.70 GHz and area . Frequency decreases to 1.45 GHz for iterative structure, but the area requires only 110590.81~\mu {\mathrm { m}}^{2} . TCORDIC is efficient in controlling relative error, and achieves the accuracy within one ulp (unit in the last place) for floating-point sine/cosine function. [ABSTRACT FROM AUTHOR]

A nonlinear system being composed of multiadaptive notch filters in parallel is introduced to track the sinusoidal components of an almost periodic signal and estimate their frequencies and amplitudes. An almost periodic nonlinear dynamic system for estimation of frequencies is achieved after the existence of a slow integral manifold is proved and results in a nonlinear autonomous system with averaging method employed. Three types of local stability of the autonomous system, the exponential stability in isolated equilibrium point and the semistability on center manifold and the ultimate boundedness under unknown periodic disturbance, are respectively investigated. The transient performance is affected by frequency adaptive gain independent of bandwidth parameter. The validity of the proposed algorithm is verified by simulation results. [ABSTRACT FROM PUBLISHER]

Dynamic programming (DP) is a fundamental algorithm for complex optimization and decision-making in many engineering and biomedical systems. However, conventional DP computation based on digital implementation of the Bellman–Ford recursive algorithm suffers from the “curse of dimensionality” and substantial iteration delays which hinder utility in real-time applications. Previously, an ordinary differential equation system was proposed that transforms the sequential DP iteration into a continuous-time parallel computational network. Here, the network is realized using a CMOS current-mode analog circuit, which provides a powerful computational platform for power-efficient, compact, and high-speed solution of the Bellman formula. Test results for the fabricated DP optimization chip demonstrate a proof of concept for this solution approach. We also propose an error compensation scheme to minimize the errors attributed to nonideal current sources and device mismatch. [ABSTRACT FROM PUBLISHER]

An improved quasi-Newton (QN) algorithm that performs data-selective adaptation is proposed whereby the weight vector and the inverse of the input-signal autocorrelation matrix are updated only when the a priori error exceeds a prespecified error bound. The proposed algorithm also incorporates an improved estimator of the inverse of the autocorrelation matrix. With these modifications, the proposed QN algorithm takes significantly fewer updates to converge and yields a reduced steady-state misalignment relative to a known QN algorithm proposed recently. These features of the proposed QN algorithm are demonstrated through extensive simulations. Simulations also show that the proposed QN algorithm, like the known QN algorithm, is quite robust with respect to roundoff errors introduced in fixed-point implementations. [ABSTRACT FROM PUBLISHER]

The determination of the available transfer capability (ATC) is formulated as a problem of finding the solution of a system of equations using the pointwise maximum function, which collapses all operating constraints of the system into one equation. The resulting equations are semismooth. The semismooth equations are solved by the use of a smoothing function. Two solution algorithms are presented. One is a smoothing Newton method in which the smoothing parameter is treated as an independent variable. Another one is a smoothing decoupled Newton method, which incorporates the inherent weak-coupling characteristics of power systems into the algorithm and is suitable for solving large scale problems. The convergence of the two algorithms is studied in detail. A numerical example is presented to illustrate the effectiveness of the proposed methods. [ABSTRACT FROM AUTHOR]