Search

In this paper, we analyze the generalization performance of the Iterative Hard Thresholding (IHT) algorithm widely used for sparse recovery problems. The parameter estimation and sparsity recovery consistency of IHT has long been known in compressed sensing. From the perspective of statistical learning, another fundamental question is how well the IHT estimation would predict on unseen data. This paper makes progress towards answering this open question by introducing a novel sparse generalization theory for IHT under the notion of algorithmic stability. Our theory reveals that: 1) under natural conditions on the empirical risk function over $n$ samples of dimension $p$ , IHT with sparsity level $k$ enjoys an $\tilde {\mathcal {O}}(n^{-1/2}\sqrt {k\log (n)\log (p)})$ rate of convergence in sparse excess risk; 2) a tighter $\tilde {\mathcal {O}}(n^{-1/2}\sqrt {\log (n)})$ bound can be established by imposing an additional iteration stability condition on a hypothetical IHT procedure invoked to the population risk; and 3) a fast rate of order $\tilde {\mathcal {O}}\left ({n^{-1}k(\log ^{3}(n)+\log (p))}\right)$ can be derived for strongly convex risk function under proper strong-signal conditions. The results have been substantialized to sparse linear regression and sparse logistic regression models to demonstrate the applicability of our theory. Preliminary numerical evidence is provided to support our theoretical predictions. [ABSTRACT FROM AUTHOR]

Contributions: The underrepresentation of women in computer science (CS) majors has long been a focus of attention in many academic documents, the majority of them from the United States and Europe. There is, however, a lack of information about educational interventions (EIs) for women in computing in Latin America. The contribution of this article is to cover this gap and describe what researchers in Latin American countries have been publishing about the recruitment and retention of women in the CS field. Background: Many EIs targeting female students at different educational levels—K-12, undergraduate, and graduate—have been undertaken to increase the participation of women in computing in Latin America. However, descriptions of these activities rarely are included in international academic databases. Research Questions: This literature mapping addresses two main research questions (RQ) about the topic of women in computing in academic publications in Latin American countries: RQ1) what are the characteristics of the publications about women in computing in Latin America? and RQ2) what are the published interventions to recruit and retain women in computing in Latin America? To answer RQ1, six subquestions were created covering year, language, country of origin, document type, and professional track. Furthermore, for RQ2, two subquestions were created involving educational level and the use of software development with a female theme. Methodology: This investigation used the systematic literature mapping process. To achieve a broad coverage of papers, the following sources were included: Scopus, Web of Science, Google Scholar, EBSCO, the proceedings of the Latin American Women in Computing Conference (LAWCC), and those of the Women in Technology (WIT) workshop colocated with the annual conference of the Brazilian Computer Society (SBC). The included papers were published in the last decade (2010–2020) and written in English, Portuguese, or Spanish. Findings: The literature mapping encompasses 197 academic documents, 48.2% of which were written in Portuguese, 28.7% in English, and 23.1% in Spanish. The papers originated from 15 of the 20 Latin American countries. Brazil and Costa Rica have the highest number of publications overall. The documents describe initiatives to increase the participation of women in computing majors that cover the entire educational spectrum, from K-12 to graduate programs, but papers targeting populations in higher education have started to appear recently. [ABSTRACT FROM AUTHOR]

This paper explores the feasibility and scope of co-channel coexistence between a low data rate Orthogonal Frequency Division Multiplexing (OFDM) secondary network and a digital television (DTV) broadcast network operating in the same area. Since DTV receivers do not transmit, neither the presence nor the impact of interference from the secondary network on these DTV receivers can be known. Consequently, conventional spectrum sensing techniques cannot be employed effectively. This paper proposes to compensate the lack of feedback by combining the available information about population distribution in the region - ranging from coarse population density estimates to accurate geospatial maps - with better estimation of interference using a data-driven technique called Ordinary Kriging. Radio Environment Maps constructed using the Kriging method from field-reported observations from the secondary nodes are used to obtain better accuracy than the conventional statistical models. The estimates are then used to compute communication parameters for each secondary link in terms of power, number of active subcarriers, and active time slots, while keeping the average interference in the DTV network within threshold bounds. Thus, the viability of such co-channel license-exempt operation of secondary networks in the DTV black and grey spaces for low data rate applications in densely populated urban areas and higher data rate capabilities for sparsely populated rural areas is established. [ABSTRACT FROM AUTHOR]

This paper considers the problem of adaptive group testing for isolating up to $k$ defective items from a population of size $n$. There exist restrictions or preferences which determine how the items can be pooled for testing. A graphical model formalizes the pooling restrictions and preferences. Such graph-constrained group testing is investigated in three settings: populations with defectives, populations facing the potential presence of inhibitors, and populations with community structures. Adaptive group testing frameworks are provided for each setting. In populations without inhibitors, existing non adaptive frameworks can isolate the defective items perfectly with $\Theta(k \log n/k)$ number of tests, where is the $\beta$ -mixing time of a random walk over the underlying graph. This paper provides a two-stage framework that can perfectly isolate up to $k$ defective items for a regular graph using $\Theta(k2 \log n k + k)$ number of tests, thus achieving an approximate gain of a factor of $k$ over the non-adaptive frameworks. This twostage framework's principles are extended to community-structured graphs and graphs with up to $r$ inhibitor items. In particular, when inhibitors are present in the graph, a four-stage group testing framework is proposed. The results show that in the regime $r= O(k)$ for a fully connected graph, $\Theta ((k+r)\log n/(k+r) + r\log n)$ tests are sufficient for isolating the defective items. This matches the corresponding necessary condition on tests which scales $(k+r)\log n$. The adaptive graphconstrained group testing framework is also empirically evaluated. [ABSTRACT FROM AUTHOR]

Let $\mathrm {W}\in \mathbb {C}^{n\times n}$ be a single-spiked Wishart matrix in the class $\mathrm {W}\sim \mathcal {CW}_{n}(m,\mathrm {I}_{n}+ \theta \mathrm {v}\mathrm {v}^{\dagger}) $ with $m\geq n$ , where ${\mathrm {I}}_{n}$ is the $n\times n$ identity matrix, $\mathrm {v}\in \mathbb {C}^{n\times 1}$ is an arbitrary vector with unit Euclidean norm, $\theta \geq 0$ is a non-random parameter, and $(\cdot)^{\dagger} $ represents the conjugate-transpose operator. Let u1 and ${\mathrm {u}}_{n}$ denote the eigenvectors corresponding to the smallest and the largest eigenvalues of W, respectively. This paper investigates the probability density function (p.d.f.) of the random quantity $Z_{\ell }^{(n)}=\left |{\mathrm {v}^{\dagger} \mathrm {u}_\ell }\right |^{2}\in (0,1)$ for $\ell =1,n$. In particular, we derive a finite dimensional closed-form p.d.f. for $Z_{1}^{(n)}$ which is amenable to asymptotic analysis as $m,n$ diverges with $m-n$ fixed. It turns out that, in this asymptotic regime, the scaled random variable $nZ_{1}^{(n)}$ converges in distribution to $\chi ^{2}_{2}/2(1+\theta)$ , where $\chi _{2}^{2}$ denotes a chi-squared random variable with two degrees of freedom. This reveals that u1 can be used to infer information about the spike. On the other hand, the finite dimensional p.d.f. of $Z_{n}^{(n)}$ is expressed as a double integral in which the integrand contains a determinant of a square matrix of dimension $(n-2)$. Although a simple solution to this double integral seems intractable, for special configurations of $n=2,3$ , and 4, we obtain closed-form expressions. [ABSTRACT FROM AUTHOR]

Understanding intra-urban human mobility patterns and their potential driving forces are vital to city planning and commercial site selection. In this paper, we first investigate the functions of urban regions and how different region types dynamically influence people’s trip decisions. Furthermore, we characterize urban circadian rhythms by time-vary inter-regional transition probabilities between these regions with different functions, and integrate them into intervening opportunity model to predict human mobility. Public transportation card data in Shanghai are used to demonstrate the effectiveness of the model in terms of station passenger flows, travel time and trip flux. By taking regional function into consideration, the proposed model significantly improved the prediction accuracy. Quantitative analysis ulteriorly indicates that trip intentions and regional features are critical elements in trip flux prediction, especially in the afternoon and evening when people have an abundance of opportunities to travel by their own volition. When the function of a certain region changes, our model is able to make reasonable predictions accordingly. The results indicate the importance of considering individual travel motivation and regional function in modeling human mobility. The proposed model could serve as a guide for popularity and trip flux prediction in urban planning and reconstruction. [ABSTRACT FROM AUTHOR]

Pattern mining (PM) refers to the process of discovering patterns of interest to users from data. However, most studies have considered only one pattern, such as frequent pattern or high-utility pattern. With the continuous requirement of businesses in various industries, the single-objective PM methods are difficult to meet the increasingly diverse needs of users. In this paper, a multi-objective problem model for high quality pattern mining (HQPM) is proposed, where the objectives are support, occupancy, and utility. In order to solve the proposed three-objective problem efficiently, an improved multi-objective evolutionary algorithm for HQPM (MOEA-PM) is proposed. Two kinds of population initialization strategies are designed, which is used to ensure the population is effectively distributed in the feasible solution space. By taking the properties of the model into consideration, an auxiliary tool is proposed to accelerate the convergence of the algorithm. Experimental results on real-world datasets show that the proposed three-objective problem model with the MOEA-PM algorithm can discover patterns that are both frequently occurring and has a high utility in the transaction datasets, while at the same time being relatively complete. Compared with the state-of-the-art MOEA-based HQPM algorithms, MOEA-PM has better performance in terms of efficiency, quality, and convergence speed. [ABSTRACT FROM AUTHOR]

Rapid urbanization, high city population growth rates, technological development, environmental impacts, and human wellbeing in urban areas have over the years become increasingly challenging concerns. These trends are related to the complex, multiple factors to be considered when evaluating “smart” cities, that is, municipalities that seek to improve residents’ quality of life by combining new technologies and environmentally sustainable practices. The above tendencies thus add to the myriad of indicators that need to be included in smart city assessments, whose intricacy hinders related decision-making processes. Based on the principles of multiple-criteria decision analysis, this paper seeks to integrate cognitive mapping and the Choquet integral to develop an assessment system that facilitates the evaluation of smart cities, which was named “SMART-C.” The research includes a panel of experts on smart cities who identifies the evaluation criteria and their respective interactions. The results of a real-life application of the assessment system developed in this paper are validated both by the panel members and a representative of the Lisboa E-Nova nonprofit association of the Lisbon City Council's Environment and Energy Department. These experts confirm that the proposed evaluation system facilitates making distinctions between cities according to how fully they develop “smartness.” The advantages and limitations of this assessment framework are also discussed. [ABSTRACT FROM AUTHOR]

Knowledge graph is becoming an indispensable resource that offers structured information for numerous AI applications. However, the knowledge graph often suffers from its incompleteness. Building a complete, high-quality knowledge graph is time-consuming and requires significant human annotation efforts. In this paper, we study the Knowledge Graph Population task, which aims at extending the scale of structured knowledge, with a special focus on reducing data preparation and annotation efforts. Previous works mainly based on discriminative methods build classifiers and verify candidate triplets that are extracted from texts, which heavily rely on the quality of data collection and co-occurrance of entities in the text. However, such methods fail to generalize on entity pairs that are not highly co-occurred, and fail to discover entity pairs that are not co-occurred at all in the given text corpus. We introduce a generative perspective to approach this task and define each relationship by learning the data distribution that embodies the core common properties for relational reasoning. A generative model KGGen is proposed, which samples from the learned data distribution for each relation and can generate triplets regardless of entity pair co-occurrence in the text corpus. To further improve the generation quality while alleviate human annotation efforts, adversarial learning is adopted to not only encourage generating high quality triplets, but also give model the ability to automatically assess the generation quality. Quantitative and qualitative experimental results conducted on two real-world generic knowledge graphs show that the proposed model KGGen generates novel and meaningful triplets with improved efficiency and less human annotation comparing with the state-of-the-art approaches. [ABSTRACT FROM AUTHOR]

Hybrid flow shop scheduling problems have gained an increasing attention in recent years because of its wide applications in real-world production systems. Most of the prior studies assume that the processing time of jobs is deterministic and constant. In practice, jobs’ processing time is usually difficult to be exactly known in advance and can be influenced by many factors, e.g., machines’ abrasion and jobs’ feature, thereby leading to their uncertain and variable processing time. In this paper, a dual-objective stochastic hybrid flow shop deteriorating scheduling problem is presented with the goal to minimize makespan and total tardiness. In the formulated problem, the normal processing time of jobs follows a known stochastic distribution, and their actual processing time is a linear function of their start time. In order to solve it effectively, this paper develops a hybrid multiobjective optimization algorithm that maintains two populations executing the global search in the whole solution space and the local search in promising regions, respectively. An information sharing mechanism and resource allocating method are designed to enhance its exploration and exploitation ability. The simulation experiments are carried out on a set of instances, and several classical algorithms are chosen as its peers for comparison. The results demonstrate that the proposed algorithm has a great advantage in dealing with the investigated problem. [ABSTRACT FROM AUTHOR]

Multiple solutions are often needed because of different kinds of uncertain failures in a plan execution process and scenarios for which precise mathematical models and constraints are difficult to obtain. This paper proposes an optimization strategy for multirobot task allocation (MRTA) problems and makes efforts on offering multiple solutions with same or similar quality for switching and selection. Since the mentioned problem can be regarded as a multimodal optimization one, this paper presents a niching immune-based optimization algorithm based on Softmax regression (sNIOA) to handle it. A prejudgment of population is done before entering an evaluation process to reduce the evaluation time and to avoid unnecessary computation. Furthermore, a guiding mutation (GM) operator inspired by the base pair in theory of gene mutation is introduced into sNIOA to strengthen its search ability. When a certain gene mutates, the others in the same gene group are more likely to mutate with a higher probability. Experimental results show the improvement of sNIOA on the aspect of accelerating computation speed with comparison to other heuristic algorithms. They also show the effectiveness of the proposed GM operator by comparing sNIOA with and without it. Two MRTA application cases are tested finally. [ABSTRACT FROM AUTHOR]

This paper considers the problem of secure parameter estimation when an estimation algorithm is prone to causative attacks. Causative attacks, in general, target decision-making algorithms (e.g., inference or learning algorithm) to alter their decisions in specific scenarios (e.g., distort parameter estimates for specific ranges of the parameter of interest). Such attacks influence the decisions via tampering with the mechanisms through which an algorithm acquires the statistical model of the population about which it aims to form a decision. Such attacks are viable, for instance, by contaminating the historical or training data, or by compromising an expert who provides the statistical model. In the presence of causative attacks, inference algorithms operate under a distorted statistical model for the data samples. This paper introduces a notion of secure parameter estimation and formalizes a framework under which secure estimation can be formulated and analyzed. The central premise underlying the secure estimation framework is that forming secure estimates introduces a new dimension to the estimation objective, pertaining to detecting attacks and isolating the true model. Since detection and isolation decisions themselves are imperfect, their inclusion induces an inherent coupling between the desired secure estimation objective and the auxiliary detection and isolation decisions that need to be formed in conjunction with the estimates. This paper establishes the fundamental interplay among these decisions, and characterizes the general decision rules in closed-forms for any desired estimation cost function. Furthermore, to circumvent the computational complexity associated with growing parameter dimension or attack complexity, a scalable estimation algorithm is provided, which is shown to enjoy certain optimality guarantees. Finally, the theory developed is applied to secure parameter estimation in sensor networks. [ABSTRACT FROM AUTHOR]

Objective: Despite numerous neural computational models proposed to explain physiological and pathological mechanisms of brain activity, a large gap remains between theory and application of the models. Building on the successful application of data-driven methods in epileptic seizure detection, we aim to build a bridge between data and models in this paper. Methods: We first propose a novel model-driven seizure detection method based on dynamic features in epileptic EEGs, where the rationale for dynamic features in epileptic EEGs can be clarified in theory by characterizing the variation of parameters of the model. Then we apply the proposed D&F-model-driven method to the problem of early epileptic seizure detection, where the evolution of model parameters selected and optimized by the proposed method is measured and used to detect the starting point of the seizure. Results: Numerical results on two open EEG databases demonstrate that our proposed method does a good job of early epileptic seizure detection. The average detection sensitivity, false positive rate and early detection period attain 100%, 0.1/h, and 7.1 s respectively. Conclusion: This paper provides a strategy to characterize EEG signals using a NMM-related method and the model parameters optimized by real EEG may then serve as features in their own right for early seizure detection. Significance: An useful attempt to early detect epileptic seizures by combining the neural mass model with data analysis. [ABSTRACT FROM AUTHOR]

Vehicle-to-vehicle (V2V) communications is an important technology in vehicular ad hoc network (VANET) to support autonomous data exchange among vehicles. Multiple V2V communications modes have been investigated for VANET, including dedicated short-range communications (DSRC) based on IEEE 802.11p and LTE-V2X, which are suitable for different packet transmission cases. In order to fully exploit the strengths of various modes, hybrid V2V communications strategies are designed in this paper, where each vehicle is allowed to choose different modes for different kinds of transmissions in separate frequency bands for transmission throughput improvement. Furthermore, since it is usually impractical to decide all the vehicles’ communications strategies globally due to high computational complexity and heavy overhead to broadcast the decisions, we model the selection of hybrid V2V communications strategies for vehicles as an evolutionary game. A strategy selection algorithm is then proposed, where each vehicle can select its hybrid V2V communications strategy locally based on its evaluation of the payoffs for different strategies and limited signalling from the base station. Simulation results demonstrate that the proposed algorithm can converge to an asymptotic stable state, which can improve the transmission throughput of vehicles, and is robust to the slight evaluation errors of payoffs and the strategy mutations of a few vehicles. [ABSTRACT FROM AUTHOR]

Objective: Preterm birth is the first cause of perinatal morbidity and mortality. Despite continuous clinical routine improvements, the preterm rate remains steady. Moreover, the specificity of the early diagnosis stays poor as many hospitalized women for preterm delivery threat finally deliver at term. In this context, the use of electrohysterograms may increase the sensitivity and the specificity of early diagnosis of preterm labor. Methods: This paper proposes a clinical application of electrohysterogram processing for the classification of patients as prone to deliver within a week or later. The approach relies on non-linear correlation analysis for the contraction bursts extraction and uses computation of various features combined with the use of Gaussian mixture models for their classification. The method is tested on a new dataset of 68 records collected on women hospitalized for preterm delivery threat. Results: This paper presents promising results for the automatic segmentation of the contraction and a classification sensitivity, specificity, and accuracy of, respectively, 80.7%, 76.3%, and 76.2%. Conclusion: These results are in accordance with the gold standards but have the advantage to be non-invasive and could be performed at home. Significance: Diagnosis of imminent labor is possible by electrohysterography recording and may help in avoiding over-medication and in providing better cares to at-risk pregnant women. [ABSTRACT FROM AUTHOR]

This paper presents fuzzy ${c}$ -means-based yield estimation (FUZYE), a methodology that reduces the time impact caused by Monte Carlo (MC) simulations in the context of analog integrated circuits (ICs) yield estimation, enabling it for yield optimization with population-based algorithms, e.g., the genetic algorithm (GA). MC analysis is the most general and reliable technique for yield estimation, yet the considerable amount of time it requires has discouraged its adoption in population-based optimization tools. The proposed methodology reduces the total number of MC simulations that are required, since, at each GA generation, the population is clustered using a fuzzy ${c}$ -means (FCMs) technique, and, only the representative individual (RI) from each cluster is subject to MC simulations. This paper shows that the yield for the rest of the population can be estimated based on the membership degree of FCM and RIs yield values alone. This new method was applied on two real circuit-sizing optimization problems and the obtained results were compared to the exhaustive approach, where all individuals of the population are subject to MC analysis. The FCM approach presents a reduction of 89% in the total number of MC simulations, when compared to the exhaustive MC analysis over the full population. Moreover, a ${k}$ -means-based clustering algorithm was also tested and compared with the proposed FUZYE, with the latest showing an improvement up to 13% in yield estimation accuracy. [ABSTRACT FROM AUTHOR]

Objective: The goal of this paper was to optimize robust PID control for propofol anesthesia in children aged 5–10 years to improve performance, particularly to decrease the time of induction of anesthesia while maintaining robustness. Methods: We analyzed results of a previous study conducted by our group to identify opportunities for system improvement. Allometric scaling was introduced to reduce the interpatient variability and a new robust PID controller was designed using an optimization-based method. We evaluated this optimized design in a clinical study involving 16 new cases. Results: The optimized controller design achieved the performance predicted in simulation studies in the design stage. Time of induction of anesthesia was median [Q1, Q3] 3.7 [2.3, 4.1] min and the achieved global score was 13.4 [9.9, 16.8]. Conclusion: Allometric scaling reduces the interpatient variability in this age group and allows for improved closed-loop performance. The uncertainty described by the model set, the predicted closed-loop responses, and the predicted robustness margins are realistic. The system meets the design objectives of improved speed of induction of anesthesia while maintaining robustness and improving clinically relevant system behavior. Significance: Control system optimization and ongoing system improvements are essential to the development of a clinically relevant commercial device. This paper demonstrates the validity of our approach, including system modeling, controller optimization, and pre-clinical testing in simulation. [ABSTRACT FROM AUTHOR]

Under transactive (market-based) coordination, a population of distributed energy resources (DERs), such as thermostatically controlled loads (TCLs) and storage devices, bid into an energy market. Consequently, a certain level of demand will be cleared based on the operating conditions of the grid. This paper analyzes the influence of various factors, such as price signals, feeder limits, and user-defined bid functions and preferences, on the aggregate energy usage of DERs. We identify cases that can lead to load synchronization, undesirable power oscillations and highly volatile prices. To address these issues, the paper develops an aggregate model of DERs under transactive coordination. A set of Markov transition equations have been developed over discrete ranges (referred to as “bins”) of price levels and their associated DER operating states. A detailed investigation of the performance of this aggregate model is presented. With reformulation of the transition equations, the bin model has been incorporated into a model predictive control setting using both mixed integer programming and quadratic programming. A case study shows that a population of TCLs can be managed economically while avoiding congestion in a distribution grid. Simulations also demonstrate that power oscillations arising from synchronization of TCLs can be effectively avoided. [ABSTRACT FROM AUTHOR]

Contribution: This paper explores the factors contributing to the development of engineering identity in Latinx students at two institutions. A better understanding of these factors will support the development of more inclusive engineering education environments and experiences. Background: Persistence of Latinx engineering students is of particular interest due to their underrepresentation in the field. Identity is a lens for understanding student persistence, but Latinx students are underrepresented in prior engineering identity studies. This paper seeks to identify the unique factors, academic and professional, that contribute to engineering identity development, and potential means for supporting the persistence of Latinx engineers. Research Questions: 1) What academic and professional affect factors predict engineering identity development of Latinx students? and 2) What role does the institution play in Latinx students’ engineering identity development? Methodology: A mixed-methods approach was used to measure engineering identity based on a framework incorporating both academic and professional affect elements. Regression analyses were conducted on 892 responses to an online survey from Latinx engineering students, with additional insight from interviews with ten Latinx engineering students. Findings: Six of the nine factors analyzed (performance/competence, interest, recognition, analysis, framing and solving problems, and tinkering) were significant predictors of Latinx students’ engineering identity, as were institution, gender, and having a parent with an engineering degree. Engineering identity was higher for Latinx students at the Hispanic Serving Institution, but none of the interaction terms were significant, so the relationship between these factors and engineering identity is similar at each institution. [ABSTRACT FROM AUTHOR]

The main goal in group testing is to recover a small subset of defective items from a larger population while efficiently reducing the total number of (possibly noisy) required tests/measurements. Under the assumption that the input-output statistical relationship (i.e., channel law) is known to the recovery algorithm, the fundamental as well as the computational limits of the group testing problem are relatively better understood than when these statistical relationships are unknown. Practical considerations, however, render this assumption inapplicable, and “blind” recovery/estimation procedures, independent of the input-output statistics, are desired. In this paper, we analyze the fundamental limits of a general noisy group testing problem, when this relationship is unknown. Specifically, in the first part of this paper, we propose an efficient scheme, based on the idea of separate-decoding of items (where each item is recovered separately), for which we derive sufficient conditions on the number of tests required for exact recovery. The difficulty in obtaining these conditions stems from the fact that we allow the number of defective items to grow with the population size, which in turn requires delicate concentration analysis of certain probabilities. Furthermore, we show that in several scenarios, our proposed scheme achieves the same performance as that of the corresponding non-blind recovery algorithm (where the input-output statistics are known), implying that the proposed blind scheme is robust/universal. Finally, in the second part of this paper, we propose also an inefficient combinatorial-based scheme (or, “joint-decoding”), for which we derive similar sufficient conditions. [ABSTRACT FROM AUTHOR]

The failure rate is essential in power system reliability assessment and thus far, it has been commonly assumed as constant. This is a basic approach that delivers reasonable results. However, this approach neglects the heterogeneity in component populations, which has a negative impact on the accuracy of the failure rate. This paper proposes a method based on risk functions, which describes the risk behavior of condition measurements over time, to compute individual failure rates within populations. The method is applied to a population of 12 power transformers on transmission level. The computed individual failure rates depict the impact of maintenance and that power transformers with long operation times have a higher failure rate. Moreover, this paper presents a procedure based on the proposed approach to forecast failure rates. Finally, the individual failure rates are calculated over a specified prediction horizon and depicted with a 95% confidence interval. [ABSTRACT FROM AUTHOR]

With the ever-increasing urbanization process, modeling people's spatiotemporal activities from their online traces has become a crucial task. State-of-the-art methods for this task rely on cross-modal embedding, which maps items from different modalities (e.g., location, time, text) into the same latent space. Despite their inspiring results, existing cross-modal embedding methods merely capture co-occurrences between items without modeling their high-order interactions. In this paper, we first construct two graphs from raw data records to represent the user interaction graph layer and activity graph layer and propose a hierarchical cross-modal embedding method that takes the high-order relationships into consideration. The key notion behind our method is a novel hierarchical embedding framework with meta-graphs connecting different layers. We introduce both inter-record and intra-record meta-graph structures, which enable learning distributed representations that preserve high-order proximities across graphs from different layers. Our empirical experiments on three real-world datasets demonstrate that our method not only outperforms state-of-the-art methods for spatiotemporal activity prediction, but also captures cross-modal proximity at a finer granularity. [ABSTRACT FROM AUTHOR]

The $k\text {-means}$ clustering problem concerns finding a partition of the data points into $k$ clusters such that the total within-cluster squared distance is minimized. This optimization objective is non-convex, and not everywhere differentiable. In general, there exist spurious local solutions other than the global optimum. Moreover, the simplest and most popular algorithm for $k\text {-means}$ , namely Lloyd’s algorithm, generally converges to such spurious local solutions both in theory and in practice. In this paper, we investigate the structures of these spurious local solutions under a probabilistic generative model with $k$ ground truth clusters. As soon as $k=3$ , spurious local minima provably exist, even for well-separated clusters. One such local minimum puts two centers at one true cluster, and the third center in the middle of the other two true clusters. We prove that this is essentially the only type of spurious local minima under a separation condition. In particular, any local minimum solution only involves a configuration that puts multiple centers at a true cluster, and one center in the middle of multiple true clusters. Our results pertain to the $k\text {-means}$ formulation for mixtures of Gaussians or bounded distributions, and hold in the over- and under-parametrization regimes where the number of centers in $k\text {-means}$ may not equal to the number of true clusters. Our theoretical results corroborate existing empirical observations and provide justification for popular heuristics for $k\text {-means}$ clustering. [ABSTRACT FROM AUTHOR]

Stochastic gradient descent (SGD) has become the method of choice for training highly complex and nonconvex models since it can not only recover good solutions to minimize training errors but also generalize well. Computational and statistical properties are separately studied to understand the behavior of SGD in the literature. However, there is a lacking study to jointly consider the computational and statistical properties in a nonconvex learning setting. In this paper, we develop novel learning rates of SGD for nonconvex learning by presenting high-probability bounds for both computational and statistical errors. We show that the complexity of SGD iterates grows in a controllable manner with respect to the iteration number, which sheds insights on how an implicit regularization can be achieved by tuning the number of passes to balance the computational and statistical errors. As a byproduct, we also slightly refine the existing studies on the uniform convergence of gradients by showing its connection to Rademacher chaos complexities. [ABSTRACT FROM AUTHOR]

Group testing refers to the process of testing pooled samples to reduce the total number of tests. Given the current pandemic, and the shortage of test supplies for COVID-19, group testing can play a critical role in time and cost efficient diagnostics. In many scenarios, samples collected from users are also accompanied with auxiliary information (such as demographics, history of exposure, onset of symptoms). Such auxiliary information may differ across patients, and is typically not considered while designing group testing algorithms. In this paper, we abstract such heterogeneity using a model where the population can be categorized into clusters with different prevalence rates. The main result of this work is to show that exploiting knowledge heterogeneity can further improve the efficiency of group testing. Motivated by the practical constraints and diagnostic considerations, we focus on two-stage group testing algorithms, where in the first stage, the goal is to detect as many negative samples by pooling, whereas the second stage involves individual testing to detect any remaining samples. For this class of algorithms, we prove that the gain in efficiency is related to the concavity of the number of tests as a function of the prevalence. We also show how one can choose the optimal pooling parameters for one of the algorithms in this class, namely, doubly constant pooling. We present lower bounds on the average number of tests as a function of the population heterogeneity profile, and also provide numerical results and comparisons. [ABSTRACT FROM AUTHOR]

The basic goal of threshold group testing is to identify up to $d$ defective items among a population of $n$ items, where $d$ is usually much smaller than $n$. The outcome of a test on a subset of items is positive if the subset has at least $u$ defective items, negative if it has up to $\ell $ defective items, where $0 \leq \ell < u$ , and arbitrary otherwise. This is called threshold group testing. The parameter $g = u - \ell - 1$ is called the gap. In this paper, we focus on the case $g > 0$ , i.e., threshold group testing with a gap. Note that the results presented here are also applicable to the case $g = 0$ ; however, the results are not as efficient as those in related work. Currently, a few reported studies have investigated test designs and decoding algorithms for identifying defective items. Most of the previous studies have not been feasible because there are numerous constraints on their problem settings or the decoding complexities of their proposed schemes are relatively large. Therefore, it is compulsory to reduce the number of tests as well as the decoding complexity, i.e., the time for identifying the defective items, for achieving practical schemes. The work presented here makes five contributions. The first is a more accurate theorem for a non-adaptive algorithm for threshold group testing proposed by Chen and Fu. The second is an improvement in the construction of disjunct matrices, which are the main tools for tackling (threshold) group testing and other tasks such as constructing cover-free families or learning hidden graphs. Specifically, we present a better exact upper bound on the number of tests for disjunct matrices compared with that in related work. The third and fourth contributions are a reduced exact upper bound on the number of tests and a reduced asymptotic bound on the decoding time for identifying defective items in a noisy setting on test outcomes. The fifth contribution is a simulation on the number of tests of the resulting improvements for previous work and the proposed theorems. [ABSTRACT FROM AUTHOR]

This paper studies the problem of developing an efficient signal sampling framework for distributed blind spectrum sensing, together with the corresponding local cognitive radio (CR) decision and fusion rules. A novel collaborative sampling and binary output (CSBO) generating scheme is proposed to overcome the disadvantage of traditional energy detectors for blind spectrum sensing, in which the signal-to-noise ratio (SNR) and level of noise power at the CRs are unknown and thus the decision threshold of local energy detectors cannot be specified. In designing the fusion rule in conjunction with the proposed CSBO scheme, both fixed-sample-size tests and sequential tests are considered. It is theoretically shown that the proposed CSBO scheme outperforms traditional blind cooperative energy detectors with uniform sampling schemes in terms of its ability to increase the amount of information acquired under a given number of samples. Simulation results confirm the theoretical analyses, and demonstrate that, compared with the fixed-sample-size test, the sequential test requires fewer observations on average to achieve comparable detection performance. The reduction in the expected sample size needed in the sequential CSBO test when compared to the fixed-sample-size CSBO can reach 50% when primary signal is present. [ABSTRACT FROM AUTHOR]

Power cables are critical assets for the reliable operation of the grid. The cable lifetime is generally estimated from the conductor temperature, and associated lifetime reduction. However, these tasks are intricate due to the complex physics-of-failure (PoF) degradation mechanism of the cable. This is further complicated with the different sources of uncertainty that affect the cable lifetime estimation. Generally, simplified or deterministic PoF models are adopted resulting in non-accurate decision-making under uncertainty. In contrast, the integration of uncertainties leads to a probabilistic decision-making process impacting directly on the flexibility to adopt decisions. Accordingly, this paper presents a novel cable lifetime estimation framework that connects data-driven probabilistic uncertainty models with PoF-based operation, and degradation models through Bayesian state-estimation techniques. The framework estimates the cable health state, and infers confidence intervals to aid decision-making under uncertainty. The proposed approach is validated with a case study with different configuration parameters, and the effect of measurement errors on cable lifetime are evaluated with a sensitivity analysis. Results demonstrate that ambient temperature measurement errors influence more than load measurement errors, and the greater the cable conductor temperature the greater the influence of uncertainties on the lifetime estimate. [ABSTRACT FROM AUTHOR]

In many diagnostic imaging settings, including positron emission tomography (PET), images are typically used for multiple tasks such as detecting disease and quantifying disease. Unlike conventional image reconstruction that optimizes a single objective, this work proposes a multi-objective optimization algorithm for PET image reconstruction to identify a set of images that are optimal for more than one task. This work is reliant on a genetic algorithm to evolve a set of solutions that satisfies two distinct objectives. In this paper, we defined the objectives as the commonly used Poisson log-likelihood function, typically reflective of quantitative accuracy, and a variant of the generalized scan-statistic model, to reflect detection performance. The genetic algorithm uses new mutation and crossover operations at each iteration. After each iteration, the child population is selected with non-dominated sorting to identify the set of solutions along the dominant front or fronts. After multiple iterations, these fronts approach a single non-dominated optimal front, defined as the set of PET images for which none the objective function values can be improved without reducing the opposing objective function. This method was applied to simulated 2D PET data of the heart and liver with hot features. We compared this approach to conventional, single-objective approaches for trading off performance: maximum likelihood estimation with increasing explicit regularization and maximum a posteriori estimation with varying penalty strength. Results demonstrate that the proposed method generates solutions with comparable to improved objective function values compared to the conventional approaches for trading off performance amongst different tasks. In addition, this approach identifies a diverse set of solutions in the multi-objective function space which can be challenging to estimate with single-objective formulations. [ABSTRACT FROM AUTHOR]

Multi-layer network community detection has drawn an increasing amount of attention recently. Despite success, the existing methods mainly focus on the lower-order connectivity structure at the level of individual nodes and edges. And the higher-order connectivity structure has been largely ignored, which contains better signature of community compared with edges. The main challenges in utilizing higher-order structure for multi-layer network community detection are that the most representative higher-order structure may vary from one layer to another and the connectivity structure formed by the same node subset may exhibit different higher-order connectivity patterns in different layers. To this end, this paper proposes a novel higher-order structure, termed harmonic motif, which is a dense subgraph having on average the largest statistical significance in each layer. Based on the harmonic motif, a primary layer is constructed by integrating higher-order structural information from all layers. Additionally, the higher-order structural information of each individual layer is taken as the auxiliary information. A coupling is established between the primary layer and each auxiliary layer. Accordingly, a harmonic motif modularity is designed to generate the community structure. Extensive experiments on eleven real-world multi-layer network datasets have been conducted to confirm the effectiveness of the proposed method. [ABSTRACT FROM AUTHOR]

With the increase in the number of optimization objectives, balancing the convergence and diversity in evolutionary multiobjective optimization becomes more intractable. So far, a variety of evolutionary algorithms have been proposed to solve many-objective optimization problems (MaOPs) with more than three objectives. Most of the existing algorithms, however, find difficulties in simultaneously counterpoising convergence and diversity during the whole evolutionary process. To address the issue, this paper proposes to solve MaOPs via multistage evolutionary search. To be specific, a two-stage evolutionary algorithm is developed, where the convergence and diversity are highlighted during different search stages to avoid the interferences between them. The first stage pushes multiple subpopulations with different weight vectors to converge to different areas of the Pareto front. After that, the nondominated solutions coming from each subpopulation are selected for generating a new population for the second stage. Moreover, a new environmental selection strategy is designed for the second stage to balance the convergence and diversity close to the Pareto front. This selection strategy evenly divides each objective dimension into a number of intervals, and then one solution having the best convergence in each interval will be retained. To assess the performance of the proposed algorithm, 48 benchmark functions with 7, 10, and 15 objectives are used to make comparisons with five representative many-objective optimization algorithms. [ABSTRACT FROM AUTHOR]

This paper studies the related problems of prediction, covariance estimation, and principal component analysis for the spiked covariance model with heteroscedastic noise. We consider an estimator of the principal components based on whitening the noise, and we derive optimal singular value and eigenvalue shrinkers for use with these estimated principal components. Underlying these methods are new asymptotic results for the high-dimensional spiked model with heteroscedastic noise, and consistent estimators for the relevant population parameters. We extend previous analysis on out-of-sample prediction to the setting of predictors with whitening. We demonstrate certain advantages of noise whitening. Specifically, we show that in a certain asymptotic regime, optimal singular value shrinkage with whitening converges to the best linear predictor, whereas without whitening it converges to a suboptimal linear predictor. We prove that for generic signals, whitening improves estimation of the principal components, and increases a natural signal-to-noise ratio of the observations. We also show that for rank one signals, our estimated principal components achieve the asymptotic minimax rate. [ABSTRACT FROM AUTHOR]

When solving constrained optimization problems (COPs) by evolutionary algorithms, the search algorithm plays a crucial role. In general, we expect that the search algorithm has the capability to balance not only diversity and convergence but also constraints and objective function during the evolution. For this purpose, this paper proposes a composite differential evolution (DE) for constrained optimization, which includes three different trial vector generation strategies with distinct advantages. In order to strike a balance between diversity and convergence, one of these three trial vector generation strategies is able to increase diversity, and the other two exhibit the property of convergence. In addition, to accomplish the tradeoff between constraints and objective function, one of the two trial vector generation strategies for convergence is guided by the individual with the least degree of constraint violation in the population, and the other is guided by the individual with the best objective function value in the population. After producing offspring by the proposed composite DE, the feasibility rule and the $\boldsymbol {\varepsilon }$ constrained method are combined elaborately for selection in this paper. Moreover, a restart scheme is proposed to help the population jump out of a local optimum in the infeasible region for some extremely complicated COPs. By assembling the above techniques together, a constrained composite DE is proposed. The experiments on two sets of benchmark test functions with various features, i.e., 24 test functions from IEEE CEC2006 and 18 test functions with 10 dimensions and 30 dimensions from IEEE CEC2010, have demonstrated that the proposed method shows better or at least competitive performance against other state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Dense stereo image matching in remotely sensed images is a challenging problem, though it has been studied for more than two decades, due to occlusions, discontinuities, geometric, and radiometric distortions. A novel multiobjective fitness function-based dense stereo matching approach using genetic algorithms (GAs) is proposed in this paper. The proposed method is useful for estimating dense disparity map with an improved number of inliers for a stereo image pair, despite the constraint of finding correct disparity at depth discontinuities. In this paper, the steps of GA, such as initialization of the population, fitness function, and crossover and mutation operation, are designed and implemented to effectively deal with the problem of dense stereo image matching. To initialize the population, a Scale Invariant Feature Transform (SIFT) descriptor is computed for each pixel and multiple-size window-based matching is performed, using the similarity measures: 1) Euclidean distance and 2) spectral angle mapper. The generated disparity maps are pruned to choose a suitable subset using the designed fitness functions, considering the constraints related to stereo image pair, such as epipolar constraint, which encodes the epipolar geometry and the similarity measure that is useful to decide accuracy of the correspondences. The two objective functions are the number of inliers computed using the fundamental matrix and an energy minimization function, considering discontinuities and occlusions. The usefulness of this approach for remotely sensed stereo image pairs is demonstrated by improving the number of inliers and favorably comparing with state-of-the-art dense stereo image matching methods. [ABSTRACT FROM AUTHOR]

Under the deregulated environment, electric utility companies have been encouraged to ensure maximum system reliability through the employment of cost-effective long-term asset management strategies. Previously, the age based Weibull distribution has been used vastly for modeling and forecasting aging failures. However, this model is only based on asset age and does not consider additional information such as asset infant mortality period and equipment energization delay. Some works on modifying Weibull distribution functions to model bathtub-shaped failure rate function can be practically difficult due to model complexity and inexplicit parameters. To improve the existing methods, this paper proposes four modified Weibull distribution models with straightforward physical meanings specific to power system applications. Furthermore, this paper proposes a novel method to effectively evaluate different Weibull distribution models and select the suitable model(s). More importantly, if more than one suitable model exists, these models can be mathematically combined as a joint forecast model, which could provide better accuracy to forecast future asset reliability. Finally, the proposed approach was applied to a Canadian utility company for the reliability forecast of electromechanical relays and distribution poles to demonstrate its practicality and usefulness. [ABSTRACT FROM AUTHOR]

The current shift toward the virtualization of network infrastructure components enables a dynamic instantiation, deployment and configuration of virtual network functions (VNFs), which can be offered "as-a-service" to multiple tenants, thus enabling 5G architectures. Simultaneously, the recent high throughput satellite (HTS) systems can play an important role in the 5G era thanks to their characteristics, such as their large coverage, fast deployment of the ground infrastructure and native broadcast/multicast broadband capabilities. In this context, this paper proposes a review of the satellite service delivery models in order to identify viable alternatives to deploy converged satellite-terrestrial services. This objective is pursued by taking as a reference a satellite-assisted IP streaming service for the enhancement of current Content Delivery Network (CDN) infrastructures, as tackled by the European Space Agency within the SHINE ("Secure Hybrid In Network caching Environment") project. SHINE aims at efficiently extending terrestrial CDN services to satellite-enabled scenarios, by designing innovative mechanisms for the secure distribution of real-time multimedia information across hybrid channels, leveraging both unicast and multicast communication paradigms. The original contribution of the paper is the analysis of satellite architectures and configurations tailored to efficiently support the SHINE solution, together with a high-level applicability assessment taking into account different satellite-enabled service models. [ABSTRACT FROM AUTHOR]

This paper studies the problem of estimating the covariance of a collection of vectors using only highly compressed measurements of each vector. An estimator based on back-projections of these compressive samples is proposed and analyzed. A distribution-free analysis shows that by observing just a single linear measurement of each vector, one can consistently estimate the covariance matrix, in both infinity and spectral norm, and this analysis leads to precise rates of convergence in both norms. Through information-theoretic techniques, lower bounds showing that this estimator is minimax-optimal for both infinity and spectral norm estimation problems are established. These results are also specialized to give matching upper and lower bounds for estimating the population covariance of a collection of Gaussian vectors, again in the compressive measurement model. The analysis conducted in this paper shows that the effective sample complexity for this problem is scaled by a factor of $m^{2}/d^{2}$ , where $m$ is the compression dimension and $d$ is the ambient dimension. Applications to subspace learning (principal components analysis) and learning over distributed sensor networks are also discussed. [ABSTRACT FROM AUTHOR]

This paper applied the finite-element method (FEM) with topological data structures to the optimization of electrical devices. A generic modifiable graph data structure is built according to the graph-theoretic foundation for these data structures. The employed topological FEM avoids rebuilding of the mesh in traditional FEM method while geometrical variations happen. It is an effective algorithm which can save computer storage and working time when applied to successive optimization. The effectiveness is verified by numerical example and comparison of the topological FEM with traditional FEM on storage load and working time is shown in this paper. [ABSTRACT FROM AUTHOR]

In this paper, the pinning process of pinned photodiodes (PPDs) is described by a new analytical model, assuming the PPD to be composed of inner and junction regions. There are two definitions of the pinning potential: maximum conduction band potential variation ($\Delta \varphi _{M}$) and maximum electron quasi-fermi level potential variation ($\Delta $ FP $_{M}$). The output of the previous pinning potential models is only an approximation of $\Delta \varphi _{M}$. In this paper, a comprehensive model is proposed in which both aforementioned definitions of pinning potential can be achieved analytically. The proposed model is a system of equations relating PPD’s main characteristics such as $\Delta \varphi _{M}$ and equilibrium full-well capacity to other main PPD parameters such as PPD spatial dimensions, impurity dopant concentrations, maximum inner region potential, and remnant carrier population at $\Delta \varphi _{M}$. The proposed model is verified by two previously reported experiment-based data. [ABSTRACT FROM AUTHOR]

This paper examines the cloud computing for education (CCE) literature, and analyzes if the research is developing scientifically with adequate empirical validation. All aspects of empirical investigations covered in the literature are shown as weak, hence, the necessary scientific development of CCE requires extending its scope of interest, and involving scholars synergistically to create and maintain a “common research agenda.” Background: A need to develop research on CCE has been recognized, and considerable efforts made to create an accurate understanding of the development of its scope of interest, in terms of supporting pedagogical developments and processes for better quality of studies. Research Questions: This paper has three main aims: 1) to evaluate the scope of interest in the literature for CCE with specific reference to pedagogy and educational processes; 2) to analyze the characteristics of papers, specifically empirical studies, from the various points of view of the daily improvement activities of teachers and learners at all levels of education; and 3) to identify eventual research gaps to consider and stimulate new topics or further investigations. Methodology: This systematic mapping study review followed a rigorous, replicable process to collect and analyze representative studies of CCE. Findings: Differences are found across geographic areas in applying CCE infrastructure and technologies in educational institutions; few studies address CCE’s impact on pedagogic processes. The scope of interest in CCE is only partially covered; with empirical research being very shallow. Suggestions are made for more effective research on concerning the production and use of content. [ABSTRACT FROM AUTHOR]

Sparse principal component analysis has become one of the most widely used techniques for dimensionality reduction in high-dimensional datasets. While many methods are available for point estimation of eigenstructure in high-dimensional settings, in this paper we propose methodology for uncertainty quantification, such as construction of confidence intervals and tests for the principal eigenvector and the corresponding largest eigenvalue. We base our methodology on an M-estimator with Lasso penalty which achieves minimax optimal rates and is used to construct a de-biased sparse PCA estimator. The novel estimator has a Gaussian limiting distribution and can be used for hypothesis testing or support recovery of the first eigenvector. The empirical performance of the new estimator is demonstrated on synthetic data and we also show that the estimator compares favourably with the classical PCA in moderately high-dimensional regimes. [ABSTRACT FROM AUTHOR]

This paper derives consistency results for estimation in the finite direct sum of reproducing kernel Hilbert spaces (RKHS) for dependent data. The link between penalized and constrained estimation is established. We consider the relation between topological equivalent norms for direct sums of RKHS. These norms have different implications for estimation. Estimation in a ball of the RKHS defined by these norms essentially results in estimation with a ridge and Lasso penalty, respectively. A greedy algorithm for the solution of the estimation problem under these two norms is discussed for general loss functions. [ABSTRACT FROM AUTHOR]

In this paper we study covariance estimation with missing data. We consider missing data mechanisms that can be independent of the data, or have a time varying dependency. Additionally, observed variables may have arbitrary (non uniform) and dependent observation probabilities. For each mechanism, we construct an unbiased estimator and obtain bounds for the expected value of their estimation error in operator norm. Our bounds are equivalent, up to constant and logarithmic factors, to state of the art bounds for complete and uniform missing observations. Furthermore, for the more general non uniform and dependent cases, the proposed bounds are new or improve upon previous results. Our error estimates depend on quantities we call scaled effective rank, which generalize the effective rank to account for missing observations. All the estimators studied in this work have the same asymptotic convergence rate (up to logarithmic factors). [ABSTRACT FROM AUTHOR]

The objective of a genome-wide association study (GWAS) is to associate subsequences of individuals’ genomes to the observable characteristics called phenotypes (e.g., high blood pressure). Motivated by the GWAS problem, in this paper we introduce the information-theoretic problem of associated subsequence retrieval, where a dataset of N (possibly high-dimensional) sequences of length G, and their corresponding observable (binary) characteristics is given. The sequences are chosen independently and uniformly at random from $\mathcal {X}^{\text {G}}$ , where $\mathcal {X}$ is a finite alphabet. The observable (binary) characteristic is only related to a specific unknown subsequence of length $L$ of the sequences, called associated subsequence. For each sequence, if the associated subsequence of it belongs to a universal finite set, then it is more likely to display the observable characteristic (i.e., it is more likely that the observable characteristic is one). The goal is to retrieve the associated subsequence using a dataset of N sequences and their observable characteristics. We demonstrate that as the parameters N, G, and L grow, a threshold effect appears in the curve of probability of error versus the rate which is defined as ${{\it\text { Gh}}(\text {L}/\text {G})}/{\text {N}}$ , where $\text {h}(\cdot)$ is the binary entropy function. This effect allows us to define the capacity of associated subsequence retrieval. We develop an achievable scheme and a matching converse for this problem, and thus characterize its capacity in two scenarios: the zero-error-rate and the $\epsilon $ -error-rate. [ABSTRACT FROM AUTHOR]

Pareto dominance-based multiobjective optimization has been successfully applied to constrained evolutionary optimization during the last two decades. However, as another famous multiobjective optimization framework, decomposition-based multiobjective optimization has not received sufficient attention from constrained evolutionary optimization. In this paper, we make use of decomposition-based multiobjective optimization to solve constrained optimization problems (COPs). In our method, first of all, a COP is transformed into a biobjective optimization problem (BOP). Afterward, the transformed BOP is decomposed into a number of scalar optimization subproblems. After generating an offspring for each subproblem by differential evolution, the weighted sum method is utilized for selection. In addition, to make decomposition-based multiobjective optimization suit the characteristics of constrained evolutionary optimization, weight vectors are elaborately adjusted. Moreover, for some extremely complicated COPs, a restart strategy is introduced to help the population jump out of a local optimum in the infeasible region. Extensive experiments on three sets of benchmark test functions, namely, 24 test functions from IEEE CEC2006, 36 test functions from IEEE CEC2010, and 56 test functions from IEEE CEC2017, have demonstrated that the proposed method shows better or at least competitive performance against other state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Differential evolution is one of the most powerful evolutionary algorithms for single objective optimization problems in the literature. Its application in the multiobjective optimization problems is also very successful, and many kinds of promising multiobjective differential evolution (MODE) algorithms have been proposed in the literature. This paper develops a new variant of MODE with two features. First, a set of personal archives are maintained to evolve the search process instead of a population with a fixed size, and a truncation procedure is used to enhance selection pressure. Second, multiple biased mutation operators incorporating the target solution quality are proposed, and an adaptive selection method is adopted to allocate the mutation operators to solutions. The proposed MODE is referred to as the MODE with personal archive and biased self-adaptive mutation selection (BiasMOSaDE). A set of 31 benchmark multiobjective problems selected from the literature are adopted to evaluate its performance. Computational results illustrate that the proposed BiasMOSaDE is competitive or even superior to several state-of-the-art MODEs in the literature. [ABSTRACT FROM AUTHOR]

Reconstruction of neuronal populations from ultra-scale optical microscopy (OM) images is essential to investigate neuronal circuits and brain mechanisms. The noises, low contrast, huge memory requirement, and high computational cost pose significant challenges in the neuronal population reconstruction. Recently, many studies have been conducted to extract neuron signals using deep neural networks (DNNs). However, training such DNNs usually relies on a huge amount of voxel-wise annotations in OM images, which are expensive in terms of both finance and labor. In this paper, we propose a novel framework for dense neuronal population reconstruction from ultra-scale images. To solve the problem of high cost in obtaining manual annotations for training DNNs, we propose a progressive learning scheme for neuronal population reconstruction (PLNPR) which does not require any manual annotations. Our PLNPR scheme consists of a traditional neuron tracing module and a deep segmentation network that mutually complement and progressively promote each other. To reconstruct dense neuronal populations from a terabyte-sized ultra-scale image, we introduce an automatic framework which adaptively traces neurons block by block and fuses fragmented neurites in overlapped regions continuously and smoothly. We build a dataset “VISoR-40” which consists of 40 large-scale OM image blocks from cortical regions of a mouse. Extensive experimental results on our VISoR-40 dataset and the public BigNeuron dataset demonstrate the effectiveness and superiority of our method on neuronal population reconstruction and single neuron reconstruction. Furthermore, we successfully apply our method to reconstruct dense neuronal populations from an ultra-scale mouse brain slice. The proposed adaptive block propagation and fusion strategies greatly improve the completeness of neurites in dense neuronal population reconstruction. [ABSTRACT FROM AUTHOR]

This paper investigates the control of a massive population of UAVs such as drones. The straightforward method of control of UAVs by considering the interactions among them to make a flock requires a huge inter-UAV communication which is impossible to implement in real-time applications. One method of control is to apply the mean field game (MFG) framework which substantially reduces communications among the UAVs. However, to realize this framework, powerful processors are required to obtain the control laws at different UAVs. This requirement limits the usage of the MFG framework for real-time applications such as massive UAV control. Thus, a function approximator based on neural networks (NN) is utilized to approximate the solutions of Hamilton-Jacobi-Bellman (HJB) and Fokker-Planck-Kolmogorov (FPK) equations. Nevertheless, using an approximate solution can violate the conditions for convergence of the MFG framework. Therefore, the federated learning (FL) approach which can share the model parameters of NNs at drones, is proposed with NN based MFG to satisfy the required conditions. The stability analysis of the NN based MFG approach is presented and the performance of the proposed FL-MFG is elaborated by the simulations. [ABSTRACT FROM AUTHOR]

Recent years have witnessed the world-wide emergence of mega-metropolises with incredibly huge populations. Understanding residents mobility patterns, or urban dynamics, thus becomes crucial for building modern smart cities. In this paper, we propose a Neighbor-Regularized and context-aware Non-negative Tensor Factorization model (NR-cNTF) to discover interpretable urban dynamics from urban heterogeneous data. Different from many existing studies concerned with prediction tasks via tensor completion, NR-cNTF focuses on gaining urban managerial insights from spatial, temporal, and spatio-temporal patterns. This is enabled by high-quality Tucker factorizations regularized by both POI-based urban contexts and geographically neighboring relations. NR-cNTF is also capable of unveiling long-term evolutions of urban dynamics via a pipeline initialization approach. We apply NR-cNTF to a real-life data set containing rich taxi GPS trajectories and POI records of Beijing. The results indicate: 1) NR-cNTF accurately captures four kinds of city rhythms and seventeen spatial communities; 2) the rapid development of Beijing, epitomized by the CBD area, indeed intensifies the job-housing imbalance; 3) the southern areas with recent government investments have shown more healthy development tendency. Finally, NR-cNTF is compared with some baselines on traffic prediction, which further justifies the importance of urban contexts awareness and neighboring regulations. [ABSTRACT FROM AUTHOR]

Genetic programming (GP) is a powerful evolutionary algorithm that has been widely used for solving many real-world optimization problems. However, traditional GP can only solve a single task in one independent run, which is inefficient in cases where multiple tasks need to be solved at the same time. Recently, multifactorial optimization (MFO) has been proposed as a new evolutionary paradigm toward evolutionary multitasking. It intends to conduct evolutionary search on multiple tasks in one independent run. To enable multitasking GP, in this paper, we propose a novel multifactorial GP (MFGP) algorithm. To the best of our knowledge, this is the first attempt in the literature to conduct multitasking GP using a single population. The proposed MFGP consists of a novel scalable chromosome encoding scheme which is capable of representing multiple solutions simultaneously, and new evolutionary mechanisms for MFO based on self-learning gene expression programming. Further, comprehensive experimental studies are conducted on multitask scenarios consisting of commonly used GP benchmark problems and real world applications. The obtained empirical results confirmed the efficacy of the proposed MFGP. [ABSTRACT FROM AUTHOR]