Search

Large-scale optimization problems (LSOPs) become increasingly ubiquitous but complicated in real-world scenarios. Confronted with such sophisticated optimization problems, most existing optimizers dramatically lose their effectiveness. To tackle this type of problems effectively, we propose a heterogeneous cognitive learning particle swarm optimizer (HCLPSO). Unlike most existing particle swarm optimizers (PSOs), HCLPSO partitions particles in the current swarm into two categories, namely superior particles (SP) and inferior particles (IP), based on their fitness, and then treats the two categories of particles differently. For inferior particles, this paper devises a random elite cognitive learning (RECL) strategy to update each one with a random superior particle chosen from SP. For superior particles, this paper designs a stochastic dominant cognitive learning (SDCL) strategy to evolve each one by randomly selecting one guiding exemplar from SP and then updating it only when the selected exemplar is better. With the collaboration between these two learning mechanisms, HCLPSO expectedly evolves particles effectively to explore the search space and exploit the found optimal zones appropriately to find optimal solutions to LSOPs. Furthermore, to help HCLPSO traverse the vast search space with promising compromise between intensification and diversification, this paper devises a dynamic swarm partition scheme to dynamically separate particles into the two categories. With this dynamic strategy, HCLPSO gradually switches from exploring the search space to exploiting the found optimal zones intensively. Experiments are executed on the publicly acknowledged CEC2010 and CEC2013 LSOP benchmark suites to compare HCLPSO with several state-of-the-art approaches. Experimental results reveal that HCLPSO is effective to tackle LSOPs, and attains considerably competitive or even far better optimization performance than the compared state-of-the-art large-scale methods. Furthermore, the effectiveness of each component in HCLPSO and the good scalability of HCLPSO are also experimentally verified. [ABSTRACT FROM AUTHOR]

Many real-life problems can be formulated as numerical optimization problems. Such problems pose a challenge for researchers when designing efficient techniques that are capable of finding the desired solution without suffering from premature convergence. This paper proposes a novel evolutionary algorithm that blends the exploitative and explorative merits of two main evolutionary algorithms, namely the Stochastic Fractal Search (SFS) and a Differential Evolution (DE) variant. This amalgam has an effective interaction and cooperation of an ensemble of diverse strategies to derive a single framework called Iterative Cyclic Tri-strategy with adaptive Differential Stochastic Fractal Evolutionary Algorithm (Ic3-aDSF-EA). The component algorithms cooperate and compete to enhance the quality of the generated solutions and complement each other. The iterative cycles in the proposed algorithm consist of three consecutive phases. The main idea behind the cyclic nature of Ic3-aDSF-EA is to gradually emphasize the work of the best-performing algorithm without ignoring the effects of the other inferior algorithm during the search process. The cooperation of component algorithms takes place at the end of each cycle for information sharing and the quality of solutions for the next cycle. The algorithm's performance is evaluated on 43 problems from three different benchmark suites. The paper also investigates the application to a set of real-life problems. The overall results show that the proposed Ic3-aDSF-EA has a propitious performance and a reliable scalability behavior compared to other state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]

Large-scale multiobjective optimization problems (LSMOPs) have exponential growth in the search space as the decision variables increase, and the vast search space poses a challenge to the performance of multiobjective evolutionary algorithms (MOEAs). Many current large-scale MOEAs need to consume a large amount of computational resources to get good performance. This paper proposes a two-stage direction-guided evolutionary algorithm for large-scale multiobjective optimization (LMOEA-S2D) to balance the performance and computational resource overhead. The algorithm exploits the Pareto-optimality property of domination and the diversity-preserving property of decomposition to optimize the performance in the two stages, respectively, and designs a corresponding direction-guided mechanism to improve search efficiency. LMOEA-S2D designs global direction search and local direction search in the domination-based stage for efficient exploitation to accelerate population convergence. To promote greater population diversity, a hybrid direction search was devised to aid diversity exploration in the decomposition-based stage, and this facilitates even distribution of candidate solutions across the Pareto optimal frontier. LMOEA-S2D is compared with five state-of-the-art large-scale MOEAs on some large-scale multiobjective test suites with 100 to 5,000 decision variables. The experimental results show that LMOEA-S2D significantly outperformed all compared algorithms under limited computational resources. [ABSTRACT FROM AUTHOR]

• Analyze DE algorithm two key issues: parameter sensitivity and search imbalance. • A complementary mutation strategy based on complementary symmetric selection and a Gaussian distribution mutation is proposed. • Data fusion-based parameter adaptation method proposed for parameter rationalization. • A novel variant of DE called DACDE is designed and results shown competitive edge. As an excellent optimization algorithm widely used to solve various practical problems, differential evolution (DE) algorithm has few parameters, yet its performance is significantly affected by these parameters. To address this issue, this paper presents a novel variant of DE called DACDE, which utilizes data fusion-based parameter adaptation and a complementary mutation strategy. Most parameter adaptation methods based on successful history only analyze the mean of parameters and ignore their degree of dispersion. In DACDE, the successful parameter distribution is recorded and described by both the mean and variance. Data fusion is then used to combine records and generate an estimated distribution, which is applied to a Gaussian distribution to generate new parameters. Inspired by opposition-based learning, we introduce a complementary mutation strategy. This strategy employs a symmetric selection mechanism to adapt to the varying search abilities required by the algorithm at different stages. The new variant is verified on 32 single-objective functions from CEC 2011 and 2014 benchmark suites, and the results show that DACDE is competitive compared to other 29 evolutionary algorithms. [ABSTRACT FROM AUTHOR]

Constrained multi-objective optimization problems (CMOPs) require a delicate balance between satisfying constraints and optimizing objectives. Existing constrained multi-objective evolutionary algorithms (CMOEAs) often struggle to balance convergence, diversity, and feasibility, especially when dealing with CMOPs that have complex feasible regions. This paper proposes a multi-task-based self-organizing mapping evolutionary algorithm (MTSOM) to tackle this challenge, which includes a main and auxiliary task. Two populations independently optimize two tasks without considering constraints in the early stage. Subsequently, in the middle stage, both tasks explore the distribution structure of the population in parallel by employing a novel constraint-to-constraint self-organizing mapping (SOM) approach. In the late stage, the main task fully considers feasibility, while the auxiliary task focuses solely on the highest priority constraints. This approach enables rapid convergence toward feasible regions. To evaluate MTSOM's effectiveness, we conducted a series of experiments on five benchmark suites. Results indicate that MTSOM is competitive when compared to other state-of-the-art CMOEAs. Additionally, our proposed constraint-to-constraint SOM is superior in handling complex CMOPs. [ABSTRACT FROM AUTHOR]

Multimodal multi-objective optimization problems (MMOPs) contain multiple equivalent Pareto optimal sets (PSs) corresponding to the same Pareto front (PF). However, simultaneously locating well-distributed and well-converged multiple equivalent global PSs and PF remains challenging. Therefore, this paper proposes dynamic niching particle swarm optimization (PSO) with an external archive-guided (AG) mechanism, termed DNPSO-AG, for solving MMOPs. In DNPSO-AG, a clustering-based dynamic niching technique is integrated with PSO to divide the population into multiple niches. In addition, a leader updating method controls the updating of the leaders. Furthermore, a novel external archive-guided mechanism guides the evolution of multiple niches and enhances the distribution of solutions, which comprises two strategies: the adaptive division of the external archive strategy, which adaptively divides the external archive into multiple sub-archives, and the distance-based sub-archive and niche matching strategy, which assigns sub-archives to multiple niches for maintenance. The experimental results demonstrate that the proposed DNPSO-AG outperforms seven other state-of-the-art competitors on the CEC 2019 MMOP test suite in terms of the inverted generational distance (IGD) and IGD in the decision space (IGDX) metrics, with improvements of 21.3% and 9.1% over the best-performing competitor, respectively. [ABSTRACT FROM AUTHOR]

Due to the excellent efficiency and high interpretability, coupled with the accuracy comparable to deep learning on tabular data, various tree-based models have been widely concerned and succeeded in many fields like medical diagnosis, credit evaluation, and fault detection. However, the model owner may face dilemmas such as compromised privacy and insufficient machine performance when providing tree-based inference services. Therefore, this paper proposes an efficient and privacy-preserving tree-based inference scheme, through which users can enjoy secure, high-accuracy, and transparent outsourcing inference services from one cloud. Specifically, by adopting additive homomorphic encryption as the underlying privacy-preserving technique, we design a suite of perturbation and recovery methods, processing cipher-based inference while masking the inference path. Meanwhile, without additional interactions, users can directly obtain high-accuracy results comparable to non-privacy inference, so the used privacy-preserving methods seem transparent to users. Moreover, through optimizing algorithm design and precalculating partial ciphertexts, the efficiency of our scheme is improved significantly. Formal security analysis demonstrates that our scheme achieves selective security under the honest-but-curious model. Extensive experimental evaluation shows the lossless accuracy, low complexity, and high efficiency of our scheme, which is practical to real-world scenes, especially for large-scale models. • A novel tree-based inference scheme. • High-accuracy and transparent outsourcing inference services for users. • Strong privacy preservation for data, model parameters, and inference results. • Only one cloud server required. • Low algorithmic complexity and high efficiency. [ABSTRACT FROM AUTHOR]

• A novel CHT is proposed based on Pareto dominance-based ranking and CDP-based ranking. • A search algorithm based on four mutation operators is proposed. • A new constrained multiobjective differential evolution algorithm is proposed. The tradeoff between objective functions and constraints is a key issue that needs to be addressed by constrained multiobjective optimization algorithms, and constraint handling techniques (CHTs) are an important technique for balancing objective functions and constraints. In this paper, a novel CHT that fuses two rankings is proposed. Specifically, each individual is assigned two rankings: one ranking calculated based on Pareto dominance (regardless of constraints) and another calculated based on the constrained dominance principle (CDP). The fitness value of an individual is the weighted sum of these two rankings, and the weight is related to the generation number and the proportion of feasible solutions in the current generation. Based on the proposed CHT, a constrained multiobjective differential evolution algorithm is proposed. To generate high-quality offspring, the proposed constrained multiobjective differential evolution algorithm combines four mutation operations as core components of the search algorithm. The proposed algorithm is compared with eight state-of-the-art algorithms in experiments with five test suites, and the experimental results show that the proposed algorithm performs significantly better than the eight state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]