Non-revisiting genetic algorithm with adaptive mutation using constant memory

The continuous non-revisiting genetic algorithm (cNrGA) uses the entire search history and parameter-less adaptive mutation to significantly enhance search performance. Storing the entire search history is natural and costs little when the number of fitness evaluations is small or moderate. However, if the number of evaluations required is substantial, some memory management is desirable. In this paper, we propose two pruning mechanisms to keep the memory used constant. They are least recently used pruning and random pruning. The basic idea is to prune a unit of memory when the memory threshold is reached and some new search information is required to be stored, thus keeping the overall memory used constant. Meanwhile, both pruning strategies naturally form parameter-less adaptive mutation operators. A study is carried out to evaluate the impact on performance caused by loss of search history information. Experimental results show that (1) both strategies can maintain the performance of cNrGA, up to the empirical limit when 90 % of the search history is not recorded, (2) cNrGA and its variants with constant memory outperform the real-coded genetic algorithm and the standard particle swarm optimization. By pre-extracting all the current prune-able history information and storing them into a list, namely, to-prune-list, the overhead of both pruning strategies becomes small. This suggests that cNrGA can be extended to use in situations when the number of fitness evaluations is much larger than before with no significant effect on statistical performance. This widens the applicability of cNrGA to include more practical problems that require larger number of fitness evaluations before converging to the global optima.