Search

The use of evolutionary robotic systems to model aspects of evolutionary biology is well-established. Yet, few studies have asked the question, "What kind of model is an evolutionary robotic system?" This paper seeks to address that question in several ways. First, it is addressed by applying a structured model description developed for physical robot models of animal sensorimotor systems, then by outlining the strengths and limitations of evolutionary robotics for modelling evolutionary biology, and, finally, by considering the deepest questions in evolution and which of them might feasibly be modelled by evolutionary robotics. The paper concludes that although evolutionary robotics faces serious limitations in exploring deeper questions in evolutionary biology, its bottom-up approach to modelling populations of evolving phenotypes and their embodied interactions holds significant value for both testing and generating hypotheses. [ABSTRACT FROM AUTHOR]

The discrepancy between simulated and hardware experiments, the reality gap, is a challenge in evolutionary robotics. While strategies have been proposed to address this gap in fixed-body robots, they are not viable when dealing with populations and generations where the body is in constant change. The continual evolution of body designs necessitates the manufacturing of new robotic structures, a process that can be time-consuming if carried out manually. Moreover, the increased manufacturing time not only prolongs hardware experimental durations but also disrupts the synergy between hardware and simulated experiments. Failure to effectively manage these challenges could impede the implementation of evolutionary robotics in real-life environments. The Autonomous Robot Evolution project presents a framework to tackle these challenges through a case study. This paper describes the main three contributions of this work: Firstly, it analyses the different reality gap experienced by each different robot or the heterogenous reality gap. Secondly, it emphasizes the importance of automation in robot manufacturing. And thirdly, it highlights the necessity of a framework to orchestrate the synergy between simulated and hardware experiments. In the long term, integrating these contributions into evolutionary robotics is envisioned to enable the continuous production of robots in real-world environments. [ABSTRACT FROM AUTHOR]

Modular robots are collections of simple embodied agents, the modules, that interact with each other to achieve complex behaviors. Each module may have a limited capability of perceiving the environment and performing actions; nevertheless, by behaving coordinately, and possibly by sharing information, modules can collectively perform complex actions. In principle, the greater the actuation, perception, and communication abilities of the single module are the more effective is the collection of modules. However, improved abilities also correspond to more complex controllers and, hence, larger search spaces when designing them by means of optimization. In this article, we analyze the impact of perception, actuation, and communication abilities on the possibility of obtaining good controllers for simulated modular robots, that is, controllers that allow the robots to exhibit collective intelligence. We consider the case of modular soft robots, where modules can contract, expand, attach, and detach from each other, and make them face two tasks (locomotion and piling), optimizing their controllers with evolutionary computation. We observe that limited abilities often do not prevent the robots from succeeding in the task, a finding that we explain with (a) the smaller search space corresponding to limited actuation, perception, and communication abilities, which makes the optimization easier, and (b) the fact that, for this kind of robot, morphological computation plays a significant role. Moreover, we discover that what matters more is the degree of collectivity the robots are required to exhibit when facing the task. [ABSTRACT FROM AUTHOR]

The use of evolutionary robotic systems to model aspects of evolutionary biology is well-established. Yet, few studies have asked the question, “What kind of model is an evolutionary robotic system?” This paper seeks to address that question in several ways. First, it is addressed by applying a structured model description developed for physical robot models of animal sensorimotor systems, then by outlining the strengths and limitations of evolutionary robotics for modelling evolutionary biology, and, finally, by considering the deepest questions in evolution and which of them might feasibly be modelled by evolutionary robotics. The paper concludes that although evolutionary robotics faces serious limitations in exploring deeper questions in evolutionary biology, its bottom-up approach to modelling populations of evolving phenotypes and their embodied interactions holds significant value for both testing and generating hypotheses.

Exposing an evolutionary algorithm that is used to evolve robot controllers to variable conditions is necessary to obtain solutions which are robust and can cross the reality gap. However, we do not yet have methods for analyzing and understanding the impact of the varying morphological conditions which impact the evolutionary process, and therefore for choosing suitable variation ranges. By morphological conditions, we refer to the starting state of the robot, and to variations in its sensor readings during operation due to noise. In this paper, we introduce a method that permits us to measure the impact of these morphological variations and we analyze the relation between the amplitude of variations, the modality with which they are introduced, and the performance and robustness of evolving agents. Our results demonstrate that (i) the evolutionary algorithm can tolerate morphological variations which have a very high impact, (ii) variations affecting the actions of the agent are tolerated much better than variations affecting the initial state of the agent or of the environment, and (iii) improving the accuracy of the fitness measure through multiple evaluations is not always useful. Moreover, our results show that morphological variations permit generating solutions which perform better both in varying and non-varying conditions. [ABSTRACT FROM AUTHOR]

In this paper, we compare Bayesian Optimization, Differential Evolution, and an Evolution Strategy employed as a gait-learning algorithm in modular robots. The motivational scenario is the joint evolution of morphologies and controllers, where "newborn" robots also undergo a learning process to optimize their inherited controllers (without changing their bodies). This context raises the question: How do gait-learning algorithms compare when applied to various morphologies that are not known in advance (and thus need to be treated as without priors)? To answer this question, we use a test suite of twenty different robot morphologies to evaluate our gait-learners and compare their efficiency, efficacy, and sensitivity to morphological differences. The results indicate that Bayesian Optimization and Differential Evolution deliver the same solution quality (walking speed for the robot) with fewer evaluations than the Evolution Strategy. Furthermore, the Evolution Strategy is more sensitive for morphological differences (its efficacy varies more between different morphologies) and is more subject to luck (repeated runs on the same morphology show greater variance in the outcomes). [ABSTRACT FROM AUTHOR]

In this paper, different test cases where robotic arms are tested will be presented. A robotic arm is tested for the gravity effects that can be observed on it. The other robotic arm is tested for how much precision it has by using it to learn to write. The other robotic arm is tested on how well it can function as a solar tracker and how precisely it can function as an energy harvester. On the basis of these tests, the robotic arm's mechanical structure, electronics, and software are put to the test. The software is based on evolutionary software that implements genetic algorithms. The entire command system is also ported to FPGAs (to hardware) to increase speed and response time. [ABSTRACT FROM AUTHOR]

In the field of evolutionary robotics, choosing the correct genetic representation is a complicated and delicate matter, especially when robots evolve behaviour and morphology at the same time. One principal problem is the lack of methods or tools to investigate and compare representations. In this paper we introduce and evaluate such a tool based on the biological notion of heritability. Heritability captures the proportion of phenotypic variation caused by genotypic variation and is often used to better understand the transmissibility of traits in real biological systems. As a proof of concept, we compare the heritability of various robot traits in two systems, one using a direct (tree based) representation and one using an indirect (grammar based) representation. We measure changes in heritability during the course of evolution and investigate how direct and indirect representation can be biased towards more exploration or exploitation throughout the course of evolution. The empirical study shows that heritability can be a useful tool to analyze different representations without running complete evolutionary processes using them. [ABSTRACT FROM AUTHOR]

Biological agents have bodies that are composed mostly of soft tissue. Researchers have resorted to soft bodies to investigate Artificial Life (ALife)-related questions; similarly, a new era of soft-bodied robots has just begun. Nevertheless, because of their infinite degrees of freedom, soft bodies pose unique challenges in terms of simulation, control, and optimization. Herein I propose a novel soft-bodied agents formalism, namely, pressure-based soft agents (PSAs): spring-mass membranes containing a pressurized medium. Pressure endows the agents with structure, while springs and masses simulate softness and allow the agents to assume a large gamut of shapes. PSAs actuate both locally, by changing the resting lengths of springs, and globally, by modulating global pressure. I optimize the controller of PSAs for a locomotion task on hilly terrain, an escape task from a cage, and an object manipulation task. The results suggest that PSAs are indeed effective at the tasks, especially those requiring a shape change. I envision PSAs as playing a role in modeling soft-bodied agents, such as soft robots and biological cells. [ABSTRACT FROM AUTHOR]

This article addresses the co-evolution of morphology and control in evolutionary robotics, focusing on the challenge of premature convergence and limited morphological diversity. We conduct a comparative analysis of state-of-the-art algorithms, focusing on QD (Quality-Diversity) algorithms, based on a well-defined methodology for benchmarking evolutionary algorithms. We introduce carefully chosen indicators to evaluate their performance in three core aspects: task performance, phenotype diversity, and genotype diversity. Our findings highlight MNSLC (Multi-BC NSLC), with the introduction of aligned novelty to NSLC (Novelty Search with Local Competition), as the most effective algorithm for diversity preservation (genotype and phenotype diversity), while maintaining a competitive level of exploitability (task performance). MAP-Elites, although exhibiting a well-balanced trade-off between exploitation and exploration, fall short in protecting morphological diversity. NSLC, while showing similar performance to MNSLC in terms of exploration, is the least performant in terms of exploitation, contrasting with QN (Fitness-Novelty MOEA), which exhibits much superior exploitation, but inferior exploration, highlighting the effects of local competition in skewing the balance toward exploration. Our study provides valuable insights into the advantages, disadvantages, and trade-offs of different algorithms in co-evolving morphology and control. [ABSTRACT FROM AUTHOR]

The discrepancy between simulated and hardware experiments, the reality gap, is a challenge in evolutionary robotics. While strategies have been proposed to address this gap in fixed-body robots, they are not viable when dealing with populations and generations where the body is in constant change. The continual evolution of body designs necessitates the manufacturing of new robotic structures, a process that can be time-consuming if carried out manually. Moreover, the increased manufacturing time not only prolongs hardware experimental durations but also disrupts the synergy between hardware and simulated experiments. Failure to effectively manage these challenges could impede the implementation of evolutionary robotics in real-life environments. The Autonomous Robot Evolution project presents a framework to tackle these challenges through a case study. This paper describes the main three contributions of this work: Firstly, it analyses the different reality gap experienced by each different robot or the heterogenous reality gap. Secondly, it emphasizes the importance of automation in robot manufacturing. And thirdly, it highlights the necessity of a framework to orchestrate the synergy between simulated and hardware experiments. In the long term, integrating these contributions into evolutionary robotics is envisioned to enable the continuous production of robots in real-world environments.

A swarm of robots can collectively select an option among the available alternatives offered by the environment through a process known as collective decision-making. This process is characterised by the fact that once the group makes a decision, it can not be attributed to any of its group members. In swarm robotics, the individual mechanisms for collective decision-making are generally hand-designed and limited to a restricted set of solutions based on the voter or the majority model. In this paper, we demonstrate that it is possible to take an alternative approach in which the individual mechanisms are implemented using artificial neural network controllers automatically synthesised using evolutionary computation techniques. We qualitatively describe the group dynamics underlying the decision process on a collective perceptual discrimination task. We carry out extensive comparative tests that quantitatively evaluate the performance of the most commonly used decision-making mechanisms (voter model and majority model) with the proposed dynamic neural network model under various operating conditions and for swarms that differ in size. The results of our study clearly indicate that the performances of a swarm employing dynamical neural networks as the decision-making mechanism are more robust, more adaptable to a dynamic environment, and more scalable to a larger swarm size than the performances of the swarms employing the voter and the majority model. These results, generated in simulation, are ecologically validated on a swarm of physical e-puck2 robots. [ABSTRACT FROM AUTHOR]

The increasing number of robots and the rising cost of electricity have spurred research into energy-reducing concepts in robotics. One such concept, elastic actuation, introduces compliant elements such as springs into the robot structure. This article presents a comparative analysis between two types of elastic actuation, namely, monoarticular parallel elastic actuation and biarticular parallel elastic actuation, and demonstrates an end-to-end pipeline for their optimization. Starting from the real-world system identification of an RRR robotic arm, we calibrate a simulation model in a general-purpose physics engine and employ in silico evolutionary optimization to co-optimize spring configurations and trajectories for a pick-and-place task. Finally, we successfully transfer the in silico optimized elastic elements and trajectory to the real-world prototype. Our results substantiate the ability of elastic actuation to reduce the actuators' torque requirements heavily. In contrast to previous work, we highlight the superior performance of the biarticular variant over the monoarticular configuration. Furthermore, we show that a combination of both proves most effective. This work provides valuable insights into the torque-reducing use of elastic actuation and demonstrates an actuator-invariant in silico optimization methodology capable of bridging the sim2real gap. [ABSTRACT FROM AUTHOR]

Swarm robotics is a distinctive type of multi-robotic system that relies on local communication among the swarm members to generate a desired global behaviour. This implies a lack of global information, requiring robots to sense and communicate using sensors and actuators located on their bodies. Consequently, the robots within the swarm must leverage collective intelligence to solve the problem at hand, as no individual robot can accomplish the task independently. This article provides an overview of swarm robotics in general, highlighting its characteristics that distinguish it from other multi-robotic systems and simultaneously serve as motivation to adopt a swarm robotics approach. A closer examination of collective decision making within swarm robotics and its design problem also provided, classifying design methods into manual design and automatic approaches. The most commonly used automatic approaches to design collective decision making in swarm robotics are explained, along with a mention of the benefits and drawbacks of such approaches. However, this review does not cover aspects such as the swarm collective behaviours – except collective decision making – and the swarm robotics tasks. [ABSTRACT FROM AUTHOR]