Search

Autonomous robotic teams have been proposed for a variety of lost-person searches in wilderness and urban settings. In the latter scenarios, for missing persons, the application of such teams, however, is more challenging than it would be in the wilderness. This paper, specifically, examines the application of an autonomous team of unmanned aerial vehicles (UAVs) to perform a sparse, mobile-target search in an urban setting. A novel multi-UAV search-trajectory planning method, which relies on the prediction of the missing-person’s motion, given a known map of the search environment, is the primary focus. The proposed method incorporates periodic updates of the estimates of where the lost/missing person may be, allowing for intelligent re-coverage of previously searched areas. Additional significant contributions of this work include a behavior-based motion-prediction method for missing persons and a novel non-parametric estimator for iso-probability-based (missing-person-location) curves. Simulated experiments are presented to illustrate the effectiveness of the proposed search-planning method, demonstrating higher rates of missing-person detection and in shorter times compared to other methods.

This paper addresses the problem of building an occupancy grid map of an unknown environment using a swarm comprising resource-constrained robots, i.e., robots with limited exteroceptive and inter-robot sensing capabilities. Past approaches have, commonly, used random-motion models to disperse the swarm and explore the environment randomly, which do not necessarily consider prior information already contained in the map. Herein, we present a collaborative, effective exploration strategy that directs the swarm toward ‘promising’ frontiers by dividing the swarm into two teams: landmark robots and mapper robots, respectively. The former direct the latter, toward promising frontiers, to collect proximity measurements to be incorporated into the map. The positions of the landmark robots are optimized to maximize new information added to the map while also adhering to connectivity constraints. The proposed strategy is novel as it decouples the problem of directing the resource-constrained swarm from the problem of mapping to build an occupancy grid map. The performance of the proposed strategy was validated through extensive simulated experiments.

For older adults, regular exercises can provide both physical and mental benefits, increase their independence, and reduce the risks of diseases associated with aging. However, only a small portion of older adults regularly engage in physical activity. Therefore, it is important to promote exercise among older adults to help maintain overall health. In this paper, we present the first exploratory long-term human–robot interaction (HRI) study conducted at a local long-term care facility to investigate the benefits of one-on-one and group exercise interactions with an autonomous socially assistive robot and older adults. To provide targeted facilitation, our robot utilizes a unique emotion model that can adapt its assistive behaviors to users’ affect and track their progress towards exercise goals through repeated sessions using the Goal Attainment Scale (GAS), while also monitoring heart rate to prevent overexertion. Results of the study show that users had positive valence and high engagement towards the robot and were able to maintain their exercise performance throughout the study. Questionnaire results showed high robot acceptance for both types of interactions. However, users in the one-on-one sessions perceived the robot as more sociable and intelligent, and had more positive perception of the robot’s appearance and movements.

Mobile robots that are capable of multiple modes of locomotion may have tangible advantages over unimodal robots in unstructured and non-homogeneous environments due to their ability to better adapt to local conditions. This paper specifically considers the use of a team of multimodal robots capable of switching between aerial and terrestrial modes of locomotion for wilderness search and rescue (WiSAR) scenarios. It presents a novel search planning method that coordinates the members of the robotic team to maximize the probability of locating a mobile target in the wilderness, potentially, last seen on an a priori known trail. It is assumed that the search area expands over time and, thus, an exhaustive search is not feasible. Earlier research on search planning methods for heterogeneous though unimodal search teams have exploited synergies between robots with different locomotive abilities through coordination and/or cooperation. Work on multimodal robots, on the other hand, has primarily focused on their mechanical design and low-level control. In contrast, our recent work, presented herein, has two major components: (i) target-motion prediction in the presence of a priori known trails in the wilderness, and (ii) probability-guided multimodal robot search-trajectory generation. For the former sub-problem, the novelty of our work lies in the formulation and use of 3D probability curves to capture target distributions under the influence of a priori known walking/hiking trails. For the latter, the novelty lies in the use of a tree structure to represent the decisions involved in multimodal probability-curve-guided search planning, which enables trajectory generation and mode selection to be optimized simultaneously, for example, via a Monte Carlo tree search technique. Extensive simulations, some of which are included herein, have shown that multimodal robotic search teams, coordinated via the trajectory planning method proposed in this paper, clearly outperform their unimodal counterparts in terms of search success rates.

In this article, we present a novel high-performance millirobot ( m illi- rob ot- To ronto), designed to allow for the testing of complex swarm-behaviours, including human–swarm interaction. m illi- rob ot- To ronto, built only with off-the-shelf components, has locomotion, processing and sensing capabilities that significantly improve upon existing designs, while maintaining one of the smallest footprints among current millirobots. As complementary software to this hardware development, herein, we also present a new global swarm-topology estimation algorithm. The method is novel in that it uniquely fuses incomplete location data collected by the individual robots in a distributed manner to optimally estimate the topology of the overall swarm using a centralized computer. It is a generalized technique usable by any swarm comprising robots capable of collecting location estimates of neighbouring robots. Numerous experiments, evaluating the performance of m illi- rob ot- To ronto and the proposed optimal swarm-topology estimation algorithm, are also included.

In this paper, a novel time-phased directional-sensor network deployment strategy is presented for the mobile-target search problem, e.g., wilderness search and rescue (WiSAR). The proposed strategy uses probabilistic target-motion models combined with a variation of a standard direct search algorithm to plan the optimal locations of directional-sensors which maximize the likelihood of target detection. A linear sensing model is employed as a simplification for directional-sensor network deployment planning, while considering physical constraints, such as on-time sensor deliverability. Extensive statistical simulations validated our method. One such illustrative experiment is included herein to demonstrate the method’s operation. A comparative study was also carried out, whose summary is included in this paper, to highlight the tangible improvement of our approach versus three traditional deployment strategies: a uniform, a random, and a ring-of-fire type deployment, respectively.

To effectively communicate with people, social robots must be capable of detecting, interpreting, and responding to human affect during human–robot interactions (HRIs). In order to accurately detect user affect during HRIs, affect elicitation techniques need to be developed to create and train appropriate affect detection models. In this paper, we present such a novel affect elicitation and detection method for social robots in HRIs. Non-verbal emotional behaviors of the social robot were designed to elicit user affect, which was directly measured through electroencephalography (EEG) signals. HRI experiments with both younger and older adults were conducted to evaluate our affect elicitation technique and compare the two types of affect detection models we developed and trained utilizing multilayer perceptron neural networks (NNs) and support vector machines (SVMs). The results showed that; on average, the self-reported valence and arousal were consistent with the intended elicited affect. Furthermore, it was also noted that the EEG data obtained could be used to train affect detection models with the NN models achieving higher classification rates

Mobile target search is a problem pertinent to a variety of applications, including wilderness search and rescue. This paper proposes a hybrid approach for target search utilizing a team of mobile agents supported by a network of static sensors. The approach is novel in that the mobile agents deploy the sensors at optimized times and locations while they themselves travel along their respective optimized search trajectories. In the proposed approach, mobile-agent trajectories are first planned to maximize the likelihood of target detection. The deployment of the static-sensor network is subsequently planned. Namely, deployment locations and times are optimized while being constrained by the already planned mobile-agent trajectories. The latter optimization problem, as formulated and solved herein, aims to minimize an overall network-deployment error. This overall error comprises three main components, each quantifying a deviation from one of three main objectives the network aims to achieve: (i) maintaining directional unbiasedness in target-motion consideration, (ii) maintaining unbiasedness in temporal search-effort distribution, and, (iii) maximizing the likelihood of target detection. We solve this unique optimization problem using an iterative heuristic-based algorithm with random starts. The proposed hybrid search strategy was validated through the extensive simulations presented in this paper. Furthermore, its performance was evaluated with respect to an alternative hybrid search strategy, where it either outperformed or performed comparably depending on the search resources available.

A novel methodology is proposed herein to estimate the three-dimensional (3D) surface shape of unknown, markerless deforming objects through a modular multi-camera vision system. The methodology is a generalized formal approach to shape estimation for a priori unknown objects. Accurate shape estimation is accomplished through a robust, adaptive particle filtering process. The estimation process yields a set of surface meshes representing the expected deformation of the target object. The methodology is based on the use of a multi-camera system, with a variable number of cameras, and range of object motions. The numerous simulations and experiments presented herein demonstrate the proposed methodology’s ability to accurately estimate the surface deformation of unknown objects, as well as its robustness to object loss under self-occlusion, and varying motion dynamics.

To effectively interact with people, social robots need to perceive human behaviors and in turn display their own behaviors using social communication modes such as gestures. The modeling of gestures can be difficult due to the high dimensionality of the robot configuration space. Imitation learning can be used to teach a robot to implement multi-jointed arm gestures by directly observing a human teacher’s arm movements (for example, using a non-contact 3D sensor) and then mapping these movements onto the robot arms. In this paper, we present a novel imitation learning system with robot self-collision awareness and avoidance. The proposed method uses a kinematical approach with bounding volumes to detect and avoid collisions with the robot itself while performing gesticulations. We conducted experiments with a dual arm social robot and a 3D sensor to determine the effectiveness of our imitation system in being able to mimic gestures while avoiding self-collisions.