Search

During the learning of a new sensorimotor task, individuals are usually provided with instructional stimuli and relevant information about the target task. The inclusion of haptic devices in the study of this kind of learning has greatly helped in the understanding of how an individual can improve or acquire new skills. However, the way in which the information and stimuli are delivered has not been extensively explored. We have designed a challenging task with nonintuitive visuomotor perturbation that allows us to apply and compare different motor strategies to study the teaching process and to avoid the interference of previous knowledge present in the naïve subjects. Three subject groups participated in our experiment, where the learning by repetition without assistance, learning by repetition with assistance, and task Segmentation Learning techniques were performed with a haptic robot. Our results show that all the groups were able to successfully complete the task and that the subjects’ performance during training and evaluation was not affected by modifying the teaching strategy. Nevertheless, our results indicate that the presented task design is useful for the study of sensorimotor teaching and that the presented metrics are suitable for exploring the evolution of the accuracy and precision during learning., Human-Robot Interaction

Skill propagation among robots without human involvement can be crucial in quickly spreading new physical skills to many robots. In this respect, it is a good alternative to pure reinforcement learning, which can be time-consuming, or learning from human demonstration, which requires human involvement. In the latter case, there may not be enough humans to quickly spread skills to many robots. However, propagation among robots without direct human supervision can result in robotic skills mutating from the original source. This can be beneficial when better skills might emerge or when a new skill is obtained to be used for other similar tasks. However, it can also be dangerous in terms of task execution safety. This letter studies the mutation of a robotic skill when it is propagated from one robot to another during a physically collaborative task. We chose the collaborative sawing task as a study case since it involves complex two-agent physical interaction/coordination and because its periodic nature can facilitate repetitive learning. The study employs periodic Dynamic Movement Primitives and Locally Weight Regression to encode and learn the motion and impedance required to execute the task. To explore what influences mutation, we varied several control and environment conditions such as the maximum stiffness, robot base position, friction coefficient of the sawed object, and movement period. The results showed that the skill varied over propagation steps and we identified several key aspects of mutation such as movement length, movement offset, and trajectory shape. Based on the results we identified possible benefits (skill mutations useful for different settings or different tasks, and energy efficiency) and dangers (high forces and skill mutations becoming useless for the original task) of the mutation., Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public., Human-Robot Interaction

The complexity of the human shoulder girdle enables the large mobility of the upper extremity, but also introduces instability of the glenohumeral (GH) joint. Shoulder movements are generated by coordinating large superficial and deeper stabilizing muscles spanning numerous degrees-of-freedom. How shoulder muscles are coordinated to stabilize the movement of the GH joint remains widely unknown. Musculoskeletal simulations are powerful tools to gain insights into the actions of individual muscles and particularly of those that are difficult to measure. In this study, we analyze how enforcement of GH joint stability in a musculoskeletal model affects the estimates of individual muscle activity during shoulder movements. To estimate both muscle activity and GH stability from recorded shoulder movements, we developed a Rapid Muscle Redundancy (RMR) solver to include constraints on joint reaction forces (JRFs) from a musculoskeletal model. The RMR solver yields muscle activations and joint forces by minimizing the weighted sum of squared-activations, while matching experimental motion. We implemented three new features: first, computed muscle forces include active and passive fiber contributions; second, muscle activation rates are enforced to be physiological, and third, JRFs are efficiently formulated as linear functions of activations. Muscle activity from the RMR solver without GH stability was not different from the computed muscle control (CMC) algorithm and electromyography of superficial muscles. The efficiency of the solver enabled us to test over 3600 trials sampled within the uncertainty of the experimental movements to test the differences in muscle activity with and without GH joint stability enforced. We found that enforcing GH stability significantly increases the estimated activity of the rotator cuff muscles but not of most superficial muscles. Therefore, a comparison of shoulder model muscle activity to EMG measurements of superficial muscles alone is i, Human-Robot Interaction, Learning & Autonomous Control, Biomechatronics & Human-Machine Control

Daily household tasks involve manipulation in cluttered and unpredictable environments and service robots require complex skills and adaptability to perform such tasks. To this end, we developed a teleoperated online learning approach with a novel skill refinement method, where the operator can make refinements to the initially trained skill by a haptic device. After a refined trajectory is formed, it is used to update a probabilistic trajectory model conditioned to the environment state. Therefore, the initial model can be adapted when unknown variations occur and the method is able to deal with different object positions and initial robot poses. This enables human operators to remotely correct or teach complex robotic manipulation skills. Such an approach can help to alleviate shortages of caretakers in elderly care and reduce travel time between homes of different elderly to reprogram the service robots whenever they get stuck. We performed a human factors experiment on 18 participants teaching a service robot how to empty a dishwasher, which is a common daily household task performed by caregivers. We compared the developed method against three other methods. The results show that the proposed method performs better in terms of how much time it takes to successfully adapt a model and in terms of the perceived workload., Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public., Human-Robot Interaction

The advancement and development of human modeling have greatly benefited from principles used in robotics, for instance, multibody dynamics laid the foundations for physics engines of human movement simulation, and the robotics and control theory were used to contextualize human sensorimotor control. There are many common interests and interconnections between the fields of human modeling and robotics. In recent years, as robots have become safer and smarter, they actively participate in our lives and help us in various scenarios. Roboticists need tools and data from human modeling to build next-generation robots that better assist humans. In this survey, we focus on the connections between physical human-robot interaction and human modeling. On one hand, human neuromusculoskeletal and sensorimotor control models provide novel insights into the human response that robots can utilize to improve human performance. On the other hand, robots are becoming instrumental in quantifying the performance of the (neuro)musculoskeletal system. Thus, the combined use of human modeling and robotic methods in physical human-robot interaction can lead to both improved human understanding and functional assistance., Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public., Human-Robot Interaction, Biomechatronics & Human-Machine Control

Robotic tasks which involve uncertainty – due to variation in goal, environment configuration, or confidence in task model – may require human input to instruct or adapt the robot. In tasks with physical contact, several existing methods for adapting robot trajectory or impedance according to individual uncertainties have been proposed, e.g., realizing intention detection or uncertainty-aware learning from demonstration. However, isolated methods cannot address the wide range of uncertainties jointly present in many tasks. To improve generality, this paper proposes a model predictive control (MPC) framework which plans both trajectory and impedance online, can consider discrete and continuous uncertainties, includes safety constraints, and can be efficiently applied to a new task. This framework can consider uncertainty from: contact constraint variation, uncertainty in human goals, or task disturbances. An uncertainty-aware task model is learned from a few (≤3) demonstrations using Gaussian Processes. This task model is used in a nonlinear MPC problem to optimize robot trajectory and impedance according to belief in discrete human goals, human kinematics, safety constraints, contact stability, and frequency-domain disturbance rejection. This MPC formulation is introduced, analyzed with respect to convexity, and validated in co-manipulation with multiple goals, a collaborative polishing task, and a collaborative assembly task., Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public., Human-Robot Interaction

Biological systems, including human beings, have the innate ability to perform complex tasks in a versatile and agile manner. Researchers in sensorimotor control have aimed to comprehend and formally define this innate characteristic. The idea, supported by several experimental findings, that biological systems are able to combine and adapt basic units of motion into complex tasks finally leads to the formulation of the motor primitives’ theory. In this respect, Dynamic Movement Primitives (DMPs) represent an elegant mathematical formulation of the motor primitives as stable dynamical systems and are well suited to generate motor commands for artificial systems like robots. In the last decades, DMPs have inspired researchers in different robotic fields including imitation and reinforcement learning, optimal control, physical interaction, and human–robot co-working, resulting in a considerable amount of published papers. The goal of this tutorial survey is two-fold. On one side, we present the existing DMP formulations in rigorous mathematical terms and discuss the advantages and limitations of each approach as well as practical implementation details. In the tutorial vein, we also search for existing implementations of presented approaches and release several others. On the other side, we provide a systematic and comprehensive review of existing literature and categorize state-of-the-art work on DMP. The paper concludes with a discussion on the limitations of DMPs and an outline of possible research directions., Human-Robot Interaction

Collaborative robots (cobots) have the potential to augment the productivity and life quality of human operators in the context of Industry 4.0 by providing them with physical assistance. For this reason, it is necessary to define the relationship between humans and cobots and to study how the two agents adapt to each other. However, to the best of our knowledge, literature is still missing insight into how humans perceive and react to changes in the cobot behavior (e.g. changes in the learned trajectory and in the role the robot assumes). Specifically, a study of how humans adapt to changing roles and control strategies of collaborating robots is missing. To fill this gap, we propose a human study in which 16 participants executed a collaborative human–robot sawing task where the cobot altered between three different control strategies. We examined human adaptation when cobot suddenly changed the control strategy from one to another, resulting in six experimental conditions. The experiments were performed on a setup involving Kuka LBR iiwa robotic arm. The results suggest that transition influences movement performance in the early stages and at steady state, subjects prefer to abandon modes that require more effort and they adapt faster to energy-demanding modes. Finally, for the specific task we studied, subjects tend to prefer collaborative modes to ones in which the robot assumes a fixed role., Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public., Human-Robot Interaction

This paper studies non-physical feedback mechanisms to guide human workers toward ergonomic body postures. Specifically, the focus is to solve the tasks that involve no direct physical interaction between the human and the robotic system, therefore tactile guidance by the robot body is not feasible. We propose a multi-modal ergonomic posture guidance system that comprises visual feedback and speech-based audio feedback. We hypothesise that the proposed multi-modal system leads to better performance compared to uni-modal feedback systems when trying to guide users from one pose to another. To test the hypothesis we conducted an experiment that compared conditions with only audio feedback, only visual feedback and multi-modal feedback. In addition, we examined speech-based audio guidance in joint space and in endpoint space. The results showed that the speech-based feedback in joint space came out as the preferred audio feedback due to its ability to allow users to carry out efficient and coordinated inter-joint movements, especially in cases of high redundancy. Furthermore, the proposed multi-modal feedback system was superior compared to the other feedback modalities both in terms of objective measures and subjective measures., Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public., Human-Robot Interaction

Despite the significant progress made in making robots more intelligent and autonomous, today, teleoperation remains a dominant robot control paradigm for the execution of complex and highly unpredictable tasks. Attempts have been made to make teleoperation systems stable, easy to use, and efficient in terms of physical interactions between the follower remote robot and the environment. In particular, the emergence of torque-controlled robots has permitted to regulate the interaction forces from a distance through direct force or impedance control, enabling them to engage in complex interaction tasks. Exploiting this feature, the concept of teleimpedance control was introduced as an alternative method to bilateral force-reflecting teleoperation. The aim was to create a feed-froward yet contact-efficient teleoperation by enriching the leader commands with desired impedance profiles while executing a task. Since then, the teleimpedance concept has found its way into a wide range of interface and controller designs, as well as application domains. Accordingly, after a decade of research progress, this survey aims to provide: first, a convenient introduction of the concept to new researchers in the field, second, consolidate the existing state-of-the-art for active researchers, third, and discuss the pros and cons of different methods in terms of interface and force feedback to provide guidelines for different applications and future developments., Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public., Human-Robot Interaction

Humans often demonstrate diverse behaviors due to their personal preferences, for instance, related to their individual execution style or personal margin for safety. In this paper, we consider the problem of integrating both path and velocity preferences into trajectory planning for robotic manipulators. We first learn reward functions that represent the user path and velocity preferences from kinesthetic demonstration. We then optimize the trajectory in two steps, first the path and then the velocity, to produce trajectories that adhere to both task requirements and user preferences. We design a set of parameterized features that capture the fundamental preferences in a pick-and-place type of object transportation task, both in the shape and timing of the motion. We demonstrate that our method is capable of generalizing such preferences to new scenarios. We implement our algorithm on a Franka Emika 7-DoF robot arm and validate the functionality and flexibility of our approach in a user study. The results show that non-expert users are able to teach the robot their preferences with just a few iterations of feedback., Biomechatronics & Human-Machine Control, Human-Robot Interaction, Learning & Autonomous Control

Physical human-robot interaction can improve human ergonomics, task efficiency, and the flexibility of automation, but often requires application-specific methods to detect human state and determine robot response. At the same time, many potential human-robot interaction tasks involve discrete modes, such as phases of a task or multiple possible goals, where each mode has a distinct objective and human behavior. In this paper, we propose a novel method for multi-modal physical human-robot interaction that builds a Gaussian process model for human force in each mode of a collaborative task. These models are then used for Bayesian inference of the mode, and to determine robot reactions through model predictive control. This approach enables optimization of robot trajectory based on the belief of human intent, while considering robot impedance and human joint configuration, according to ergonomic- and/or task-related objectives. The proposed method reduces programming time and complexity, requiring only a low number of demonstrations (here, three per mode) and a mode-specific objective function to commission a flexible online human-robot collaboration task. We validate the method with experiments on an admittance-controlled robot, performing a collaborative assembly task with two modes where assistance is provided in full six degrees of freedom. It is shown that the developed algorithm robustly re-plans to changes in intent or robot initial position, achieving online control at 15 Hz., Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public., Human-Robot Interaction

Tele-impedance increases interaction performance between a robotic tool and unstructured/unpredictable en-vironments during teleoperation. However, the existing tele-impedance interfaces have several ongoing issues, such as long calibration times and various obstructions for the human operator. In addition, they are all designed to be controlled by the operator's arms, which can cause difficulties when both arms are used, as in bi-manual teleoperation. To resolve these issues, we designed a novel foot-based tele-impedance control method inspired by the human limb stiffness ellipse modulation. The proposed mechanical interface design includes a disc and a foot pressure sensor that controls the orientation and size/shape of the stiffness ellipse, respectively. We evaluated the disc interface control method in an experimental study with 12 participants, who performed a complex drilling task in a virtual environment. The results show the ability of the operator to use the proposed interface in order to dynamically adapt to different phases of the task and changes in the environment. In addition, a comparison with low and high uniform impedance modes demonstrates a superior interaction performance of the proposed method., Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public., Biomechatronics & Human-Machine Control, Human-Robot Interaction

We present a method for arbitration between human and robot involvement in a collaborative physical task execution based on ergonomic metrics. The existing methods for ergonomic control of physical human-robot collaboration perform the real-Time arbitration primarily based on a single type of ergonomic metric. The novelty of our approach is twofold. First, the system enables real-Time arbitration based on combining two types of ergonomic metrics: preventive and reactive. Second, we use a preventive metric to prevent worker fatigue and discomfort due to overexertion in the future and a reactive metric to avoid immediate fatigue and discomfort. To this end, we considered two metrics respectively: human arm manipulability and muscle fatigue. The developed multi-metric arbitration method translates the human multi-metric state to a robot control level over a collaborative task execution using a finite state machine. We demonstrate the proposed method on a Kuka LWR iiwa robotic arm in a collaborative human-robot polishing task that requires a specific force production., Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public., Human-Robot Interaction

Walking is an essential part of almost all activities of daily living. We use different gait patterns in different situations, e.g., moving around the house, performing various sports, or when compensating for an injury. However, how humans perform this gait tailoring remains a partially unknown process. To this end, the influence of various performance metrics on the optimality and diversity of gait patterns can provide us with more insight. To analyse gait in terms of pattern diversity and performance metrics related to physical aspects, such as joint torque, fatigue, and manipulability, we propose a multi-metric gait analysis framework that simultaneously accounts for these parameters. We used a recorded set of versatile gait patterns that are already dynamically stable and physiologically feasible. To that end, 45 gait variations-varying in stride length, step height, and walking speed-were recorded in a motion capture experiment. Results of analysis using the recorded dataset are presented for a baseline case (with all optimisation weights set to one), which serves as the first step for future research, in particular giving insights into specific aspects of the gait, e.g., joint loading, long-term performance, and capacity to sustain ground reaction forces., Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public., Human-Robot Interaction

While half of all construction tasks can be fully automated the other half relies to a certain degree on human support. This paper presents a Computer Vision (CV) and Human–Robot Interaction/Collaboration (HRI/C) supported Design-to-Robotic-Assembly (D2RA) approach that links computational design with robotic assembly. This multidisciplinary approach has been tested on a case study focusing on urban furniture and involving experts from respective disciplines and students., Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public., History, Form & Aesthetics, Human-Robot Interaction

In this work, we propose a method for monitoring and managing rotator-cuff (RC) tendon strains in human-robot collaborative physical therapy for shoulder rehabilitation. We integrate a high-resolution biomechanical model with a collaborative industrial robot arm and an impedance controller to provide feedback to a human subject, therapist or both, which prevents the subject from entering unsafe poses during rehabilitation. The biomechanical model estimates RC tendon strain as a function of human shoulder configuration, muscle activation and applied external forces. Subject- and injury-specific data are model estimates of strain that compose strain maps, which capture the relationship between the RC strains and movement of the shoulder degrees of freedom (DoF). High-strain regions of the strain map are identified as unsafe zones by clustering and ellipse fitting to smoothly demarcate these zones. These unsafe areas, which reflect increased risks of (re-)injury, are used to define parameters of an impedance controller and reference pose for real-time biomechanical safety control. Using strain maps we demonstrate both safe patient-led movements and teleoperated movements that prevent the subject from entering unsafe zones. In the teleoperated case, the physical therapist leads the patient remotely using a haptic device. The proposed method has the potential to improve the safety, range of motion, and volume of activity that a patient receives through robot-mediated physical therapy. We validated our approach using three experiments that demonstrate shoulder joint torques of less than 1 Nm during free motion with larger torques occurring only when the subject was asked to actively push into the unsafe boundary or, in the case of teleoperation, to resist the physical therapist., Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public., Human-Robot Interaction, Biomechatronics & Human-Machine Control

Unlike many traditional stiff position-controlled robots, new collaborative robots interact with humans and operate in an environment that is often unpredictable and unknown. For safe and effective executions of manipulation tasks within such an environment, the robot requires to modulate its compliance. Therefore, the human operator must have a system that enables an intuitive demonstration of compliance skills to the robot. Ideally, this should also be possible through teleoperation in order to have the ability to demonstrate skills at a distance, such as in remote home care applications or any other scenario where the skilled operators are not physically present all the time. Existing state-of-the-art methods for remote demonstration of impedance skills only enable limited modulation of the stiffness matrix, or they are too complex and cumbersome for practical applications. This research tries to overcome these limitations and proposes a teleoperated stiffness commanding method that enables a complete modulation of the stiffness matrix in 3 degrees of freedom. The method uses the same haptic device hardware as used for controlling the robot manipulator motion, hence it does not require extra specialised equipment for stiffness commands. By wiggling the endpoint of the haptic device, the stiffness is commanded to the robot and also fed back to the operator through haptic and visual feedback. To evaluate the performance and acceptance of the system, we performed a user study where the participants had to demonstrate various interaction behaviour to the remote robot. The results show how varying system parameters (i.e., degrees of freedom, orientation, and size of the stiffness commands) influence the performance of the system and user acceptance., Accepted Author Manuscript, Human-Robot Interaction

In tele-impedance the human can control the impedance of the remote robot through various interfaces, in addition to controlling the motion. While this can improve the performance of the remote robot in unpredictable and unstructured environments, it can add more workload to the human operator compared to the classic teleoperation. This paper presents a novel method for a semi-autonomous tele-impedance, where the controller exploits the robot vision to detect the environment and selects the appropriate impedance. For example, if vision detects a fragile object like glass, the controller autonomously lowers the impedance to increase the safety, while the human is commanding the motion to initiate and perform the interaction. If the vision algorithm is not confident in its detection, we developed an additional verbal communication interface that enables the human to confirm or correct the autonomous decision. Therefore, the method has four modalities: (i) perturbation rejection mode, (ii) object property detection mode, (iii) verbal confirmation mode, (iv) voice control mode. We conducted proof-of-concept experiments on a teleoperation setup, where the human operator performed position tracking and contact establishing tasks., Accepted Author Manuscript, Human-Robot Interaction

Imitation learning techniques have been used as a way to transfer skills to robots. Among them, dynamic movement primitives (DMPs) have been widely exploited as an effective and an efficient technique to learn and reproduce complex discrete and periodic skills. While DMPs have been properly formulated for learning point-to-point movements for both translation and orientation, periodic ones are missing a formulation to learn the orientation. To address this gap, we propose a novel DMP formulation that enables encoding of periodic orientation trajectories. Within this formulation we develop two approaches: Riemannian metric-based projection approach and unit quaternion based periodic DMP. Both formulations exploit unit quaternions to represent the orientation. However, the first exploits the properties of Riemannian manifolds to work in the tangent space of the unit sphere. The second encodes directly the unit quaternion trajectory while guaranteeing the unitary norm of the generated quaternions. We validated the technical aspects of the proposed methods in simulation. Then we performed experiments on a real robot to execute daily tasks that involve periodic orientation changes (i.e., surface polishing/wiping and liquid mixing by shaking)., Accepted Author Manuscript, Human-Robot Interaction

The existing state-of-the-art interfaces for commanding a remote robot's endpoint stiffness ellipsoid in tele-impedance lack the ability to independently control its size, shape and orientation or they are not easily to implement due to the use of physiological signals, such as electromyography, to control the endpoint stiffness. We propose a novel method that can command size, shape and orientation independently and simultaneously through a virtual stiffness ellipsoid generated on a touchscreen device. The human operator controls size, shape and orientation of the virtual ellipsoid using his/her index and thumb fingers of one hand. This virtual ellipsoid is then mapped to the Cartesian stiffness ellipsoid of a remote robot endpoint in real-time. The other hand holds the haptic device to control the pose of the remote robotic arm. Compared to the state-of-the-art methods to control the robot stiffness in tele-impedance, the main advantages of the proposed method are its relatively simple implementation and ability of independent control over various aspects of the robot endpoint stiffness ellipsoid. To provide a proof-of-concept and demonstrate the main features of the proposed approach, we performed several experiments on a tele-impedance setup with a Kuka LBR iiwa robotic arm and a Force Dimension Sigma7 haptic device. We examined two principal types of tasks, in which changing stiffness parameters of the remote robot is important for successful task execution: counteracting external perturbations and establishing contact with unknown objects. The results indicate that our proposed approach can successfully deal with these tasks. A human subject study showed that the touchscreen interface is faster in commanding the desired stiffness compared to another state-of-the-art input method, while showing similar workload ratings., Accepted Author Manuscript, Human-Robot Interaction

In this work, we explore using computational musculoskeletal modeling to equip an industrial collaborative robot with awareness of the internal state of a patient to safely deliver physical therapy. A major concern of robot-mediated physical therapy is that robots may unwittingly injure patients. For patients with shoulder injuries this typically means the risk of tearing a rotator-cuff muscle tendon. Risk of reinjury hampers both human and robot therapists and it is the main reason for conservative physical therapy. Advances in human musculoskeletal modeling, however, can equip robots with additional perception of potential reinjury risks. While the ultimate goal is to improve the safety, range-of-motion and activity that patients receive through robot-mediated therapy, the aim of this letter is to develop and test a framework that enables the robot to understand the state of the patient and to execute physical therapy movements that demonstrate low injury risk and achieve a large range-of-motion in human subjects. We build on prior work in human-robot interaction via impedance control, but take robot awareness of the human to the next level by including and manipulating a musculoskeletal model in parallel to the patient. Taking the most common shoulder impairments (i.e., rotator-cuff tears) as an example, we demonstrate planned, model-based trajectories that minimize strain in these muscles and corresponding robot-mediated movements on healthy subjects. Our experiments suggest that musculoskeletal awareness is a promising approach to plan and deliver therapeutic movements that are safe and effective via an industrial robot., Accepted Author Manuscript, Biomechatronics & Human-Machine Control, Human-Robot Interaction

Tele-impedance augments classic teleoperation by enabling the human operator to actively command remote robot stiffness in real-time, which is an essential ability to successfully interact with the unstructured and unpredictable environment. However, the literature is missing a study on benefits and drawbacks of different types of stiffness command interfaces used in bilateral tele-impedance. In this article, we introduce a term called coupling effect, which pertains to the coupling between human-commanded stiffness going to the remote robot and force feedback coming from the remote robot. We hypothesize that, whenever the operator's commanded stiffness and force feedback are subject to coupling effect (e.g., muscle activity based stiffness command interfaces), force feedback can invoke involuntary changes in the commanded stiffness due to human reflexes. Although the coupling effect takes away some degree of the operator's control over the commanded stiffness, these involuntary changes can be either beneficial (e.g., during position tracking) or detrimental (e.g., during force tracking) to the task performance on the remote robot side. We examined the coupling effect in an experimental study with $\mathbf {16}$ participants, who performed position and force tracking tasks by using both coupled type (muscle activity based) and decoupled type (external device based) of interface. The results demonstrate a benefit of the coupling effect when the remote robot is operating in presence of unexpected force perturbations, where lower absolute error in position tracking task was observed. On the other hand, the decoupled type of interface is beneficial for force tracking tasks on the remote robot side, such as establishing or maintaining a stable contact with objects. However, the coupling effect negatively influences the commanding of reference stiffness to the remote robot in both position and, Accepted Author Manuscript, Human-Robot Interaction

Ergonomics of human workers is one of the key elements in design and evaluation of production processes. Human ergonomics have a major impact on productivity as well as chronic health risks incurred by inappropriate working postures and conditions. In this paper we propose a novel method for estimating and communicating the ergonomic work condition called Binary Work-Condition Map, which provides a visualized feedback about work conditions of different configurations of an arm. The map is of binary nature and is derived by imposing the desired thresholds on considered ergonomic and safety related criteria. Therefore, the suggested arm postures in the map guarantee that all considered criteria are satisfied. This eliminates the ambiguity compared to state-of-the-art maps that uses continuous scales derived from weighted sum of multiple ergonomics criteria. In addition, to combine the advantages of both the binary map and the continuous map, we additionally propose a Hybrid Work-Condition Map that rules out unsuitable workspace with the binary map approach and renders the suitable workspace with the continuous map approach. The proposed approach was tested in simulation for various tasks and conditions. In addition, we conducted subjective evaluation experiments to compare the proposed methods with the state-of-the art method regarding the usability. The results indicated that the binary map is simpler to use, while the hybrid map is a good tradeoff between the binary and the continuous map. In selecting the map, strong points of each map should be considered with respect to the requirements of a specific application and task., Human-Robot Interaction

Teaching robots how to apply forces according to our preferences is still an open challenge that has to be tackled from multiple engineering perspectives. This paper studies how to learn variable impedance policies where both the Cartesian stiffness and the attractor can be learned from human demonstrations and corrections with a user-friendly interface. The presented framework, named ILoSA, uses Gaussian Processes for policy learning, identifying regions of uncertainty and allowing interactive corrections, stiffness modulation and active disturbance rejection. The experimental evaluation of the framework is carried out on a Franka-Emika Panda in four separate cases with unique force interaction properties: 1) pulling a plug wherein a sudden force discontinuity occurs upon successful removal of the plug, 2) pushing a box where a sustained force is required to keep the robot in motion, 3) wiping a whiteboard in which the force is applied perpendicular to the direction of movement, and 4) inserting a plug to verify the usability for precision-critical tasks in an experimental validation performed with non-expert users., Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public., Learning & Autonomous Control, Human-Robot Interaction

Space exploration is characterized by a limited amount of resources and tools. This particularly stands out in habitat construction, where heavy machinery like cranes are unavailable and manual work still plays a key role. To mitigate this, we propose a human-robot collaboration method for habitat construction tasks, which involve several key subtasks: grasping objects of various shapes, carrying them, and aligning them for assembly. The proposed method is based on an impedance controller and includes four modes of operation, that are tailored for specific sub-tasks. Each mode prescribes a robot stiffness behavior, needed for collaborative execution. The human operator can easily switch between the mode in realtime via a voice interface. To demonstrate the functionality of the proposed method in the construction task, we performed an experiment using KUKA LBR iiwa robot arm and qb robotics SoftHand robotic hand. These results indicate that the method offers a practical solution for human-robot collaborative construction tasks., Human-Robot Interaction

The science and technology of wearable robots are steadily advancing, and the use of such robots in our everyday life appears to be within reach. Nevertheless, widespread adoption of wearable robots should not be taken for granted, especially since many recent attempts to bring them to real-life applications resulted in mixed outcomes. The aim of this article is to address the current challenges that are limiting the application and wider adoption of wearable robots that are typically worn over the human body. We categorized the challenges into mechanical layout, actuation, sensing, body interface, control, human–robot interfacing and coadaptation, and benchmarking. For each category, we discuss specific challenges and the rationale for why solving them is important, followed by an overview of relevant recent works. We conclude with an opinion that summarizes possible solutions that could contribute to the wider adoption of wearable robots., Human-Robot Interaction

Teaching robots how to apply forces according to our preferences is still an open challenge that has to be tackled from multiple engineering perspectives. This paper studies how to learn variable impedance policies where both the Cartesian stiffness and the attractor can be learned from human demonstrations and corrections with a user-friendly interface. The presented framework, named ILoSA, uses Gaussian Processes for policy learning, identifying regions of uncertainty and allowing interactive corrections, stiffness modulation and active disturbance rejection. The experimental evaluation of the framework is carried out on a Franka-Emika Panda in four separate cases with unique force interaction properties: 1) pulling a plug wherein a sudden force discontinuity occurs upon successful removal of the plug, 2) pushing a box where a sustained force is required to keep the robot in motion, 3) wiping a whiteboard in which the force is applied perpendicular to the direction of movement, and 4) inserting a plug to verify the usability for precision-critical tasks in an experimental validation performed with non-expert users., Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public., Learning & Autonomous Control, Human-Robot Interaction

The existing state-of-the-art interfaces for commanding a remote robot's endpoint stiffness ellipsoid in tele-impedance lack the ability to independently control its size, shape and orientation or they are not easily to implement due to the use of physiological signals, such as electromyography, to control the endpoint stiffness. We propose a novel method that can command size, shape and orientation independently and simultaneously through a virtual stiffness ellipsoid generated on a touchscreen device. The human operator controls size, shape and orientation of the virtual ellipsoid using his/her index and thumb fingers of one hand. This virtual ellipsoid is then mapped to the Cartesian stiffness ellipsoid of a remote robot endpoint in real-time. The other hand holds the haptic device to control the pose of the remote robotic arm. Compared to the state-of-the-art methods to control the robot stiffness in tele-impedance, the main advantages of the proposed method are its relatively simple implementation and ability of independent control over various aspects of the robot endpoint stiffness ellipsoid. To provide a proof-of-concept and demonstrate the main features of the proposed approach, we performed several experiments on a tele-impedance setup with a Kuka LBR iiwa robotic arm and a Force Dimension Sigma7 haptic device. We examined two principal types of tasks, in which changing stiffness parameters of the remote robot is important for successful task execution: counteracting external perturbations and establishing contact with unknown objects. The results indicate that our proposed approach can successfully deal with these tasks. A human subject study showed that the touchscreen interface is faster in commanding the desired stiffness compared to another state-of-the-art input method, while showing similar workload ratings., Accepted Author Manuscript, Human-Robot Interaction

Unlike many traditional stiff position-controlled robots, new collaborative robots interact with humans and operate in an environment that is often unpredictable and unknown. For safe and effective executions of manipulation tasks within such an environment, the robot requires to modulate its compliance. Therefore, the human operator must have a system that enables an intuitive demonstration of compliance skills to the robot. Ideally, this should also be possible through teleoperation in order to have the ability to demonstrate skills at a distance, such as in remote home care applications or any other scenario where the skilled operators are not physically present all the time. Existing state-of-the-art methods for remote demonstration of impedance skills only enable limited modulation of the stiffness matrix, or they are too complex and cumbersome for practical applications. This research tries to overcome these limitations and proposes a teleoperated stiffness commanding method that enables a complete modulation of the stiffness matrix in 3 degrees of freedom. The method uses the same haptic device hardware as used for controlling the robot manipulator motion, hence it does not require extra specialised equipment for stiffness commands. By wiggling the endpoint of the haptic device, the stiffness is commanded to the robot and also fed back to the operator through haptic and visual feedback. To evaluate the performance and acceptance of the system, we performed a user study where the participants had to demonstrate various interaction behaviour to the remote robot. The results show how varying system parameters (i.e., degrees of freedom, orientation, and size of the stiffness commands) influence the performance of the system and user acceptance., Accepted Author Manuscript, Human-Robot Interaction

In tele-impedance the human can control the impedance of the remote robot through various interfaces, in addition to controlling the motion. While this can improve the performance of the remote robot in unpredictable and unstructured environments, it can add more workload to the human operator compared to the classic teleoperation. This paper presents a novel method for a semi-autonomous tele-impedance, where the controller exploits the robot vision to detect the environment and selects the appropriate impedance. For example, if vision detects a fragile object like glass, the controller autonomously lowers the impedance to increase the safety, while the human is commanding the motion to initiate and perform the interaction. If the vision algorithm is not confident in its detection, we developed an additional verbal communication interface that enables the human to confirm or correct the autonomous decision. Therefore, the method has four modalities: (i) perturbation rejection mode, (ii) object property detection mode, (iii) verbal confirmation mode, (iv) voice control mode. We conducted proof-of-concept experiments on a teleoperation setup, where the human operator performed position tracking and contact establishing tasks., Accepted Author Manuscript, Human-Robot Interaction

Imitation learning techniques have been used as a way to transfer skills to robots. Among them, dynamic movement primitives (DMPs) have been widely exploited as an effective and an efficient technique to learn and reproduce complex discrete and periodic skills. While DMPs have been properly formulated for learning point-to-point movements for both translation and orientation, periodic ones are missing a formulation to learn the orientation. To address this gap, we propose a novel DMP formulation that enables encoding of periodic orientation trajectories. Within this formulation we develop two approaches: Riemannian metric-based projection approach and unit quaternion based periodic DMP. Both formulations exploit unit quaternions to represent the orientation. However, the first exploits the properties of Riemannian manifolds to work in the tangent space of the unit sphere. The second encodes directly the unit quaternion trajectory while guaranteeing the unitary norm of the generated quaternions. We validated the technical aspects of the proposed methods in simulation. Then we performed experiments on a real robot to execute daily tasks that involve periodic orientation changes (i.e., surface polishing/wiping and liquid mixing by shaking)., Accepted Author Manuscript, Human-Robot Interaction

In this work, we explore using computational musculoskeletal modeling to equip an industrial collaborative robot with awareness of the internal state of a patient to safely deliver physical therapy. A major concern of robot-mediated physical therapy is that robots may unwittingly injure patients. For patients with shoulder injuries this typically means the risk of tearing a rotator-cuff muscle tendon. Risk of reinjury hampers both human and robot therapists and it is the main reason for conservative physical therapy. Advances in human musculoskeletal modeling, however, can equip robots with additional perception of potential reinjury risks. While the ultimate goal is to improve the safety, range-of-motion and activity that patients receive through robot-mediated therapy, the aim of this letter is to develop and test a framework that enables the robot to understand the state of the patient and to execute physical therapy movements that demonstrate low injury risk and achieve a large range-of-motion in human subjects. We build on prior work in human-robot interaction via impedance control, but take robot awareness of the human to the next level by including and manipulating a musculoskeletal model in parallel to the patient. Taking the most common shoulder impairments (i.e., rotator-cuff tears) as an example, we demonstrate planned, model-based trajectories that minimize strain in these muscles and corresponding robot-mediated movements on healthy subjects. Our experiments suggest that musculoskeletal awareness is a promising approach to plan and deliver therapeutic movements that are safe and effective via an industrial robot., Accepted Author Manuscript, Biomechatronics & Human-Machine Control, Human-Robot Interaction

Tele-impedance augments classic teleoperation by enabling the human operator to actively command remote robot stiffness in real-time, which is an essential ability to successfully interact with the unstructured and unpredictable environment. However, the literature is missing a study on benefits and drawbacks of different types of stiffness command interfaces used in bilateral tele-impedance. In this article, we introduce a term called coupling effect, which pertains to the coupling between human-commanded stiffness going to the remote robot and force feedback coming from the remote robot. We hypothesize that, whenever the operator's commanded stiffness and force feedback are subject to coupling effect (e.g., muscle activity based stiffness command interfaces), force feedback can invoke involuntary changes in the commanded stiffness due to human reflexes. Although the coupling effect takes away some degree of the operator's control over the commanded stiffness, these involuntary changes can be either beneficial (e.g., during position tracking) or detrimental (e.g., during force tracking) to the task performance on the remote robot side. We examined the coupling effect in an experimental study with $\mathbf {16}$ participants, who performed position and force tracking tasks by using both coupled type (muscle activity based) and decoupled type (external device based) of interface. The results demonstrate a benefit of the coupling effect when the remote robot is operating in presence of unexpected force perturbations, where lower absolute error in position tracking task was observed. On the other hand, the decoupled type of interface is beneficial for force tracking tasks on the remote robot side, such as establishing or maintaining a stable contact with objects. However, the coupling effect negatively influences the commanding of reference stiffness to the remote robot in both position and, Accepted Author Manuscript, Human-Robot Interaction

Ergonomics of human workers is one of the key elements in design and evaluation of production processes. Human ergonomics have a major impact on productivity as well as chronic health risks incurred by inappropriate working postures and conditions. In this paper we propose a novel method for estimating and communicating the ergonomic work condition called Binary Work-Condition Map, which provides a visualized feedback about work conditions of different configurations of an arm. The map is of binary nature and is derived by imposing the desired thresholds on considered ergonomic and safety related criteria. Therefore, the suggested arm postures in the map guarantee that all considered criteria are satisfied. This eliminates the ambiguity compared to state-of-the-art maps that uses continuous scales derived from weighted sum of multiple ergonomics criteria. In addition, to combine the advantages of both the binary map and the continuous map, we additionally propose a Hybrid Work-Condition Map that rules out unsuitable workspace with the binary map approach and renders the suitable workspace with the continuous map approach. The proposed approach was tested in simulation for various tasks and conditions. In addition, we conducted subjective evaluation experiments to compare the proposed methods with the state-of-the art method regarding the usability. The results indicated that the binary map is simpler to use, while the hybrid map is a good tradeoff between the binary and the continuous map. In selecting the map, strong points of each map should be considered with respect to the requirements of a specific application and task., Human-Robot Interaction

In this paper, we propose a method for improving the human operator's arm posture during bilateral teleoperation. The method is based on a musculoskeletal model that considers human operator's arm dynamics and the feedback force from the haptic interface (master), which is used to control a robotic arm (slave) in a remote environment. We perform an online optimisation to find the optimal configuration that has the longest endurance time with respect to muscle fatigue. Next, a trajectory is generated on the haptic interface in order to guide the human arm into the optimal configuration. The teleoperation is temporarily suspended by decoupling the master from the slave robot when the haptic device is being reconfigured. Afterwards, the loop is coupled again and the slave robot is controlled from the position where it stopped after the haptic interface guided the operator's arm to the optimised configuration. The main advantage of the proposed method is that the human operator can perform the task with less effort, which increases the endurance time. To validate our approach, we performed proof-of-concept experiments on a teleoperation system composed of two Franka Emika robots, where one was serving as master and the other as slave., Accepted Author Manuscript, Human-Robot Interaction

In this paper, we introduce and explore a concept called coupling effect, which pertains to the influence of force feedback on the commanded stiffness that is voluntarily controlled by the operator through the stiffness interface during bilateral tele-impedance. The degree of coupling effect depends on the type of interface used to control the impedance of the remote robot. In case of muscle activity based stiffness command interfaces, the force feedback can invoke involuntary changes in the commanded stiffness due to human reflexes. These involuntary changes can be either beneficial (e.g., during position tracking) or detrimental (e.g., during force tracking) to the task performance on the remote robot side. To investigate the coupling effect in different types of stiffness command interfaces (i.e., coupled and decoupled), we conduct an experimental study in which participants are asked to perform position and force tracking tasks. The results show that in both position and force tracking tasks a lower tracking error of the reference stiffness is obtained with a decoupled interface (p<0.001). However, the unexpected force perturbation yields lower absolute position error when using a coupled interface (p=0.0091), which indicates a specific benefit of the coupling effect. Finally, a lower absolute force error is found in the force tracking task by using the decoupled interface (p<0.001), which indicates a specific downside of the coupling effect., Accepted Author Manuscript, Human-Robot Interaction

In this paper, we propose a method for improving the human operator's arm posture during bilateral teleoperation. The method is based on a musculoskeletal model that considers human operator's arm dynamics and the feedback force from the haptic interface (master), which is used to control a robotic arm (slave) in a remote environment. We perform an online optimisation to find the optimal configuration that has the longest endurance time with respect to muscle fatigue. Next, a trajectory is generated on the haptic interface in order to guide the human arm into the optimal configuration. The teleoperation is temporarily suspended by decoupling the master from the slave robot when the haptic device is being reconfigured. Afterwards, the loop is coupled again and the slave robot is controlled from the position where it stopped after the haptic interface guided the operator's arm to the optimised configuration. The main advantage of the proposed method is that the human operator can perform the task with less effort, which increases the endurance time. To validate our approach, we performed proof-of-concept experiments on a teleoperation system composed of two Franka Emika robots, where one was serving as master and the other as slave., Accepted Author Manuscript, Human-Robot Interaction

In this paper, we introduce and explore a concept called coupling effect, which pertains to the influence of force feedback on the commanded stiffness that is voluntarily controlled by the operator through the stiffness interface during bilateral tele-impedance. The degree of coupling effect depends on the type of interface used to control the impedance of the remote robot. In case of muscle activity based stiffness command interfaces, the force feedback can invoke involuntary changes in the commanded stiffness due to human reflexes. These involuntary changes can be either beneficial (e.g., during position tracking) or detrimental (e.g., during force tracking) to the task performance on the remote robot side. To investigate the coupling effect in different types of stiffness command interfaces (i.e., coupled and decoupled), we conduct an experimental study in which participants are asked to perform position and force tracking tasks. The results show that in both position and force tracking tasks a lower tracking error of the reference stiffness is obtained with a decoupled interface (p<0.001). However, the unexpected force perturbation yields lower absolute position error when using a coupled interface (p=0.0091), which indicates a specific benefit of the coupling effect. Finally, a lower absolute force error is found in the force tracking task by using the decoupled interface (p<0.001), which indicates a specific downside of the coupling effect., Accepted Author Manuscript, Human-Robot Interaction

The deployment of industrial robotic cells based on lean manufacturing principles enables the development of fast-reconfigurable assembly lines in which human and robotic agents collaborate to achieve a shared task. To ensure the effective coordination of the shared effort, each task must be decomposed into a sequence of atomic actions that can be assigned either to a single agent or to the combination of more agents, according to a defined metric. While task allocation is a general problem and has been discussed intensively in other fields, less effort has been devoted in industrial scenarios, involving mixed human–robot teams and in particular, to the factors that should be considered in allocating tasks among a heterogeneous set of agents in collaborative manufacturing scenarios. In this letter, we investigate the agent characteristics that should be considered in the task allocation problem of fast-reconfigurable systems in industrial assembly processes. First, we introduce a set of indices, namely task complexity, agent dexterity, and agent effort, to evaluate agent performance with respect to a task. Second, we propose an offline allocation algorithm that combines the performance indices to assign optimally the task to the team agents. Finally, we validate the framework in a proof-of-concept collaborative assembly of a metallic structure. The results show that the workload is shared through the agents according to their particular physical capabilities and skill levels. A subjective analysis of the proposed collaborative framework on 12 healthy participants also validated the intuitiveness-of-use and improved performance., Accepted Author Manuscript, Human-Robot Interaction

Goal-directed human reaching often involves multi-component strategy with sub-movements. In general, the initial sub-movement is fast and less precise to bring the limb’s endpoint in the vicinity of the target as soon as possible. The final sub-movement then corrects the error accumulated during the previous sub-movement in order to reach the target. We investigate properties of a temporary target of the initial sub-movement. We hypothesise that the peak spatial dispersion of movement trajectories in the axis perpendicular to the movement is in front of the final reaching target, and that it indicates the temporary target of the initial sub-movement. The reasoning is that the dispersion accumulates, due to signal-dependent noise during the initial sub-movement, until the final corrective sub-movement is initiated, which then reduces the dispersion to successfully reach the actual target. We also hypothesise that the reaching movement distance and size of the actual target affect the properties of the temporary target of the initial sub-movement. The increased reaching movement distance increases the magnitude of peak dispersion and moves its location away from the actual target. On the other hand, the increased target size increases the magnitude of peak dispersion and moves its location closer to the actual target., Human-Robot Interaction

This paper introduces a novel control framework for an arm exoskeleton that takes into account force of the human arm. In contrast to the conventional exoskeleton controllers where the assistance is provided without considering the human arm biomechanical force manipulability properties, we propose a control approach based on the arm muscular manipulability. The proposed control framework essentially reshapes the anisotropic force manipulability into the endpoint force manipulability that is invariant with respect to the direction in the entire workspace of the arm. This allows users of the exoskeleton to perform tasks effectively in the whole range of the workspace, even in areas that are normally unsuitable due to the low force manipulability of the human arm. We evaluated the proposed control framework with real robot experiments where subjects wearing an arm exoskeleton were asked to move a weight between several locations. The results show that the proposed control framework does not affect the normal movement behavior of the users while effectively reduces user effort in the area of low manipulability. Particularly, the proposed approach augments the human arm force manipulability to execute tasks equally well in the entire workspace of the arm., Human-Robot Interaction

In this paper, we propose a method for selective monitoring and management of human muscle fatigue in human-robot co-manipulation scenarios. The proposed approach uses a machine learning technique to learn the complex relationship between individual human muscle forces, arm configuration and arm endpoint force that are provided by a sophisticated offline musculoskeletal model. The estimated muscle forces are used in the fatigue model to estimate the individual muscle fatigue levels online. Two fatigue management protocols are proposed that enable the robot to handle and reduce the human fatigue by altering the configuration of task execution. The first protocol uses optimisation technique to find the optimal position for task execution, where the fatigue-related endurance time can be maximised. The second protocol divides the arm muscles into groups and then alters the direction of endpoint force so that the fatigued muscle group can relax and the relaxed muscle group becomes active. The proposed method has a potential to enable the robot to facilitate safer and more ergonomic working conditions for the human coworker. The main advantage of this approach is that it can operate online, and that all the measurements can be performed by the robot sensory system, which can significantly increase the applicability in real world scenarios. To validate the proposed method, we performed multiple experiments with two collaborative tasks (polishing and drilling) under different conditions., Accepted Author Manuscript, Human-Robot Interaction

The deployment of industrial robotic cells based on lean manufacturing principles enables the development of fast-reconfigurable assembly lines in which human and robotic agents collaborate to achieve a shared task. To ensure the effective coordination of the shared effort, each task must be decomposed into a sequence of atomic actions that can be assigned either to a single agent or to the combination of more agents, according to a defined metric. While task allocation is a general problem and has been discussed intensively in other fields, less effort has been devoted in industrial scenarios, involving mixed human–robot teams and in particular, to the factors that should be considered in allocating tasks among a heterogeneous set of agents in collaborative manufacturing scenarios. In this letter, we investigate the agent characteristics that should be considered in the task allocation problem of fast-reconfigurable systems in industrial assembly processes. First, we introduce a set of indices, namely task complexity, agent dexterity, and agent effort, to evaluate agent performance with respect to a task. Second, we propose an offline allocation algorithm that combines the performance indices to assign optimally the task to the team agents. Finally, we validate the framework in a proof-of-concept collaborative assembly of a metallic structure. The results show that the workload is shared through the agents according to their particular physical capabilities and skill levels. A subjective analysis of the proposed collaborative framework on 12 healthy participants also validated the intuitiveness-of-use and improved performance., Accepted Author Manuscript, Human-Robot Interaction

Goal-directed human reaching often involves multi-component strategy with sub-movements. In general, the initial sub-movement is fast and less precise to bring the limb’s endpoint in the vicinity of the target as soon as possible. The final sub-movement then corrects the error accumulated during the previous sub-movement in order to reach the target. We investigate properties of a temporary target of the initial sub-movement. We hypothesise that the peak spatial dispersion of movement trajectories in the axis perpendicular to the movement is in front of the final reaching target, and that it indicates the temporary target of the initial sub-movement. The reasoning is that the dispersion accumulates, due to signal-dependent noise during the initial sub-movement, until the final corrective sub-movement is initiated, which then reduces the dispersion to successfully reach the actual target. We also hypothesise that the reaching movement distance and size of the actual target affect the properties of the temporary target of the initial sub-movement. The increased reaching movement distance increases the magnitude of peak dispersion and moves its location away from the actual target. On the other hand, the increased target size increases the magnitude of peak dispersion and moves its location closer to the actual target., Human-Robot Interaction

This paper introduces a novel control framework for an arm exoskeleton that takes into account force of the human arm. In contrast to the conventional exoskeleton controllers where the assistance is provided without considering the human arm biomechanical force manipulability properties, we propose a control approach based on the arm muscular manipulability. The proposed control framework essentially reshapes the anisotropic force manipulability into the endpoint force manipulability that is invariant with respect to the direction in the entire workspace of the arm. This allows users of the exoskeleton to perform tasks effectively in the whole range of the workspace, even in areas that are normally unsuitable due to the low force manipulability of the human arm. We evaluated the proposed control framework with real robot experiments where subjects wearing an arm exoskeleton were asked to move a weight between several locations. The results show that the proposed control framework does not affect the normal movement behavior of the users while effectively reduces user effort in the area of low manipulability. Particularly, the proposed approach augments the human arm force manipulability to execute tasks equally well in the entire workspace of the arm., Human-Robot Interaction

In this paper, we propose a method for selective monitoring and management of human muscle fatigue in human-robot co-manipulation scenarios. The proposed approach uses a machine learning technique to learn the complex relationship between individual human muscle forces, arm configuration and arm endpoint force that are provided by a sophisticated offline musculoskeletal model. The estimated muscle forces are used in the fatigue model to estimate the individual muscle fatigue levels online. Two fatigue management protocols are proposed that enable the robot to handle and reduce the human fatigue by altering the configuration of task execution. The first protocol uses optimisation technique to find the optimal position for task execution, where the fatigue-related endurance time can be maximised. The second protocol divides the arm muscles into groups and then alters the direction of endpoint force so that the fatigued muscle group can relax and the relaxed muscle group becomes active. The proposed method has a potential to enable the robot to facilitate safer and more ergonomic working conditions for the human coworker. The main advantage of this approach is that it can operate online, and that all the measurements can be performed by the robot sensory system, which can significantly increase the applicability in real world scenarios. To validate the proposed method, we performed multiple experiments with two collaborative tasks (polishing and drilling) under different conditions., Accepted Author Manuscript, Human-Robot Interaction