Search

This study addresses the challenges of human-robot interactions in real-time environments with adaptive field-programmable gate array (FPGA)-based accelerators. Predicting human posture in indoor environments in confined areas is a significant challenge for service robots. The proposed approach works on two levels: the estimation of human location and the robot's intention to serve based on the human's location at static and adaptive positions. This paper presents three methodologies to address these challenges: binary classification to analyze static and adaptive postures for human localization in indoor environments using the sensor fusion method, adaptive Simultaneous Localization and Mapping (SLAM) for the robot to deliver the task, and human-robot implicit communication. VLSI hardware schemes are developed for the proposed method. Initially, the control unit processes real-time sensor data through PIR sensors and multiple ultrasonic sensors to analyze the human posture. Subsequently, static and adaptive human posture data are communicated to the robot via Wi-Fi. Finally, the robot performs services for humans using an adaptive SLAM-based triangulation navigation method. The experimental validation was conducted in a hospital environment. The proposed algorithms were coded in Verilog HDL, simulated, and synthesized using VIVADO 2017.3. A Zed-board-based FPGA Xilinx board was used for experimental validation.

Human-robot collaboration will play an important role in the fourth industrial revolution in applications related to hostile environments, mining, industry, forestry, education, natural disaster and defense. Effective collaboration requires robots to understand human intentions and tasks, which involves advanced user profiling. Voice-based communication, rich in complex information, is key to this. Beamforming, a technology that enhances speech signals, can help robots extract semantic, emotional, or health-related information from speech. This paper describes the implementation of a system that provides substantially improved signal-to-noise ratio (SNR) and speech recognition accuracy to a moving robotic platform for use in human-robot interaction (HRI) applications in static and dynamic contexts. This study focuses on training deep learning-based beamformers using acoustic model-based multi-style training with measured room impulse responses (RIRs). The results show that this approach outperforms training with simulated RIRs or matched measured RIRs, especially in dynamic conditions involving robot motion. The findings suggest that training with a broad range of measured RIRs is sufficient for effective HRI in various environments, making additional data recording or augmentation unnecessary. This research demonstrates that deep learning-based beamforming can significantly improve HRI performance, particularly in challenging acoustic environments, surpassing traditional beamforming methods.

This paper presents the design of a strawberry fruit head gripper unit, together with the concept of a control system for the operation of its mechanisms and vision system. The developed design consists of three specialised mechanisms: positioning, grasping, and cutting off of the fruit. A Finite Element Method (FEM) model was developed for the described design. Next, calculations were carried out, based on which the construction materials were selected. The key performance parameters of the functional model, built on the basis of the developed design concept, were verified under laboratory conditions. In tests carried out on the possible hematoma caused by exceeding the breaking stress induced by the pressure of the encompassing jaws on the fruit, it was found that none of the fruit tested suffered mechanical damage as a result of the sensor triggering force, and the average length of the trimmed stalk was approximately 14 mm. The designed head gripper, together with the proposed automation system, will contribute to improving harvesting precision, and this will favour a reduction in the quantitative and qualitative losses of the harvested crop. The experimental tests conducted under harvesting conditions showed a high efficiency of 95% in identifying ripe fruit, and the harvesting efficiency of the robotic arm was 90%.

This paper presents the results of an experiment that was designed to explore whether users assigned an ethnic identity to the Misty II robot based on the robot's voice accent, place of origin, and given name. To explore this topic a 2 × 3 within subject study was run which consisted of a humanoid robot speaking with a male or female gendered voice and using three different voice accents (Chinese, American, Mexican). Using participants who identified as American, the results indicated that users were able to identify the gender and ethnic identity of the Misty II robot with a high degree of accuracy based on a minimum set of social cues. However, the version of Misty II presenting with an American ethnicity was more accurately identified than a robot presenting with cues signaling a Mexican or Chinese ethnicity. Implications of the results for the design of human-robot interfaces are discussed.

Brain-computer interface (BCI) provides direct communication and control between the human brain and physical devices. It is achieved by converting EEG signals into control commands. Such interfaces have significantly improved the lives of disabled individuals suffering from neurological disorders-such as stroke, amyotrophic lateral sclerosis (ALS), and spinal cord injury-by extending their movement range and thereby promoting self-independence. Brain-controlled mobile robots, however, often face challenges in safety and control performance due to the inherent limitations of BCIs. This paper proposes a shared control scheme for brain-controlled mobile robots by utilizing fuzzy logic to enhance safety, control performance, and robustness. The proposed scheme is developed by combining a self-learning neuro-fuzzy (SLNF) controller with an obstacle avoidance controller (OAC). The SLNF controller robustly tracks the user's intentions, and the OAC ensures the safety of the mobile robot following the BCI commands. Furthermore, SLNF is a model-free controller that can learn as well as update its parameters online, diminishing the effect of disturbances. The experimental results prove the efficacy and robustness of the proposed SLNF controller including a higher task completion rate of 94.29% (compared to 79.29%, and 92.86% for Direct BCI and Fuzzy-PID, respectively), a shorter average task completion time of 85.31 s (compared to 92.01 s and 86.16 s for Direct BCI and Fuzzy-PID, respectively), and reduced settling time and overshoot.

Conventional patient monitoring methods require skin-to-skin contact, continuous observation, and long working shifts, causing physical and mental stress for medical professionals. Remote patient monitoring (RPM) assists healthcare workers in monitoring patients distantly using various wearable sensors, reducing stress and infection risk. RPM can be enabled by using the Digital Twins (DTs)-based Internet of Robotic Things (IoRT) that merges robotics with the Internet of Things (IoT) and creates a virtual twin (VT) that acquires sensor data from the physical twin (PT) during operation to reflect its behavior. However, manual navigation of PT causes cognitive fatigue for the operator, affecting trust dynamics, satisfaction, and task performance. Also, operating manual systems requires proper training and long-term experience. This research implements autonomous control in the DTs-based IoRT to remotely monitor patients with chronic or contagious diseases. This work extends our previous paper that required the user to manually operate the PT using its VT to collect patient data for medical inspection. The proposed decision-making algorithm enables the PT to autonomously navigate towards the patient's room, collect and transmit health data, and return to the base station while avoiding various obstacles. Rather than manually navigating, the medical personnel direct the PT to a specific target position using the Menu buttons. The medical staff can monitor the PT and the received sensor information in the pre-built virtual environment (VE). Based on the operator's preference, manual control of the PT is also achievable. The experimental outcomes and comparative analysis verify the efficiency of the proposed system.

For successful human-robot collaboration, it is crucial to establish and sustain quality interaction between humans and robots, making it essential to facilitate human-robot interaction (HRI) effectively. The evolution of robot intelligence now enables robots to take a proactive role in initiating and sustaining HRI, thereby allowing humans to concentrate more on their primary tasks. In this paper, we introduce a system known as the Robot-Facilitated Interaction System (RFIS), where mobile robots are employed to perform identification, tracking, re-identification, and gesture recognition in an integrated framework to ensure anytime readiness for HRI. We implemented the RFIS on an autonomous mobile robot used for transporting a patient, to demonstrate proactive, real-time, and user-friendly interaction with a caretaker involved in monitoring and nursing the patient. In the implementation, we focused on the efficient and robust integration of various interaction facilitation modules within a real-time HRI system that operates in an edge computing environment. Experimental results show that the RFIS, as a comprehensive system integrating caretaker recognition, tracking, re-identification, and gesture recognition, can provide an overall high quality of interaction in HRI facilitation with average accuracies exceeding 90% during real-time operations at 5 FPS.

In the global context, advancements in technology and science have rendered virtual, augmented, and mixed-reality technologies capable of transforming clinical care and medical environments by offering enhanced features and improved healthcare services. This paper aims to present a mixed reality-based system to control a robotic wheelchair for people with limited mobility. The test group comprised 11 healthy subjects (six male, five female, mean age 35.2 ± 11.7 years). A novel platform that integrates a smart wheelchair and an eye-tracking-enabled head-mounted display was proposed to reduce the cognitive requirements needed for wheelchair movement and control. The approach's effectiveness was demonstrated by evaluating our system in realistic scenarios. The demonstration of the proposed AR head-mounted display user interface for controlling a smart wheelchair and the results provided in this paper could highlight the potential of the HoloLens 2-based innovative solutions and bring focus to emerging research topics, such as remote control, cognitive rehabilitation, the implementation of patient autonomy with severe disabilities, and telemedicine.

Grasping and object manipulation have been considered key domains of Cyber-Physical Systems (CPS) since the beginning of automation, as they are the most common interactions between systems, or a system and its environment. As the demand for automation is spreading to increasingly complex fields of industry, smart tools with sensors and internal decision-making become necessities. CPS, such as robots and smart autonomous machinery, have been introduced in the meat industry in recent decades; however, the natural diversity of animals, potential anatomical disorders and soft, slippery animal tissues require the use of a wide range of sensors, software and intelligent tools. This paper presents the development of a smart robotic gripper for deployment in the meat industry. A comprehensive review of the available robotic grippers employed in the sector is presented along with the relevant recent research projects. Based on the identified needs, a new mechatronic design and early development process of the smart gripper is described. The integrated force sensing method based on strain measurement and magnetic encoders is described, including the adjacent laboratory and on-site tests. Furthermore, a combined slip detection system is presented, which relies on an optical flow-based image processing algorithm using the video feed of a built-in endoscopic camera. Basic user tests and application assessments are presented.

Wearable robots are emerging as a viable and effective solution for assisting and enabling people who suffer from balance and mobility disorders. Virtual prototyping is a powerful tool to design robots, preventing the costly iterative physical prototyping and testing. Design of wearable robots through modelling, however, often involves computationally expensive and error-prone multi-body simulations wrapped in an optimization framework to simulate human-robot-environment interactions. This paper proposes a framework to make the human-robot link segment system statically determinate, allowing for the closed-form inverse dynamics formulation of the link-segment model to be solved directly in order to simulate human-robot dynamic interactions. The paper also uses a technique developed by the authors to estimate the walking ground reactions from reference kinematic data, avoiding the need to measure them. The proposed framework is (a) computationally efficient and (b) transparent and easy to interpret, and (c) eliminates the need for optimization, detailed musculoskeletal modelling and measuring ground reaction forces for normal walking simulations. It is used to optimise the position of hip and ankle joints and the actuator torque-velocity requirements for a seven segments of a lower-limb wearable robot that is attached to the user at the shoes and pelvis. Gait measurements were carried out on six healthy subjects, and the data were used for design optimization and validation. The new technique promises to offer a significant advance in the way in which wearable robots can be designed.

Conventional passive ankle foot orthoses (AFOs) have not seen substantial advances or functional improvements for decades, failing to meet the demands of many stakeholders, especially the pediatric population with neurological disorders. Our objective is to develop the first comfortable and unobtrusive powered AFO for children with cerebral palsy (CP), the DE-AFO. CP is the most diagnosed neuromotor disorder in the pediatric population. The standard of care for ankle control dysfunction associated with CP, however, is an unmechanized, bulky, and uncomfortable L-shaped conventional AFO. These passive orthoses constrain the ankle's motion and often cause muscle disuse atrophy, skin damage, and adverse neural adaptations. While powered orthoses could enhance natural ankle motion, their reliance on bulky, noisy, and rigid actuators like DC motors limits their acceptability. Our innovation, the DE-AFO, emerged from insights gathered during customer discovery interviews with 185 stakeholders within the AFO ecosystem as part of the NSF I-Corps program. The DE-AFO is a biomimetic robot that employs artificial muscles made from an electro-active polymer called dielectric elastomers (DEs) to assist ankle movements in the sagittal planes. It incorporates a gait phase detection controller to synchronize the artificial muscles with natural gait cycles, mimicking the function of natural ankle muscles. This device is the first of its kind to utilize lightweight, compact, soft, and silent artificial muscles that contract longitudinally, addressing traditional actuated AFOs' limitations by enhancing the orthosis's natural feel, comfort, and acceptability. In this paper, we outline our design approach and describe the three main components of the DE-AFO: the artificial muscle technology, the finite state machine (the gait phase detection system), and its mechanical structure. To verify the feasibility of our design, we theoretically calculated if DE-AFO can provide the necessary ankle moment assistance for children with CP-aligning with moments observed in typically developing children. To this end, we calculated the ankle moment deficit in a child with CP when compared with the normative moment of seven typically developing children. Our results demonstrated that the DE-AFO can provide meaningful ankle moment assistance, providing up to 69% and 100% of the required assistive force during the pre-swing phase and swing period of gait, respectively.

Despite advancements in creating barrier-free environments, many buildings still have stairs, making accessibility a significant concern for wheelchair users, the majority of whom check for accessibility information before venturing out. This paper focuses on developing a transformable quadruped wheelchair to address the mobility challenges posed by stairs and steps for wheelchair users. The wheelchair, inspired by the Unitree B2 quadruped robot, combines wheels for flat surfaces and robotic legs for navigating stairs and is equipped with advanced sensors and force detectors to interact with its surroundings effectively. This research utilized reinforcement learning, specifically curriculum learning, to teach the wheelchair stair-climbing skills, with progressively increasing complexity in a simulated environment crafted in the Unity game engine. The experiments demonstrated high success rates in both stair ascent and descent, showcasing the wheelchair's potential in overcoming mobility barriers. However, the current model faces limitations in tackling various stair types, like spiral staircases, and requires further enhancements in safety and stability, particularly in the descending phase. The project illustrates a significant step towards enhancing mobility for wheelchair users, aiming to broaden their access to diverse environments. Continued improvements and testing are essential to ensure the wheelchair's adaptability and safety across different terrains and situations, underlining the ongoing commitment to technological innovation in aiding individuals with mobility impairments.

Interactions between mobile robots and human operators in common areas require a high level of safety, especially in terms of trajectory planning, obstacle avoidance and mutual cooperation. In this connection, the crossings of planned trajectories and their uncertainty based on model fluctuations, system noise and sensor noise play an outstanding role. This paper discusses the calculation of the expected areas of interactions during human-robot navigation with respect to fuzzy and noisy information. The expected crossing points of the possible trajectories are nonlinearly associated with the positions and orientations of the robots and humans. The nonlinear transformation of a noisy system input, such as the directions of the motion of humans and robots, to a system output, the expected area of intersection of their trajectories, is performed by two methods: statistical linearization and the sigma-point transformation. For both approaches, fuzzy approximations are presented and the inverse problem is discussed where the input distribution parameters are computed from the given output distribution parameters.

The traditional aviary decontamination process involves farmers applying pesticides to the aviary's ground. These agricultural defenses are easily dispersed in the air, making the farmers susceptible to chronic diseases related to recurrent exposure. Industry 5.0 raises new pillars of research and innovation in transitioning to more sustainable, human-centric, and resilient companies. Based on these concepts, this paper presents a new aviary decontamination process that uses IoT and a robotic platform coupled with ozonizer (O 3 ) and ultraviolet light (UVL). These clean technologies can successfully decontaminate poultry farms against pathogenic microorganisms, insects, and mites. Also, they can degrade toxic compounds used to control living organisms. This new decontamination process uses physicochemical information from the poultry litter through sensors installed in the environment, which allows accurate and safe disinfection. Different experimental tests were conducted to construct the system. First, tests related to measuring soil moisture, temperature, and pH were carried out, establishing the range of use and the confidence interval of the measurements. The robot's navigation uses a back-and-forth motion that parallels the aviary's longest side because it reduces the number of turns, reducing energy consumption. This task becomes more accessible because of the aviaries' standardized geometry. Furthermore, the prototype was tested in a real aviary to confirm the innovation, safety, and effectiveness of the proposal. Tests have shown that the UV + ozone combination is sufficient to disinfect this environment.

Haptic hands and grippers, designed to enable skillful object manipulation, are pivotal for high-precision interaction with environments. These technologies are particularly vital in fields such as minimally invasive surgery, where they enhance surgical accuracy and tactile feedback: in the development of advanced prosthetic limbs, offering users improved functionality and a more natural sense of touch, and within industrial automation and manufacturing, they contribute to more efficient, safe, and flexible production processes. This paper presents the development of a two-finger robotic hand that employs simple yet precise strategies to manipulate objects without damaging or dropping them. Our innovative approach fused force-sensitive resistor (FSR) sensors with the average current of servomotors to enhance both the speed and accuracy of grasping. Therefore, we aim to create a grasping mechanism that is more dexterous than grippers and less complex than robotic hands. To achieve this goal, we designed a two-finger robotic hand with two degrees of freedom on each finger; an FSR was integrated into each fingertip to enable object categorization and the detection of the initial contact. Subsequently, servomotor currents were monitored continuously to implement impedance control and maintain the grasp of objects in a wide range of stiffness. The proposed hand categorized objects' stiffness upon initial contact and exerted accurate force by fusing FSR and the motor currents. An experimental test was conducted using a Yale-CMU-Berkeley (YCB) object set consisted of a foam ball, an empty soda can, an apple, a glass cup, a plastic cup, and a small milk packet. The robotic hand successfully picked up these objects from a table and sat them down without inflicting any damage or dropping them midway. Our results represent a significant step forward in developing haptic robotic hands with advanced object perception and manipulation capabilities.

The aim of this paper is to investigate technological advancements made to a robotic tele-ultrasound system for musculoskeletal imaging, the MSK-TIM (Musculoskeletal Telerobotic Imaging Machine). The hardware was enhanced with a force feedback sensor and a new controller was introduced. Software improvements were developed which allowed the operator to access ultrasound functions such as focus, depth, gain, zoom, color, and power Doppler controls. The device was equipped with Wi-Fi network capability which allowed the master and slave stations to be positioned in different locations. A trial assessing the system to scan the wrist was conducted with twelve participants, for a total of twenty-four arms. Both the participants and radiologist reported their experience. The images obtained were determined to be of satisfactory quality for diagnosis. The system improvements resulted in a better user and patient experience for the radiologist and participants. Latency with the VPN configuration was similar to the WLAN in our experiments. This research explores several technologies in medical telerobotics and provides insight into how they should be used in future. This study provides evidence to support larger-scale trials of the MSK-TIM for musculoskeletal imaging.

In the field of aerospace, large and heavy cabin segments present a significant challenge in assembling space engines. The substantial inertial force of cabin segments' mass often leads to unexpected motion during docking, resulting in segment collisions, making it challenging to ensure the accuracy and quality of engine segment docking. While traditional manual docking leverages workers' expertise, the intensity of the labor and low productivity are impractical for real-world applications. Human-robot collaboration can effectively integrate the advantages of humans and robots. Parallel robots, known for their high precision and load-bearing capacity, are extensively used in precision assembly under heavy load conditions. Therefore, human-parallel-robot collaboration is an excellent solution for such problems. In this paper, a framework is proposed that is easy to realize in production, using human-parallel-robot collaboration technology for cabin segment docking. A fractional-order variable damping admittance control and an inverse dynamics robust controller are proposed to enhance the robot's compliance, responsiveness, and trajectory tracking accuracy during collaborative assembly. This allows operators to dynamically adjust the robot's motion in real-time, counterbalancing inertial forces and preventing collisions between segments. Segment docking assembly experiments are performed using the Stewart platform in this study. The results show that the proposed method allows the robot to swiftly respond to interaction forces, maintaining compliance and stable motion accuracy even under unknown interaction forces.

Digital surgery technologies, such as interventional robotics and sensor systems, not only improve patient care but also aid in the development and optimization of traditional invasive treatments and methods. Atrial Fibrillation (AF) is the most common cardiac arrhythmia with critical clinical relevance today. Delayed intervention can lead to heart failure, stroke, or sudden cardiac death. Although many advances have been made in the field of radiofrequency (RF) catheter ablation (CA), it can be further developed by incorporating sensor technology to improve its efficacy and safety. Automation can be utilized to shorten the duration of RF ablation, provided that the interactions between the tissue and the RF tools are well understood and adequately modeled. Further research is needed to develop the optimal catheter design. This paper describes the systematic methodology developed to support robot-assisted RF CA characterization measurements. The article describes the custom instruments developed for the experiments, particularly the contact force limiter, the measurement procedure, and the evaluation of the results, as enablers for new results. The aim was to establish an objective, repeatable, robust measurement method and adjacent procedure.

Children with autism spectrum disorder (ASD) have deficits that affect their social relationships, communication, and flexibility in reasoning. There are different types of treatment (pharmacological, educational, psychological, and rehabilitative). Currently, one way to address this problem is by using robotic systems to address the abilities that are altered in these children. The aim of this review will be to analyse the effectiveness of the incorporation of the different robotic systems currently existing in the treatment of children up to 10 years of age diagnosed with autism. A systematic review has been carried out in the PubMed, Scopus, Web of Science, and Dialnet databases, with the following descriptors: child, autism, and robot. The search yielded 578 papers, and nine were selected after the application of the PRISMA guideline. The quality of the studies was analysed with the PEDRo scale, and only those with a score between four and six were selected. From this study, the conclusion is that the use of robots, in general, improves children's behaviour in the short term, but longer-term experiences are necessary to achieve more conclusive results.

The Industry 5.0 paradigm has a human-centered vision of the industrial scenario and foresees a close collaboration between humans and robots. Industrial manufacturing environments must be easily adaptable to different task requirements, possibly taking into account the ergonomics and production line flexibility. Therefore, external sensing infrastructures such as cameras and motion capture systems may not be sufficient or suitable as they limit the shop floor reconfigurability and increase setup costs. In this paper, we present the technological advancements leading to the realization of ProxySKIN, a skin-like sensory system based on networks of distributed proximity sensors and tactile sensors. This technology is designed to cover large areas of the robot body and to provide a comprehensive perception of the surrounding space. ProxySKIN architecture is built on top of CySkin, a flexible artificial skin conceived to provide robots with the sense of touch, and arrays of Time-of-Flight (ToF) sensors. We provide a characterization of the arrays of proximity sensors and we motivate the design choices that lead to ProxySKIN, analyzing the effects of light interference on a ToF, due to the activity of other sensing devices. The obtained results show that a large number of proximity sensors can be embedded in our distributed sensing architecture and incorporated onto the body of a robotic platform, opening new scenarios for complex applications.

In recent years, social assistive robots have gained significant acceptance in healthcare settings, particularly for tasks such as patient care and monitoring. This paper offers a comprehensive overview of the expressive humanoid robot, Qhali, with a focus on its industrial design, essential components, and validation in a controlled environment. The industrial design phase encompasses research, ideation, design, manufacturing, and implementation. Subsequently, the mechatronic system is detailed, covering sensing, actuation, control, energy, and software interface. Qhali's capabilities include autonomous execution of routines for mental health promotion and psychological testing. The software platform enables therapist-directed interventions, allowing the robot to convey emotional gestures through joint and head movements and simulate various facial expressions for more engaging interactions. Finally, with the robot fully operational, an initial behavioral experiment was conducted to validate Qhali's capability to deliver telepsychological interventions. The findings from this preliminary study indicate that participants reported enhancements in their emotional well-being, along with positive outcomes in their perception of the psychological intervention conducted with the humanoid robot.

Tracking human operators working in the vicinity of collaborative robots can improve the design of safety architecture, ergonomics, and the execution of assembly tasks in a human-robot collaboration scenario. Three commercial spatial computation kits were used along with their Software Development Kits that provide various real-time functionalities to track human poses. The paper explored the possibility of combining the capabilities of different hardware systems and software frameworks that may lead to better performance and accuracy in detecting the human pose in collaborative robotic applications. This study assessed their performance in two different human poses at six depth levels, comparing the raw data and noise-reducing filtered data. In addition, a laser measurement device was employed as a ground truth indicator, together with the average Root Mean Square Error as an error metric. The obtained results were analysed and compared in terms of positional accuracy and repeatability, indicating the dependence of the sensors' performance on the tracking distance. A Kalman-based filter was applied to fuse the human skeleton data and then to reconstruct the operator's poses considering their performance in different distance zones. The results indicated that at a distance less than 3 m, Microsoft Azure Kinect demonstrated better tracking performance, followed by Intel RealSense D455 and Stereolabs ZED2, while at ranges higher than 3 m, ZED2 had superior tracking performance.

This paper presents a model for generating expressive robot motions based on human expressive movements. The proposed data-driven approach combines variational autoencoders and a generative adversarial network framework to extract the essential features of human expressive motion and generate expressive robot motion accordingly. The primary objective was to transfer the underlying expressive features from human to robot motion. The input to the model consists of the robot task defined by the robot's linear velocities and angular velocities and the expressive data defined by the movement of a human body part, represented by the acceleration and angular velocity. The experimental results show that the model can effectively recognize and transfer expressive cues to the robot, producing new movements that incorporate the expressive qualities derived from the human input. Furthermore, the generated motions exhibited variability with different human inputs, highlighting the ability of the model to produce diverse outputs.

This paper proposes a method for generating dynamic virtual fixtures with real-time 3D image feedback to facilitate human-robot collaboration in medical robotics. Seamless shared control in a dynamic environment, like that of a surgical field, remains challenging despite extensive research on collaborative control and planning. To address this problem, our method dynamically creates virtual fixtures to guide the manipulation of a trocar-placing robot arm using the force field generated by point cloud data from an RGB-D camera. Additionally, the "view scope" concept selectively determines the region for computational points, thereby reducing computational load. In a phantom experiment for robot-assisted port incision in minimally invasive thoracic surgery, our method demonstrates substantially improved accuracy for port placement, reducing error and completion time by 50% (p=1.06×10-2) and 35% (p=3.23×10-2), respectively. These results suggest that our proposed approach is promising in improving surgical human-robot collaboration.

Notable efforts have been devoted to the development of biomechanical models of the spine, so the development of a motion system to control the spine becomes expressively relevant. This paper presents a fuzzy controller to manipulate the movement of a 3D robotic mechanism of the lumbar spine, which is driven by tendons. The controller was implemented in Matlab/Simulink R2023a software, MathWorks (Brazil), considering mathematical modeling based on the Lagrangian methodology for simulating the behavior of the lumbar spine dynamic movement. The fuzzy controller was implemented to perform movements of two joints of the 3D robotic mechanism, which consists of five vertebrae grouped into two sets, G1 and G2. The mechanism's movements are carried out by four servomotors which are driven by readings from two sensors. For control, the linguistic variables of position, velocity and acceleration were used as controller inputs and the torque variables were used for the controller output. The experimental tests were carried out by running the fuzzy controller directly on the 3D physical model (external to the simulation environment) to represent flexion and extension movements analogous to human movements.

(1) Background: Social robot interaction design is crucial for determining user acceptance and experience. However, few studies have systematically discussed the current focus and future research directions of social robot interaction design from a bibliometric perspective. Therefore, we conducted this study in order to identify the latest research progress and evolution trajectory of research hotspots in social robot interaction design over the last decade. (2) Methods: We conducted a comprehensive review based on 2416 papers related to social robot interaction design obtained from the Web of Science (WOS) database. Our review utilized bibliometric techniques and integrated VOSviewer and CiteSpace to construct a knowledge map. (3) Conclusions: The current research hotspots of social robot interaction design mainly focus on #1 the study of human-robot relationships in social robots, #2 research on the emotional design of social robots, #3 research on social robots for children's psychotherapy, #4 research on companion robots for elderly rehabilitation, and #5 research on educational social robots. The reference co-citation analysis identifies the classic literature that forms the basis of the current research, which provides theoretical guidance and methods for the current research. Finally, we discuss several future research directions and challenges in this field.

Recent advances in the field of collaborative robotics aim to endow industrial robots with prediction and anticipation abilities. In many shared tasks, the robot's ability to accurately perceive and recognize the objects being manipulated by the human operator is crucial to make predictions about the operator's intentions. In this context, this paper proposes a novel learning-based framework to enable an assistive robot to recognize the object grasped by the human operator based on the pattern of the hand and finger joints. The framework combines the strengths of the commonly available software MediaPipe in detecting hand landmarks in an RGB image with a deep multi-class classifier that predicts the manipulated object from the extracted keypoints. This study focuses on the comparison between two deep architectures, a convolutional neural network and a transformer, in terms of prediction accuracy, precision, recall and F1-score. We test the performance of the recognition system on a new dataset collected with different users and in different sessions. The results demonstrate the effectiveness of the proposed methods, while providing valuable insights into the factors that limit the generalization ability of the models.

Microsurgical techniques have been widely utilized in various surgical specialties, such as ophthalmology, neurosurgery, and otolaryngology, which require intricate and precise surgical tool manipulation on a small scale. In microsurgery, operations on delicate vessels or tissues require high standards in surgeons' skills. This exceptionally high requirement in skills leads to a steep learning curve and lengthy training before the surgeons can perform microsurgical procedures with quality outcomes. The microsurgery robot (MSR), which can improve surgeons' operation skills through various functions, has received extensive research attention in the past three decades. There have been many review papers summarizing the research on MSR for specific surgical specialties. However, an in-depth review of the relevant technologies used in MSR systems is limited in the literature. This review details the technical challenges in microsurgery, and systematically summarizes the key technologies in MSR with a developmental perspective from the basic structural mechanism design, to the perception and human-machine interaction methods, and further to the ability in achieving a certain level of autonomy. By presenting and comparing the methods and technologies in this cutting-edge research, this paper aims to provide readers with a comprehensive understanding of the current state of MSR research and identify potential directions for future development in MSR.

In recent years, researchers have focused on analyzing humans' daily living activities to study various performance metrics that humans subconsciously optimize while performing a particular task. In order to recreate these motions in robotic structures based on the human model, researchers developed a framework for robot motion planning which is able to use various optimization methods to replicate similar motions demonstrated by humans. As part of this process, it will be necessary to record the motions data of the human body and the objects involved in order to provide all the essential information for motion planning. This paper aims to provide a dataset of human motion performing activities of daily living that consists of detailed and accurate human whole-body motion data collected using a Vicon motion capture system. The data have been utilized to generate a subject-specific full-body model within OpenSim. Additionally, it facilitated the computation of joint angles within the OpenSim framework, which can subsequently be applied to the subject-specific robotic model developed MATLAB framework. The dataset comprises nine daily living activities and eight Range of Motion activities performed by ten healthy participants and with two repetitions of each variation of one action, resulting in 340 demonstrations of all the actions. A whole-body human motion database is made available to the public at the Center for Assistive, Rehabilitation, and Robotics Technologies (CARRT)-Motion Capture Data for Robotic Human Upper Body Model, which consists of raw motion data in .c3d format, motion data in .trc format for the OpenSim model, as well as post-processed motion data for the MATLAB-based model.

Due to the advantages of ease of use, less motion disturbance, and low cost, wearable systems have been widely used in the human-machine interaction (HRI) field. However, HRI in complex clinical rehabilitation scenarios has further requirements for wearable sensor systems, which has aroused the interest of many researchers. However, the traditional wearable system has problems such as low integration, limited types of measurement data, and low accuracy, causing a gap with the actual needs of HRI. This paper will introduce the latest progress in the current wearable systems of HRI from four aspects. First of all, it introduces the breakthroughs of current research in system integration, which includes processing chips and flexible sensing modules to reduce the system's volume and increase battery life. After that, this paper reviews the latest progress of wearable systems in electrochemical measurement, which can extract single or multiple biomarkers from biological fluids such as sweat. In addition, the clinical application of non-invasive wearable systems is introduced, which solves the pain and discomfort problems caused by traditional clinical invasive measurement equipment. Finally, progress in the combination of current wearable systems and the latest machine-learning methods is shown, where higher accuracy and indirect acquisition of data that cannot be directly measured is achieved. From the evidence presented, we believe that the development trend of wearable systems in HRI is heading towards high integration, multi-electrochemical measurement data, and clinical and intelligent development.

In the context of collaborative robotics, handing over hand-held objects to a robot is a safety-critical task. Therefore, a robust distinction between human hands and presented objects in image data is essential to avoid contact with robotic grippers. To be able to develop machine learning methods for solving this problem, we created the OHO (Object Hand-Over) dataset of tools and other everyday objects being held by human hands. Our dataset consists of color, depth, and thermal images with the addition of pose and shape information about the objects in a real-world scenario. Although the focus of this paper is on instance segmentation, our dataset also enables training for different tasks such as 3D pose estimation or shape estimation of objects. For the instance segmentation task, we present a pipeline for automated label generation in point clouds, as well as image data. Through baseline experiments, we show that these labels are suitable for training an instance segmentation to distinguish hands from objects on a per-pixel basis. Moreover, we present qualitative results for applying our trained model in a real-world application.

One of the most interesting characteristics of collaborative robots is their ability to be used in close cooperation scenarios. In industry, this facilitates the implementation of human-in-loop workflows. However, this feature can also be exploited in different fields, such as healthcare. In this paper, a rehabilitation framework for the upper limbs of neurological patients is presented, consisting of a collaborative robot that helps users perform three-dimensional trajectories. Such a practice is aimed at improving the coordination of patients by guiding their motions in a preferred direction. We present the mechatronic setup, along with a preliminary experimental set of results from 19 volunteers (patients and control subjects) who provided positive feedback on the training experience (52% of the subjects would return and 44% enjoyed performing the exercise). Patients were able to execute the exercise, with a maximum deviation from the trajectory of 16 mm. The muscular effort required was limited, with average maximum forces recorded at around 50 N.

As the global population rapidly ages with longer life expectancy and declining birth rates, the need for healthcare services and caregivers for older adults is increasing. Current research envisions addressing this shortage by introducing domestic service robots to assist with daily activities. The successful integration of robots as domestic service providers in our lives requires them to possess efficient manipulation capabilities, provide effective physical assistance, and have adaptive control frameworks that enable them to develop social understanding during human-robot interaction. In this context, human factors, especially quantifiable ones, represent a necessary component. The objective of this paper is to conduct an unbiased review encompassing the studies on human factors studied in research involving physical interactions and strong manipulation capabilities. We identified the prevalent human factors in physical human-robot interaction (pHRI), noted the factors typically addressed together, and determined the frequently utilized assessment approaches. Additionally, we gathered and categorized proposed quantification approaches based on the measurable data for each human factor. We also formed a map of the common contexts and applications addressed in pHRI for a comprehensive understanding and easier navigation of the field. We found out that most of the studies in direct pHRI (when there is direct physical contact) focus on social behaviors with belief being the most commonly addressed human factor type. Task collaboration is moderately investigated, while physical assistance is rarely studied. In contrast, indirect pHRI studies (when the physical contact is mediated via a third item) often involve industrial settings, with physical ergonomics being the most frequently investigated human factor. More research is needed on the human factors in direct and indirect physical assistance applications, including studies that combine physical social behaviors with physical assistance tasks. We also found that while the predominant approach in most studies involves the use of questionnaires as the main method of quantification, there is a recent trend that seeks to address the quantification approaches based on measurable data.

Bone drilling is a common procedure in orthopedic surgery and is frequently attempted using robot-assisted techniques. However, drilling on rigid, slippery, and steep cortical surfaces, which are frequently encountered in robot-assisted operations due to limited workspace, can lead to tool path deviation. Path deviation can have significant impacts on positioning accuracy, hole quality, and surgical safety. In this paper, we consider the deformation of the tool and the robot as the main factors contributing to path deviation. To address this issue, we establish a multi-stage mechanistic model of tool-bone interaction and develop a stiffness model of the robot. Additionally, a joint stiffness identification method is proposed. To compensate for path deviation in robot-assisted bone drilling, a force-position hybrid compensation control framework is proposed based on the derived models and a compensation strategy of path prediction. Our experimental results validate the effectiveness of the proposed compensation control method. Specifically, the path deviation is significantly reduced by 56.6%, the force of the tool is reduced by 38.5%, and the hole quality is substantially improved. The proposed compensation control method based on a multi-stage mechanistic model and joint stiffness identification method can significantly improve the accuracy and safety of robot-assisted bone drilling.

Microneedle puncture is a standard minimally invasive treatment and surgical method, which is widely used in extracting blood, tissues, and their secretions for pathological examination, needle-puncture-directed drug therapy, local anaesthesia, microwave ablation needle therapy, radiotherapy, and other procedures. The use of robots for microneedle puncture has become a worldwide research hotspot, and medical imaging navigation technology plays an essential role in preoperative robotic puncture path planning, intraoperative assisted puncture, and surgical efficacy detection. This paper introduces medical imaging technology and minimally invasive puncture robots, reviews the current status of research on the application of medical imaging navigation technology in minimally invasive puncture robots, and points out its future development trends and challenges.

In the pursuit of optimizing the efficiency, flexibility, and adaptability of agricultural practices, human-robot interaction (HRI) has emerged in agriculture. Enabled by the ongoing advancement in information and communication technologies, this approach aspires to overcome the challenges originating from the inherent complex agricultural environments. Τhis paper systematically reviews the scholarly literature to capture the current progress and trends in this promising field as well as identify future research directions. It can be inferred that there is a growing interest in this field, which relies on combining perspectives from several disciplines to obtain a holistic understanding. The subject of the selected papers is mainly synergistic target detection, while simulation was the main methodology. Furthermore, melons, grapes, and strawberries were the crops with the highest interest for HRI applications. Finally, collaboration and cooperation were the most preferred interaction modes, with various levels of automation being examined. On all occasions, the synergy of humans and robots demonstrated the best results in terms of system performance, physical workload of workers, and time needed to execute the performed tasks. However, despite the associated progress, there is still a long way to go towards establishing viable, functional, and safe human-robot interactive systems.

Lower limb exoskeleton robots have shown significant research value due to their capabilities of providing assistance to wearers and improving physical motion functions. As a type of robotic technology, wearable robots are directly in contact with the wearer's limbs during operation, necessitating a high level of human-robot collaboration to ensure safety and efficacy. Furthermore, gait prediction for the wearer, which helps to compensate for sensor delays and provide references for controller design, is crucial for improving the the human-robot collaboration capability. For gait prediction, the plantar force intrinsically reflects crucial gait patterns regardless of individual differences. To be exact, the plantar force encompasses a doubled three-axis force, which varies over time concerning the two feet, which also reflects the gait patterns indistinctly. In this paper, we developed a transformer-based neural network (TFSformer) comprising convolution and variational mode decomposition (VMD) to predict bilateral hip and knee joint angles utilizing the plantar pressure. Given the distinct information contained in the temporal and the force-space dimensions of plantar pressure, the encoder uses 1D convolution to obtain the integrated features in the two dimensions. As for the decoder, it utilizes a multi-channel attention mechanism to simultaneously focus on both dimensions and a deep multi-channel attention structure to reduce the computational and memory consumption. Furthermore, VMD is applied to networks to better distinguish the trends and changes in data. The model is trained and tested on a self-constructed dataset that consists of data from 35 volunteers. The experimental results show that FTSformer reduces the mean absolute error (MAE) up to 10.83%, 15.04% and 8.05% and the mean squared error (MSE) by 20.40%, 29.90% and 12.60% compared to the CNN model, the transformer model and the CNN transformer model, respectively.

When the magnitude of a gaze is too large, human beings change the orientation of their head or body to assist their eyes in tracking targets because saccade alone is insufficient to keep a target at the center region of the retina. To make a robot gaze at targets rapidly and stably (as a human does), it is necessary to design a body-head-eye coordinated motion control strategy. A robot system equipped with eyes and a head is designed in this paper. Gaze point tracking problems are divided into two sub-problems: in situ gaze point tracking and approaching gaze point tracking. In the in situ gaze tracking state, the desired positions of the eye, head and body are calculated on the basis of minimizing resource consumption and maximizing stability. In the approaching gaze point tracking state, the robot is expected to approach the object at a zero angle. In the process of tracking, the three-dimensional (3D) coordinates of the object are obtained by the bionic eye and then converted to the head coordinate system and the mobile robot coordinate system. The desired positions of the head, eyes and body are obtained according to the object's 3D coordinates. Then, using sophisticated motor control methods, the head, eyes and body are controlled to the desired position. This method avoids the complex process of adjusting control parameters and does not require the design of complex control algorithms. Based on this strategy, in situ gaze point tracking and approaching gaze point tracking experiments are performed by the robot. The experimental results show that body-head-eye coordination gaze point tracking based on the 3D coordinates of an object is feasible. This paper provides a new method that differs from the traditional two-dimensional image-based method for robotic body-head-eye gaze point tracking.

Despite the substantial progress achieved in the development and integration of augmented reality (AR) in surgical robotic and autonomous systems (RAS), the center of focus in most devices remains on improving end-effector dexterity and precision, as well as improved access to minimally invasive surgeries. This paper aims to provide a systematic review of different types of state-of-the-art surgical robotic platforms while identifying areas for technological improvement. We associate specific control features, such as haptic feedback, sensory stimuli, and human-robot collaboration, with AR technology to perform complex surgical interventions for increased user perception of the augmented world. Current researchers in the field have, for long, faced innumerable issues with low accuracy in tool placement around complex trajectories, pose estimation, and difficulty in depth perception during two-dimensional medical imaging. A number of robots described in this review, such as Novarad and SpineAssist, are analyzed in terms of their hardware features, computer vision systems (such as deep learning algorithms), and the clinical relevance of the literature. We attempt to outline the shortcomings in current optimization algorithms for surgical robots (such as YOLO and LTSM) whilst providing mitigating solutions to internal tool-to-organ collision detection and image reconstruction. The accuracy of results in robot end-effector collisions and reduced occlusion remain promising within the scope of our research, validating the propositions made for the surgical clearance of ever-expanding AR technology in the future.

This paper proposes a method for accurate 3D posture sensing of the soft actuators, which could be applied to the closed-loop control of soft robots. To achieve this, the method employs an array of miniaturized sponge resistive materials along the soft actuator, which uses long short-term memory (LSTM) neural networks to solve the end-to-end 3D posture for the soft actuators. The method takes into account the hysteresis of the soft robot and non-linear sensing signals from the flexible bending sensors. The proposed approach uses a flexible bending sensor made from a thin layer of conductive sponge material designed for posture sensing. The LSTM network is used to model the posture of the soft actuator. The effectiveness of the method has been demonstrated on a finger-size 3 degree of freedom (DOF) pneumatic bellow-shaped actuator, with nine flexible sponge resistive sensors placed on the soft actuator's outer surface. The sensor-characterizing results show that the maximum bending torque of the sensor installed on the actuator is 4.7 Nm, which has an insignificant impact on the actuator motion based on the working space test of the actuator. Moreover, the sensors exhibit a relatively low error rate in predicting the actuator tip position, with error percentages of 0.37%, 2.38%, and 1.58% along the x-, y-, and z-axes, respectively. This work is expected to contribute to the advancement of soft robot dynamic posture perception by using thin sponge sensors and LSTM or other machine learning methods for control.

Nowadays, cyber-physical systems (CPSs) are composed of more and more agents and the demand for designers to develop ever larger multi-agent systems is a fact. When the number of agents increases, several challenges related to control or communication problems arise due to the lack of scalability of existing solutions. It is important to develop tools that allow control strategies evaluation of large-scale systems. In this paper, it is considered that a CPS is a heterogeneous robot multi-agent system that cooperatively performs a formation task through a wireless network. The goal of this research is to evaluate the system's performance when the number of agents increases. To this end, two different frameworks developed with the open-source tools Gazebo and Webots are used. These frameworks enable combining both real and virtual agents in a realistic scenario allowing scalability experiences. They also reduce the costs required when a significant number of robots operate in a real environment, as experiences can be conducted with a few real robots and a higher number of virtual robots by mimicking the real ones. Currently, the frameworks include several types of robots, such as the aerial robot Crazyflie 2.1 and differential mobile robots Khepera IV used in this work. To illustrate the usage and performance of the frameworks, an event-based control strategy for rigid formations varying the number of agents is analyzed. The agents should achieve a formation defined by a set of desired Euclidean distances to their neighbors. To compare the scalability of the system in the two different tools, the following metrics have been used: formation error, CPU usage percentage, and the ratio between the real time and the simulation time. The results show the feasibility of using Robot Operating System (ROS) 2 in distributed architectures for multi-agent systems in experiences with real and virtual robots regardless of the number of agents and their nature. However, the two tools under study present different behaviors when the number of virtual agents grows in some of the parameters, and such discrepancies are analyzed.

Safety plays a key role in human-robot interactions in collaborative robot (cobot) applications. This paper provides a general procedure to guarantee safe workstations allowing human operations, robot contributions, the dynamical environment, and time-variant objects in a set of collaborative robotic tasks. The proposed methodology focuses on the contribution and the mapping of reference frames. Multiple reference frame representation agents are defined at the same time by considering egocentric, allocentric, and route-centric perspectives. The agents are processed to provide a minimal and effective assessment of the ongoing human-robot interactions. The proposed formulation is based on the generalization and proper synthesis of multiple cooperating reference frame agents at the same time. Accordingly, it is possible to achieve a real-time assessment of the safety-related implications through the implementation and fast calculation of proper safety-related quantitative indices. This allows us to define and promptly regulate the controlling parameters of the involved cobot without velocity limitations that are recognized as the main disadvantage. A set of experiments has been realized and investigated to demonstrate the feasibility and effectiveness of the research by using a seven-DOF anthropomorphic arm in combination with a psychometric test. The acquired results agree with the current literature in terms of the kinematic, position, and velocity aspects; use measurement methods based on tests provided to the operator; and introduce novel features of work cell arranging, including the use of virtual instrumentation. Finally, the associated analytical-topological treatments have enabled the development of a safe and comfortable measure to the human-robot relation with satisfactory experimental results compared to previous research. Nevertheless, the robot posture, human perception, and learning technologies would have to apply research from multidisciplinary fields such as psychology, gesture, communication, and social sciences in order to be prepared for positioning in real-world applications that offer new challenges for cobot applications.

MultiCal is an affordable, high-precision measuring device designed for the on-site calibration of industrial robots. Its design features a long measuring rod with a spherical tip that is attached to the robot. By restricting the rod's tip to multiple fixed points under different rod orientations, the relative positions of these points are accurately measured beforehand. A common issue with MultiCal is the gravitational deformation of the long measuring rod, which introduces measurement errors into the system. This problem becomes especially serious when calibrating large robots, as the length of the measuring rod needs to be increased to enable the robot to move in a sufficient space. To address this issue, we propose two improvements in this paper. Firstly, we suggest the use of a new design of the measuring rod that is lightweight yet has high rigidity. Secondly, we propose a deformation compensation algorithm. Experimental results have shown that the new measuring rod improves calibration accuracy from 20% to 39%, while using the deformation compensation algorithm, the accuracy increases from 6% to 16%. In the best configuration, the calibration accuracy is similar to that of a measuring arm with a laser scanner, producing an average positioning error of 0.274 mm and a maximum positioning error of 0.838 mm. The improved design is cost-affordable, robust, and has sufficient accuracy, making MultiCal a more reliable tool for industrial robot calibration.

This paper presents a novel method for online tool recognition in manual assembly processes. The goal was to develop and implement a method that can be integrated with existing Human Action Recognition (HAR) methods in collaborative tasks. We examined the state-of-the-art for progress detection in manual assembly via HAR-based methods, as well as visual tool-recognition approaches. A novel online tool-recognition pipeline for handheld tools is introduced, utilizing a two-stage approach. First, a Region Of Interest (ROI) was extracted by determining the wrist position using skeletal data. Afterward, this ROI was cropped, and the tool located within this ROI was classified. This pipeline enabled several algorithms for object recognition and demonstrated the generalizability of our approach. An extensive training dataset for tool-recognition purposes is presented, which was evaluated with two image-classification approaches. An offline pipeline evaluation was performed with twelve tool classes. Additionally, various online tests were conducted covering different aspects of this vision application, such as two assembly scenarios, unknown instances of known classes, as well as challenging backgrounds. The introduced pipeline was competitive with other approaches regarding prediction accuracy, robustness, diversity, extendability/flexibility, and online capability.

The successful implementation of Human-Robot Collaboration (HRC) has become a prominent feature of smart manufacturing environments. Key industrial requirements, such as flexibility, efficiency, collaboration, consistency, and sustainability, present pressing HRC needs in the manufacturing sector. This paper provides a systemic review and an in-depth discussion of the key technologies currently being employed in smart manufacturing with HRC systems. The work presented here focuses on the design of HRC systems, with particular attention given to the various levels of Human-Robot Interaction (HRI) observed in the industry. The paper also examines the key technologies being implemented in smart manufacturing, including Artificial Intelligence (AI), Collaborative Robots (Cobots), Augmented Reality (AR), and Digital Twin (DT), and discusses their applications in HRC systems. The benefits and practical instances of deploying these technologies are showcased, emphasizing the substantial prospects for growth and improvement in sectors such as automotive and food. However, the paper also addresses the limitations of HRC utilization and implementation and provides some insights into how the design of these systems should be approached in future work and research. Overall, this paper provides new insights into the current state of HRC in smart manufacturing and serves as a useful resource for those interested in the ongoing development of HRC systems in the industry.

Palpation is a simple but effective method to distinguish tumors from healthy tissues. The development of miniaturized tactile sensors embedded on endoscopic or robotic devices is key to achieving precise palpation diagnosis and subsequent timely treatment. This paper reports on the fabrication and characterization of a novel tactile sensor with mechanical flexibility and optical transparency that can be easily mounted on soft surgical endoscopes and robotics. By utilizing the pneumatic sensing mechanism, the sensor offers a high sensitivity of 1.25 mbar and negligible hysteresis, enabling the detection of phantom tissues with different stiffnesses ranging from 0 to 2.5 MPa. Our configuration, combining pneumatic sensing and hydraulic actuating, also eliminates electrical wiring from the functional elements located at the robot end-effector, thereby enhancing the system safety. The optical transparency path in the sensors together with its mechanical sensing capability open interesting possibilities in the early detection of solid tumor as well as in the development of all-in-one soft surgical robots that can perform visual/mechanical feedback and optical therapy.

With the advancement of robotics, the field of path planning is currently experiencing a period of prosperity. Researchers strive to address this nonlinear problem and have achieved remarkable results through the implementation of the Deep Reinforcement Learning (DRL) algorithm DQN (Deep Q-Network). However, persistent challenges remain, including the curse of dimensionality, difficulties of model convergence and sparsity in rewards. To tackle these problems, this paper proposes an enhanced DDQN (Double DQN) path planning approach, in which the information after dimensionality reduction is fed into a two-branch network that incorporates expert knowledge and an optimized reward function to guide the training process. The data generated during the training phase are initially discretized into corresponding low-dimensional spaces. An "expert experience" module is introduced to facilitate the model's early-stage training acceleration in the Epsilon-Greedy algorithm. To tackle navigation and obstacle avoidance separately, a dual-branch network structure is presented. We further optimize the reward function enabling intelligent agents to receive prompt feedback from the environment after performing each action. Experiments conducted in both virtual and real-world environments have demonstrated that the enhanced algorithm can accelerate model convergence, improve training stability and generate a smooth, shorter and collision-free path.

This paper proposes a learning control framework for the robotic manipulator's dynamic tracking task demanding fixed-time convergence and constrained output. In contrast with model-dependent methods, the proposed solution deals with unknown manipulator dynamics and external disturbances by virtue of a recurrent neural network (RNN)-based online approximator. First, a time-varying tangent-type barrier Lyapunov function (BLF) is introduced to construct a fixed-time virtual controller. Then, the RNN approximator is embedded in the closed-loop system to compensate for the lumped unknown term in the feedforward loop. Finally, we devise a novel fixed-time, output-constrained neural learning controller by integrating the BLF and RNN approximator into the main framework of the dynamic surface control (DSC). The proposed scheme not only guarantees the tracking errors converge to the small neighborhoods about the origin in a fixed time, but also preserves the actual trajectories always within the prescribed ranges and thus improves the tracking accuracy. Experiment results illustrate the excellent tracking performance and verify the effectiveness of the online RNN estimate for unknown dynamics and external disturbances.

The inspection and maintenance of transmission systems are necessary for their proper functioning. In this way, among the line's critical points are the insulator chains, which are responsible for providing insulation between conductors and structures. The accumulation of pollutants on the insulator surface can cause failures in the power system, leading to power supply interruptions. Currently, the cleaning of insulator chains is performed manually by operators who climb towers and use cloths, high-pressure washers, or even helicopters. The use of robots and drones is also under study, presenting challenges to be overcome. This paper presents the development of a drone-robot for cleaning insulator chains. The drone-robot was designed to identify insulators by camera and perform cleaning through a robotic module. This module is attached to the drone and carries a battery-powered portable washer, a reservoir for demineralized water, a depth camera, and an electronic control system. This paper includes a literature review on the state of the art related to strategies used for cleaning insulator chains. Based on this review, the justification for the construction of the proposed system is presented. The methodology used in the development of the drone-robot is then described. The system was validated in a controlled environment and in field experimental tests, with the ensuing discussions and conclusions formulated, along with suggestions for future work.

This comprehensive review aims to explore the applications of indocyanine green (ICG) in robot-assisted urological surgery through a detailed examination of fluorescence-guided techniques. An extensive literature search was conducted in PubMed/MEDLINE, EMBASE and Scopus, using keywords such as "indocyanine green," "ICG", "NIRF", "Near Infrared Fluorescence", "robot-assisted", and "urology". Additional suitable articles were collected by manually cross-referencing the bibliography of previously selected papers. The integration of the Firefly ® technology in the Da Vinci ® robotic system has opened new avenues for the advancement and exploration of different urological procedures. ICG is a fluorophore widely used in near-infrared fluorescence-guided techniques. The synergistic combination of intraoperative support, safety profiles and widespread availability comprises an additional asset that empowers ICG-guided robotic surgery. This overview of the current state of the art illustrates the potential advantages and broad applications of combining ICG-fluorescence guidance with robotic-assisted urological surgery.