Search

Continuous Human Activity Recognition (HAR) in arbitrary directions is investigated in this paper using a network of five spatially distributed pulsed Ultra‐Wideband radars. While activities performed continuously and in unconstrained trajectories provide a more realistic and natural scenario for HAR, the network of radar sensors is proposed to address the issue of unfavourable or occluded perspectives when using only a single sensor. Different techniques to combine the relevant information from the multiple radars in the network are investigated, focussing on signal level fusion directly applied on Range‐Time maps, and the selection of radar nodes based on location and velocity of the target derived from multilateration processing and tracking. Recurrent Neural Networks with and without bidirectionality are used to classify the activities based on the micro‐Doppler (μD) spectrograms obtained for sensor fusion techniques. To assess classification performances, novel evaluation metrics accounting for the continuous nature of the sequence of activities and inherent imbalances in the dataset are proposed and compared with existing metrics. It is shown that the conventional accuracy metric may not capture all the important aspects for continuous HAR, and the proposed metrics can be considered for a more comprehensive evaluation. [ABSTRACT FROM AUTHOR]

This article presents the results of a series of measurements of multistatic radar signatures of small UAVs at L‐ and X‐bands. The system employed was the multistatic multiband radar system, NeXtRAD, consisting of one monostatic transmitter‐receiver and two bistatic receivers. NeXtRAD is capable of recording simultaneous bistatic and monostatic data with baselines and two‐way bistatic range of the order of a few kilometres. The paper presents an empirical analysis with range‐time plots and micro‐Doppler signatures of UAVs and birds of opportunity recorded at several hundred metres of distance. A quantitative analysis of the overall signal‐to‐noise ratio is presented along with a comparison between the power of the signal scattered from the drone body and blades. A simple study with empirically obtained features and four supervised‐learning classifiers for binary drone versus non‐drone separation is also presented. The results are encouraging with classification accuracy consistently above 90% using very simple features and classification algorithms. [ABSTRACT FROM AUTHOR]

Although traditionally associated with defence and security domains, radar sensing has attracted significant interest in recent years in healthcare applications. These include the monitoring of vital signs such as respiration, heartbeat, and blood pressure, analysis of gait and mobility levels, classification of human activities to promptly detect critical events such as falls, as well as the evaluation of fitness and reactivity levels. The attractiveness of radar against alternative technologies such as wearable sensors or cameras lies in its contactless capabilities, whereby people do not need to wear, carry, or interact with any additional device, and plain images of people and private environments are not recorded. In this letter, we discuss some of the most recent achievements and outstanding research challenges related to radar applications in healthcare and present some results from our work at the University of Glasgow, including a dataset of radar signatures of human activities that are openly shared with the wider community. [ABSTRACT FROM AUTHOR]

This paper presents a radar‐based algorithm for autonomous estimation of drone intention. The algorithm is based on radar's kinematic measurements, providing fast and robust intention estimation for multiple targets. The core idea of the proposed algorithm is to build intention‐specific features for each intention in advance and use them in actual drone surveillance situations. To effectively depict the trajectory characteristics of various intentions, the trajectory frequency is computed on multiple phase planes through Monte Carlo Simulations. Finally, a naive Bayes classifier is applied to integrate the trajectory likelihood in different phases and ultimately compute the intention likelihood of all intentions concerned. Numerical simulations for the three candidate intentions of image acquisition, smuggling, and kamikaze attack demonstrated the performance of the presented method. The simulation results show that one can estimate the true intention of a specific drone by comparing the value of each intention likelihood. [ABSTRACT FROM AUTHOR]

This paper investigates the selection of different combinations of features at different multistatic radar nodes, depending on scenario parameters, such as aspect angle to the target and signal-to-noise ratio, and radar parameters, such as dwell time, polarization, and frequency band. Two sets of experimental data collected with the multistatic radar system NetRAD are analyzed for two separate problems, namely the classification of unarmed versus potentially armed multiple personnel, and the personnel recognition of individuals based on walking gait. The results show that the overall classification accuracy can be significantly improved by taking into account feature diversity at each radar node depending on the environmental parameters and target behavior, in comparison with the conventional approach of selecting the same features for all nodes. [ABSTRACT FROM PUBLISHER]

Classification of different human activities using multistatic micro-Doppler data and features is considered in this study, focusing on the distinction between unarmed and potentially armed personnel. A database of real radar data with more than 550 recordings from 7 different human subjects has been collected in a series of experiments in the field with a multistatic radar system. Four key features were extracted from the micro-Doppler signature after a short time Fourier transform analysis. The resulting feature vectors were then used as individual, pairs, triplets and all together before inputting to different types of classifiers based on the discriminant analysis method. The performance of different classifiers and different feature combinations is discussed aiming at identifying the most appropriate features for the unarmed against armed personnel classification, as well as the benefit of combining multistatic data rather than using monostatic data only. [ABSTRACT FROM AUTHOR]

This paper presents the design and optimization of patch-like antennas for through-the-wall imaging (TTWI) radar applications in the frequency range 0.5–2 GHz. A basic antenna configuration is analyzed and modified through an optimization aiming at reducing the size of the antenna and focusing the radiated power in a single lobe to be directed toward the wall and the targets to be detected. Both the basic and the optimized antennas have been manufactured and tested. The optimized patch antennas and a conventional Vivaldi antenna have been successfully used in the frequency-modulated interrupted continuous wave (FMICW) radar system developed at Durham University. Results of a novel wall-removal technique for TTWI using numerical simulations and measurements aimed at the detection of stationary targets and people are presented. [ABSTRACT FROM PUBLISHER]

Undesired wall reflections in through-the-wall imaging can mask the return from actual targets and saturate and block the receiver. We propose frequency-modulated interrupted continuous wave (FMICW) signals as a novel wall removal technique and validate its effectiveness through numerical simulations and experiments performed using a radar system built for the purpose. FMICW waveforms appear to mitigate wall reflections and benefit the through-wall detection of stationary targets and of people moving or breathing behind different kinds of wall. [ABSTRACT FROM PUBLISHER]

Human activity recognition (HAR) plays a vital role in many applications, such as surveillance, in-home monitoring, and health care. Portable radar sensor has been increasingly used in HAR systems in combination with deep learning (DL). However, it is both difficult and time-consuming to obtain a large-scale radar dataset with reliable labels. Insufficient labeled data often limit the generalization of DL models. As a result, the performance of DL models will drop when being applied to a new scenario. In this sense, only labeling a small portion of data in the large-scale radar dataset is more feasible. In this article, we propose a semisupervised transfer learning (TL) algorithm, “joint domain and semantic transfer learning (JDS-TL),” for radar-based HAR, which is composed of two modules: unsupervised domain adaptation (DA) and supervised semantic transfer. By employing a sparsely labeled dataset to train the HAR model, the proposed method alleviates the need of labeling a significantly large number of radar signals. We adopt a public radar micro-Doppler spectrogram dataset including six human activities to evaluate JDS-TL. Experiments show that the proposed JDS-TL is able to recognize the six activities with an average accuracy of 87.6% when there are only 10% instances labeled in the training dataset. Ablation analysis also demonstrates the efficiency of the DA and the semantic transfer modules. [ABSTRACT FROM AUTHOR]

This document is a guest editorial from the journal IET Radar, Sonar & Navigation. It discusses the advances in AI-assisted radar sensing applications and the challenges that hinder its adoption in this field. The special issue of the journal features nine papers that address these challenges and offer innovative ideas and experimental results. The papers cover a range of topics, including health monitoring, human activity recognition, voice identification, elderly care health monitoring, track-to-track association, signal pre-processing, traffic congestion alleviation, and target recognition. The authors express their gratitude to the contributors and reviewers and believe that the research presented will inspire further exploration and innovation in this field. [Extracted from the article]

The performance of deep learning (DL) algorithms for radar-based human motion recognition (HMR) is hindered by the diversity and volume of the available training data. In this article, to tackle the issue of insufficient training data for HMR, we propose an instance-based transfer learning (ITL) method with limited radar micro-Doppler (MD) signatures, alleviating the burden of collecting and annotating a large number of radar samples. ITL is a unique algorithm that consists of three interconnected parts, including DL model pretraining, correlated source data selection, and adaptive collaborative fine-tuning (FT). Any of the three components cannot be excluded; otherwise, the performance of the entire algorithm decreases. The experiments with a radar data set of six human motions show that ITL achieves state-of-the-art performance for HMR with limited training samples, outperforming several existing transfer learning approaches. Especially, when there are only 100 samples per person per class, ITL yields an F1 score of 96.7%. Last but not least, ITL is more generalized to human motion differences. Though adapted to recognize the persons’ motions in a small-scale target data set, ITL can also classify the persons’ motion data used for pretraining, achieving up to 11.0% F1 score enhancement over the conventional FT method. [ABSTRACT FROM AUTHOR]

The latest progress of the multiple‐input multiple‐output (MIMO) radar system developed for small drones detection at Beijing Institute of Technology is presented herein. A low‐cost S‐band MIMO scanning radar system is designed for the detection of small drones. A practical design optimisation and implementation of a sparse array covering the whole airspace, and a target‐based MIMO radar array calibration method to improve the signal‐to‐noise ratio of the target are proposed. An experiment in the microwave chamber was conducted to verify the designed sparse‐array beam‐pattern, and measurement campaigns for small drones were performed to test the system performance where the radar achieved detection and tracking of a small DJI‐Phantom 4 drone at a range of up to 5 km. Target features, including micro‐Doppler and radar cross‐section signatures were extracted to assist target classification. The experimental results indicate that the system has promising capability in small drones detection and tracking, despite the challenges of low dwell time on targets due to the scanning nature of the system. [ABSTRACT FROM AUTHOR]

Radar systems are increasingly being employed in healthcare applications for human activity recognition due to their advantages in terms of privacy, contactless sensing, and insensitivity to lighting conditions. The proposed classification algorithms are however often complex, focusing on a single domain of radar, and requiring significant computational resources that prevent their deployment in embedded platforms which often have limited memory and computational resources. To address this issue, we present an adaptive magnitude thresholding approach for highlighting the region of interest in the multi-domain micro-Doppler signatures. The region of interest is beneficial to extract salient features, meanwhile it ensures the simplicity of calculations with less computational cost. The results for the proposed approach show an accuracy of up to 93.1% for six activities, outperforming state-of-the-art deep learning methods on the same dataset with an over tenfold reduction in both training time and memory footprint, and a twofold reduction in inference time compared to a series of deep learning implementations. These results can help bridge the gap toward embedded platform deployment. [ABSTRACT FROM AUTHOR]

In recent years, gait-based person identification has gained significant interest for a variety of applications, including security systems and public security forensics. Meanwhile, this task is faced with the challenge of disguised gaits. When a human subject changes what he or she is wearing or carrying, it becomes challenging to reliably identify the subject’s identity using gait data. In this paper, we propose an unsupervised domain adaptation (UDA) model, named Guided Subspace Alignment under the Class-aware condition (G-SAC), to recognize human subjects based on their disguised gait data by fully exploiting the intrinsic information in gait biometrics. To accomplish this, we employ neighbourhood component analysis (NCA) to create an intrinsic feature subspace from which we can obtain similarities between normal and disguised gaits. With the aid of a proposed constraint for adaptive class-aware alignment, the class-level discriminative feature representation can be learned guided by this subspace. Our experimental results on a measured micro-Doppler radar dataset demonstrate the effectiveness of our approach. The comparison results with several state-of-the-art methods indicate that our work provides a promising domain adaptation solution for the concerned problem, even in cases where the disguised pattern differs significantly from the normal gaits. Additionally, we extend our approach to more complex multi-target domain adaptation (MTDA) challenge and video-based gait recognition tasks, the superior results demonstrate that the proposed model has a great deal of potential for tackling increasingly difficult problems. [ABSTRACT FROM AUTHOR]

The health status of an older or vulnerable person can be determined by looking into the additive effects of aging as well as any associated diseases. This status can lead the person to a situation of 'unstable incapacity' for normal aging and is determined by the decrease in response to the environment and to specific pathologies with apparent decrease of independence in activities of daily living (ADL). In this paper, we use micro-Doppler images obtained using a frequency-modulated continuous wave radar (FMCW) operating at 5.8 GHz with 400 MHz bandwidth as the sensor to perform assessment of this health status. The core idea is to develop a generalized system where the data obtained for ADL can be portable across different environments and groups of subjects, and critical events such as falls in mature individuals can be detected. In this context, we have conducted comprehensive experimental campaigns at nine different locations including four laboratory environments and five elderly care homes. A total of 99 subjects participated in the experiments where 1453 micro-Doppler signatures were recorded for six activities. Different machine learning, deep learning algorithms and transfer learning technique were used to classify the ADL. The support vector machine (SVM), K-nearest neighbor (KNN) and convolutional neural network (CNN) provided adequate classification accuracies for particular scenarios; however, the autoencoder neural network outperformed the mentioned classifiers by providing classification accuracy of ~ 88%. The proposed system for fall detection in elderly people can be deployed in care centers and is application for any indoor settings with various age group of people. For future work, we would focus on monitoring multiple older adults, concurrently in indoor settings using continuous radar sensor data stream which is limitation of the present system. [ABSTRACT FROM AUTHOR]

Radar micro‐Doppler signatures have been proposed for human monitoring and activity classification for surveillance and outdoor security, as well as for ambient assisted living in healthcare‐related applications. A known issue is the performance reduction when the target is moving tangentially to the line of sight of the radar. Multiple techniques have been proposed to address this, such as multistatic radar and to some extent, interferometric (IF) radar. A simulator is presented to generate synthetic data representative of eight radar systems (monostatic, circular multistatic and in‐line multistatic [IM] and IF) to quantify classification performances as a function of aspect angles and deployment geometries. This simulator allows an unbiased performance evaluation of different radar systems. Six human activities are considered with signatures originating from motion‐captured data of 14 different subjects. The classification performances are analysed as a function of aspect angles ranging from 0° to 90° per activity and overall. It demonstrates that IF configurations are more robust than IM configurations. However, IM performs better at angles below 55° before IF configurations take over. [ABSTRACT FROM AUTHOR]

Radar-based classification of human activities and gait have attracted significant attention with a large number of approaches proposed in terms of features and classification algorithms. A common approach in activity classification attempts to find the algorithm (features plus classifier) that can deal with multiple activities analysed in one study such as walking, sitting, drinking and crawling. However, using the same set of features for multiple activities can be suboptimal per activity and not take into account the diversity of kinematic movements that could be captured by diverse features. In this paper, we propose a hierarchical classification approach that uses a large variety of features including but not limited to energy features like entropy and energy curve, physical features like centroid and bandwidth, image-based features like skewness extracted from multiple radar data domains. Feature selection is used at each step of the hierarchical model to select the best set of features to discriminate the target activity from the others, showing improvements with respect to the more conventional approach of using a multiclass model. The proposed approach is validated on a large dataset with 1078 recorded samples of varying length from 5 s to 10 s of experimental data, yielding 95.4% accuracy to classify six activities. The approach is also validated on a personnel recognition task to identify individual subjects from their walking gait, yielding 83.7% accuracy for ten subjects and 68.2% for a significantly larger group of subjects, i.e., 60 people. [ABSTRACT FROM AUTHOR]

Radar-based human motion recognition is crucial for many applications, such as surveillance, search and rescue operations, smart homes, and assisted living. Continuous human motion recognition in real-living environment is necessary for practical deployment, i.e., classification of a sequence of activities transitioning one into another, rather than individual activities. In this paper, a novel dynamic range-Doppler trajectory (DRDT) method based on the frequency-modulated continuous-wave (FMCW) radar system is proposed to recognize continuous human motions with various conditions emulating real-living environment. This method can separate continuous motions and process them as single events. First, range-Doppler frames consisting of a series of range-Doppler maps are obtained from the backscattered signals. Next, the DRDT is extracted from these frames to monitor human motions in time, range, and Doppler domains in real time. Then, a peak search method is applied to locate and separate each human motion from the DRDT map. Finally, range, Doppler, radar cross section (RCS), and dispersion features are extracted and combined in a multidomain fusion approach as inputs to a machine learning classifier. This achieves accurate and robust recognition even in various conditions of distance, view angle, direction, and individual diversity. Extensive experiments have been conducted to show its feasibility and superiority by obtaining an average accuracy of 91.9% on continuous classification. [ABSTRACT FROM AUTHOR]

Once diagnosed with cancer, a patient goes through a series of diagnosis and tests, which are referred to as "after cancer treatment". Due to the nature of the treatment and side effects, maintaining quality of life (QoL) in the home environment is a challenging task. Sometimes, a cancer patient's situation changes abruptly as the functionality of certain organs deteriorates, which affects their QoL. One way of knowing the physiological functional status of a cancer patient is to design an occupational therapy. In this paper, we propose a blockchain and off-chain-based framework, which will allow multiple medical and ambient intelligent Internet of Things sensors to capture the QoL information from one's home environment and securely share it with their community of interest. Using our proposed framework, both transactional records and multimedia big data can be shared with an oncologist or palliative care unit for real-time decision support. We have also developed blockchain-based data analytics, which will allow a clinician to visualize the immutable history of the patient's data available from an in-home secure monitoring system for a better understanding of a patient's current or historical states. Finally, we will present our current implementation status, which provides significant encouragement for further development. [ABSTRACT FROM AUTHOR]