Search

This paper reports on the use of machine learning to delineate data harnessed by fiber-optic distributed acoustic sensors (DAS) using fiber with enhanced Rayleigh backscattering to recognize vibration events induced by human locomotion. The DAS used in this work is based on homodyne phase-sensitive optical time-domain reflectometry (φ-OTDR). The signal-to-noise ratio (SNR) of the DAS was enhanced using femtosecond laser-induced artificial Rayleigh scattering centers in single-mode fiber cores. Both supervised and unsupervised machine-learning algorithms were explored to identify people and specific events that produce acoustic signals. Using convolutional deep neural networks, the supervised machine learning scheme achieved over 76.25% accuracy in recognizing human identities. Conversely, the unsupervised machine learning scheme achieved over 77.65% accuracy in recognizing events and human identities through acoustic signals. Through integrated efforts on both sensor device innovation and machine learning data analytics, this paper shows that the DAS technique can be an effective security technology to detect and to identify highly similar acoustic events with high spatial resolution and high accuracies. [ABSTRACT FROM AUTHOR]

Traditional protection methods such as over-current or under-voltage methods are unreliable in inverter-based microgrid applications. This is primarily due to low fault current levels because of power electronic interfaces to the distributed energy resources (DER), and IEEE1547 low-voltage-ride-through (LVRT) requirements for renewables in microgrids. However, when faults occur in a microgrid feeder, system changes occur which manipulate the internal circuit structure altering the system dynamic relationships. This observation establishes the basis for a proposed, novel, model-based, communication-free fault detection technique for inverter-based microgrids. The method can detect faults regardless of the fault current level and the microgrid mode of operation. The approach utilizes fewer measurements to avoid the use of a communication system. Protecting the microgrid without communication channels could lead to blinding (circuit breakers not tripping for faults) or nuisance tripping (tripping incorrectly). However, these events can be avoided with proper system design, specifically with appropriately sized system impedance. Thus, a major contribution of this article is the development of a mathematical framework to analyze and avoid blinding and nuisance tripping scenarios by quantifying the bounds of the proposed fault detection technique. As part of this analysis, the impedance based constraints for microgrid system feeders are included. The performance of the proposed technique is demonstrated in the MATLAB/SIMULINK (MathWorks, Natick, MA, USA) simulation environment on a representative microgrid architecture showing that the proposed technique can detect faults for a wide range of load impedances and fault impedances. [ABSTRACT FROM AUTHOR]

The integration of sensor technology in healthcare has become crucial for disease diagnosis and treatment [...].

Unhealthy diet is a top risk factor causing obesity and numerous chronic diseases. To help the public adopt healthy diet, nutrition scientists need user-friendly tools to conduct Dietary Assessment (DA). In recent years, new DA tools have been developed using a smartphone or a wearable device which acquires images during a meal. These images are then processed to estimate calories and nutrients of the consumed food. Although considerable progress has been made, 2D food images lack scale reference and 3D volumetric information. In addition, food must be sufficiently observable from the image. This basic condition can be met when the food is stand-alone (no food container is used) or it is contained in a shallow plate. However, the condition cannot be met easily when a bowl is used. The food is often occluded by the bowl edge, and the shape of the bowl may not be fully determined from the image. However, bowls are the most utilized food containers by billions of people in many parts of the world, especially in Asia and Africa. In this work, we propose to premeasure plates and bowls using a marked adhesive strip before a dietary study starts. This simple procedure eliminates the use of a scale reference throughout the DA study. In addition, we use mathematical models and image processing to reconstruct the bowl in 3D. Our key idea is to estimate how full the bowl is rather than how much food is (in either volume or weight) in the bowl. This idea reduces the effect of occlusion. The experimental data have shown satisfactory results of our methods which enable accurate DA studies using both plates and bowls with reduced burden on research participants.

This research analyzes the area required for the conflict resolution between aircraft in two flows impacted by a convective weather cell (CWC). The CWC is introduced as a constrained area, forbidden to flight through, which affects the air traffic flows. Prior the conflict resolution, two flows and their intersection are relocated away from the CWC area (thus enabling circumvention of the CWC), which is followed by a tuning of the relocated flows intersection angle in order to create the minimal size of the conflict zone (CZ-a circular area centered at the intersection of two flows, which provides aircraft enough space to completely resolve the conflict within). Therefore, the essence of the proposed solution is in providing conflict free trajectories for the aircraft in intersecting flows that are affected by the CWC, with the goal of minimizing the CZ size, so the finite occupied airspace for the conflict resolution and the CWC circumvention could be reduced. Compared to the best solutions and current industry practice, this article is focused in reduction of the airspace required for aircraft to aircraft and aircraft to weather conflict resolution, and not to distance travelled, time savings, and fuel consumption minimization. The conducted analysis in the MicrosoftExcel2010 confirmed the relevance of the proposed model and demonstrated variations in efficiency of the utilized airspace. The proposed model's transdisciplinary nature makes it potentially applicable in other fields of study, such as the conflict resolution between unmanned aerial vehicles (UAVs) and fixed objects like buildings. Building on this model and taking in consideration large and complex data sets, such as weather related data and flight data (aircraft position, speed, and altitude), we believe it is possible to conduct more sophisticated analyses that would take advantage of Big Data., Competing Interests: Competing interestsThe authors declare that they have no competing interests., (© The Author(s) 2023.)

An unhealthy diet is strongly linked to obesity and numerous chronic diseases. Currently, over two-thirds of American adults are overweight or obese. Although dietary assessment helps people improve nutrition and lifestyle, traditional methods for dietary assessment depend on self-report, which is inaccurate and often biased. In recent years, as electronics, information, and artificial intelligence (AI) technologies advanced rapidly, image-based objective dietary assessment using wearable electronic devices has become a powerful approach. However, research in this field has been focused on the developments of advanced algorithms to process image data. Few reports exist on the study of device hardware for the particular purpose of dietary assessment. In this work, we demonstrate that, with the current hardware design, there is a considerable risk of missing important dietary data owing to the common use of rectangular image screen and fixed camera orientation. We then present two designs of a new camera system to reduce data loss by generating circular images using rectangular image sensor chips. We also present a mechanical design that allows the camera orientation to be adjusted, adapting to differences among device wearers, such as gender, body height, and so on. Finally, we discuss the pros and cons of rectangular versus circular images with respect to information preservation and data processing using AI algorithms.

Although deep learning has achieved great success in many computer vision tasks, its performance relies on the availability of large datasets with densely annotated samples. Such datasets are difficult and expensive to obtain. In this article, we focus on the problem of learning representation from unlabeled data for semantic segmentation. Inspired by two patch-based methods, we develop a novel self-supervised learning framework by formulating the jigsaw puzzle problem as a patch-wise classification problem and solving it with a fully convolutional network. By learning to solve a jigsaw puzzle comprising 25 patches and transferring the learned features to semantic segmentation task, we achieve a 5.8% point improvement on the Cityscapes dataset over the baseline model initialized from random values. It is noted that we use only about 1/6 training images of Cityscapes in our experiment, which is designed to imitate the real cases where fully annotated images are usually limited to a small number. We also show that our self-supervised learning method can be applied to different datasets and models. In particular, we achieved competitive performance with the state-of-the-art methods on the PASCAL VOC2012 dataset using significantly fewer time costs on pretraining.

Knowing the amounts of energy and nutrients in an individual's diet is important for maintaining health and preventing chronic diseases. As electronic and AI technologies advance rapidly, dietary assessment can now be performed using food images obtained from a smartphone or a wearable device. One of the challenges in this approach is to computationally measure the volume of food in a bowl from an image. This problem has not been studied systematically despite the bowl being the most utilized food container in many parts of the world, especially in Asia and Africa. In this paper, we present a new method to measure the size and shape of a bowl by adhering a paper ruler centrally across the bottom and sides of the bowl and then taking an image. When observed from the image, the distortions in the width of the paper ruler and the spacings between ruler markers completely encode the size and shape of the bowl. A computational algorithm is developed to reconstruct the three-dimensional bowl interior using the observed distortions. Our experiments using nine bowls, colored liquids, and amorphous foods demonstrate high accuracy of our method for food volume estimation involving round bowls as containers. A total of 228 images of amorphous foods were also used in a comparative experiment between our algorithm and an independent human estimator. The results showed that our algorithm overperformed the human estimator who utilized different types of reference information and two estimation methods, including direct volume estimation and indirect estimation through the fullness of the bowl.

The macro and micro design is essential to the biomechanical performance of a short implant. In this study, the implant thread parameters of short implants used in edentulous maxillae will be discussed. The aim of the study is to analyse biomechanical distinctions in different thread parameters over short implants by applying the vertical or oblique load of 130 N on dental prosthesis. A 6*5 mm implant will be used in posterior maxillae arch, where the molar region locates. The CAD model has been assembled by three parts, a crown, an implant system and a jaw. By applying the vertical or oblique load to the crown, the Von-Mises stresses of cortical bone and trabecular bone will be evaluated in pairs along the lines v1-v2 & a1-a2. The results showed that the reverse buttress thread would induce more stresses in cancellous bone whereas the buttress did the opposite. The trapezoidal thread (V-thread) is more favourable than the reverse buttress thread in accordance to the FEA result. The rectangle threads will induce more uneven stresses in cancellous bones., (© 2022 Walter de Gruyter GmbH, Berlin/Boston.)

Multilabel feature extraction (FE) is an effective preprocessing step to cope with some possible irrelevant, redundant, and noisy features, to reduce computational costs and even improve classification performance. Original normalized cross-covariance operator represents a kernel-based nonlinear dependence measure between features and labels, whose empirical estimator is formulated as a trace operation including two inverse matrices of feature and label kernels with a regularization constant. Due to such a complicated expression, it is impossible to derive an eigenvalue problem for linear FE directly. In this paper, we approximate this measure using Moore-Penrose inverse matrix, linear kernel for feature space, and delta kernel for label space, and then symmetrize the entire matrix in the trace operation, resulting in an effective approximated and symmetrized representation. According to orthonormal projection direction constraints, maximizing such a modified form induces a novel eigenvalue problem for multilabel linear FE. Experiments on 12 data sets illustrate that our proposed method works the best, compared with seven existing FE techniques, according to eight multilabel classification performance metrics and three statistical tests.

It is well known that many chronic diseases are associated with unhealthy diet. Although improving diet is critical, adopting a healthy diet is difficult despite its benefits being well understood. Technology is needed to allow an assessment of dietary intake accurately and easily in real-world settings so that effective intervention to manage being overweight, obesity, and related chronic diseases can be developed. In recent years, new wearable imaging and computational technologies have emerged. These technologies are capable of performing objective and passive dietary assessments with a much simplified procedure than traditional questionnaires. However, a critical task is required to estimate the portion size (in this case, the food volume) from a digital image. Currently, this task is very challenging because the volumetric information in the two-dimensional images is incomplete, and the estimation involves a great deal of imagination, beyond the capacity of the traditional image processing algorithms. In this work, we present a novel Artificial Intelligent (AI) system to mimic the thinking of dietitians who use a set of common objects as gauges (e.g., a teaspoon, a golf ball, a cup, and so on) to estimate the portion size. Specifically, our human-mimetic system "mentally" gauges the volume of food using a set of internal reference volumes that have been learned previously. At the output, our system produces a vector of probabilities of the food with respect to the internal reference volumes. The estimation is then completed by an "intelligent guess", implemented by an inner product between the probability vector and the reference volume vector. Our experiments using both virtual and real food datasets have shown accurate volume estimation results., Competing Interests: Conflicts of Interest: The authors declare no conflict of interest.

Objective: Accurate measurements of food volume and density are often required as 'gold standards' for calibration of image-based dietary assessment and food database development. Currently, there is no specialised laboratory instrument for these measurements. We present the design of a new volume of density (VD) meter to bridge this technological gap., Design: Our design consists of a turntable, a load sensor, a set of cameras and lights installed on an arc-shaped stationary support, and a microcomputer. It acquires an array of food images, reconstructs a 3D volumetric model, weighs the food and calculates both food volume and density, all in an automatic process controlled by the microcomputer. To adapt to the complex shapes of foods, a new food surface model, derived from the electric field of charged particles, is developed for 3D point cloud reconstruction of either convex or concave food surfaces., Results: We conducted two experiments to evaluate the VD meter. The first experiment utilised computer-synthesised 3D objects with prescribed convex and concave surfaces of known volumes to investigate different food surface types. The second experiment was based on actual foods with different shapes, colours and textures. Our results indicated that, for synthesised objects, the measurement error of the electric field-based method was <1 %, significantly lower compared with traditional methods. For real-world foods, the measurement error depended on the types of food volumes (detailed discussion included). The largest error was approximately 5 %., Conclusion: The VD meter provides a new electronic instrument to support advanced research in nutrition science.

Malnutrition, including both undernutrition and obesity, is a significant problem in low- and middle-income countries (LMICs). In order to study malnutrition and develop effective intervention strategies, it is crucial to evaluate nutritional status in LMICs at the individual, household, and community levels. In a multinational research project supported by the Bill & Melinda Gates Foundation, we have been using a wearable technology to conduct objective dietary assessment in sub-Saharan Africa. Our assessment includes multiple diet-related activities in urban and rural families, including food sources (e.g., shopping, harvesting, and gathering), preservation/storage, preparation, cooking, and consumption (e.g., portion size and nutrition analysis). Our wearable device ("eButton" worn on the chest) acquires real-life images automatically during wake hours at preset time intervals. The recorded images, in amounts of tens of thousands per day, are post-processed to obtain the information of interest. Although we expect future Artificial Intelligence (AI) technology to extract the information automatically, at present we utilize AI to separate the acquired images into two binary classes: images with (Class 1) and without (Class 0) edible items. As a result, researchers need only to study Class-1 images, reducing their workload significantly. In this paper, we present a composite machine learning method to perform this classification, meeting the specific challenges of high complexity and diversity in the real-world LMIC data. Our method consists of a deep neural network (DNN) and a shallow learning network (SLN) connected by a novel probabilistic network interface layer. After presenting the details of our method, an image dataset acquired from Ghana is utilized to train and evaluate the machine learning system. Our comparative experiment indicates that the new composite method performs better than the conventional deep learning method assessed by integrated measures of sensitivity, specificity, and burden index, as indicated by the Receiver Operating Characteristic (ROC) curve., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2021 Chen, Jia, Zhao, Mao, Lo, Anderson, Frost, Jobarteh, McCrory, Sazonov, Steiner-Asiedu, Ansong, Baranowski, Burke and Sun.)

Despite the extreme importance of food intake in human health, it is currently difficult to conduct an objective dietary assessment without individuals' self-report. In recent years, a passive method utilizing a wearable electronic device has emerged. This device acquires food images automatically during the eating process. These images are then analyzed to estimate intakes of calories and nutrients, assisted by advanced computational algorithms. Although this passive method is highly desirable, it has been thwarted by the requirement of a fiducial marker which must be present in the image for a scale reference. The importance of this scale reference is analogous to the importance of the scale bar in a map which determines distances or areas in any geological region covered by the map. Likewise, the sizes or volumes of arbitrary foods on a dining table covered by an image cannot be determined without the scale reference. Currently, the fiducial marker (often a checkerboard card) serves as the scale reference which must be present on the table before taking pictures, requiring human efforts to carry, place and retrieve the fiducial marker manually. In this work, we demonstrate that the fiducial marker can be eliminated if an individual's dining location is fixed and a one-time calibration using a circular plate of known size is performed. When the individual uses another circular plate of an unknown size, our algorithm estimates its radius using the range of pre-calibrated distances between the camera and the plate from which the desired scale reference is determined automatically. Our comparative experiment indicates that the mean absolute percentage error of the proposed estimation method is ~10.73%. Although this error is larger than that of the manual method of 6.68% using a fiducial marker on the table, the new method has a distinctive advantage of eliminating the manual procedure and automatically generating the scale reference., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2021 Jia, Wu, Ren, Cao, Mao and Sun.)

This paper presents an integrated technical framework to protect pipelines against both malicious intrusions and piping degradation using a distributed fiber sensing technology and artificial intelligence. A distributed acoustic sensing (DAS) system based on phase-sensitive optical time-domain reflectometry (φ-OTDR) was used to detect acoustic wave propagation and scattering along pipeline structures consisting of straight piping and sharp bend elbow. Signal to noise ratio of the DAS system was enhanced by femtosecond induced artificial Rayleigh scattering centers. Data harnessed by the DAS system were analyzed by neural network-based machine learning algorithms. The system identified with over 85% accuracy in various external impact events, and over 94% accuracy for defect identification through supervised learning and 71% accuracy through unsupervised learning.

Semantic segmentation is a key step in scene understanding for autonomous driving. Although deep learning has significantly improved the segmentation accuracy, current highquality models such as PSPNet and DeepLabV3 are inefficient given their complex architectures and reliance on multi-scale inputs. Thus, it is difficult to apply them to real-time or practical applications. On the other hand, existing real-time methods cannot yet produce satisfactory results on small objects such as traffic lights, which are imperative to safe autonomous driving. In this paper, we improve the performance of real-time semantic segmentation from two perspectives, methodology and data. Specifically, we propose a real-time segmentation model coined Narrow Deep Network (NDNet) and build a synthetic dataset by inserting additional small objects into the training images. The proposed method achieves 65.7% mean intersection over union (mIoU) on the Cityscapes test set with only 8.4G floatingpoint operations (FLOPs) on 1024×2048 inputs. Furthermore, by re-training the existing PSPNet and DeepLabV3 models on our synthetic dataset, we obtained an average 2% mIoU improvement on small objects.

Functional electrical stimulation (FES) has recently been proposed as a supplementary torque assist in lower-limb powered exoskeletons for persons with paraplegia. In the combined system, also known as a hybrid neuroprosthesis, both FES-assist and the exoskeleton act to generate lower-limb torques to achieve standing and walking functions. Due to this actuator redundancy, we are motivated to optimally allocate FES-assist and exoskeleton torque based on a performance index that penalizes FES overuse to minimize muscle fatigue while also minimizing regulation or tracking errors. Traditional optimal control approaches need a system model to optimize; however, it is often difficult to formulate a musculoskeletal model that accurately predicts muscle responses due to FES. In this paper, we use a novel identification and control structure that contains a recurrent neural network (RNN) and several feedforward neural networks (FNNs). The RNN is trained by supervised learning to identify the system dynamics, while the FNNs are trained by a reinforcement learning method to provide sub-optimal control actions. The output layer of each FNN has its unique activation functions, so that the asymmetric constraint of FES and the symmetric constraint of exoskeleton motor control input can be realized. This new structure is experimentally validated on a seated human participant using a single joint hybrid neuroprosthesis.

Cervical auscultation is a method for assessing swallowing performance. However, its ability to serve as a classification tool for a practical clinical assessment method is not fully understood. In this study, we utilized neural network classification methods in the form of Deep Belief networks in order to classify swallows. We specifically utilized swallows that did not result in clinically significant aspiration and classified them on whether they originated from healthy subjects or unhealthy patients. Dual-axis swallowing vibrations from 1946 discrete swallows were recorded from 55 healthy and 53 unhealthy subjects. The Fourier transforms of both signals were used as inputs to the networks of various sizes. We found that single and multi-layer Deep Belief networks perform nearly identically when analyzing only a single vibration signal. However, multi-layered Deep Belief networks demonstrated approximately a 5% to 10% greater accuracy and sensitivity when both signals were analyzed concurrently, indicating that higher-order relationships between these vibrations are important for classification and assessment.

Wireless Power Transfer (WPT) and wireless data communication are both important problems of research with various applications, especially in medicine. However, these two problems are usually studied separately. In this work, we present a joint study of both problems. Most medical electronic devices, such as smart implants, must have both a power supply to allow continuous operation and a communication link to pass information. Traditionally, separate wireless channels for power transfer and communication are utilized, which complicate the system structure, increase power consumption and make device miniaturization difficult. A more effective approach is to use a single wireless link with both functions of delivering power and passing information. We present a design of such a wireless link in which power and data travel in opposite directions. In order to aggressively miniaturize the implant and reduce power consumption, we eliminate the traditional multi-bit Analog-to-Digital Converter (ADC), digital memory and data transmission circuits all together. Instead, we use a pulse stream, which is obtained from the original biological signal, by a sigma-delta converter and an edge detector, to alter the load properties of the WPT channel. The resulting WPT signal is synchronized with the load changes therefore requiring no memory elements to record inter-pulse intervals. We take advantage of the high sensitivity of the resonant WPT to the load change, and the system dynamic response is used to transfer each pulse. The transient time of the WPT system is analyzed using the coupling mode theory (CMT). Our experimental results show that the memoryless approach works well for both power delivery and data transmission, providing a new wireless platform for the design of future miniaturized medical implants.

Brain-computer interfaces (BCIs) largely augment human capabilities by translating brain wave signals into feasible commands to operate external devices. However, many issues face the development of BCIs such as the low classification accuracy of brain signals and the tedious human-learning procedures. To solve these problems, we propose to use signals associated with eye saccades and blinks to control a BCI interface. By extracting existing physiological eye signals, the user does not need to adapt his/her brain waves to the device. Furthermore, using saccade signals to control an external device frees the limbs to perform other tasks. In this research, we use two electrodes placed on top of the left and right ears of thirteen participants. Then we use Independent Component Analysis (ICA) to extract meaningful EEG signals associated with eye movements. A sliding-window technique was implemented to collect relevant features. Finally, we classified the features as horizontal or blink eye movements using KNN and SVM. We were able to achieve a mean classification accuracy of about 97%. The two electrodes were then integrated with off-the-shelf earbuds to control a wheelchair. The earbuds can generate voice cues to indicate when to rotate the eyeballs to certain locations (i.e., left or right) or blink, so that the user can select directional commands to drive the wheelchair. In addition, through properly designing the contents of voice menus, we can generate as many commands as possible, even though we only have limited numbers of states of the identified eye saccade movements.

Parkinson's disease (PD) is a progressive neurodegenerative disease characterized by rigidity, bradykinesia, resting tremor, and postural instability. Rigidity, defined as an increased resistance to passive movement of a joint, progresses faster than other motor signs in PD. Rigidity is attributable to both exaggerated neural reflex and altered muscle mechanical properties. However, little is known about the contributions of individual components to rigidity. Further, there is no evidence regarding the effects of dopaminergic medication on individual components. Objectives of this study were to quantify the contributions of neural reflexes and intrinsic muscle properties to rigidity and investigate the effects of medication on each contributing component. Joint torque and muscle activities of the wrist in 14 patients and 14 controls were measured during externally induced movements. Each subject with PD was tested in Off- and On-medication states. A system identification technique was applied to differentiate and quantify the neural reflex and intrinsic mechanical components. A mixed model of ANOVA was performed to compare the differences between the two components of rigidity for both groups, and to compare between the Off- and On-medication states for patients. The results showed that reflex and intrinsic components are comparable (p > 0.05), and both are enhanced in subjects with PD than in the controls (p < 0.05). Medication decreased the reflex component of rigidity (p < 0.01). It is concluded that both reflex and intrinsic factors are responsible for rigidity. Present findings are clinically significant as they may provide guidance in development of effective therapeutic interventions.

In this paper, an efficient field-programmable gate array (FPGA) implementation of the JPEG baseline image compression encoder is presented for wearable devices in health and wellness applications. In order to gain flexibility in developing FPGA-specific software and balance between real-time performance and resources utilization, A High Level Synthesis (HLS) tool is utilized in our system design. An optimized dataflow configuration with a padding scheme simplifies the timing control for data transfer. Our experiments with a system-on-chip multi-sensor system have verified our FPGA implementation with respect to real-time performance, computational efficiency, and FPGA resource utilization.

In this paper, the design of a low power heterogeneous wearable multi-sensor system, built with Zynq System-on-Chip (SoC), for human activity evaluation is presented. The powerful data processing capability and flexibility of this SoC represent significant improvements over our previous ARM based system designs. The new system captures and compresses multiple color images and sensor data simultaneously. Several strategies are adopted to minimize power consumption. Our wearable system provides a new tool for the evaluation of human activity, including diet, physical activity and lifestyle.

Position localization is essential for visually impaired individuals to live independently. Comparing with outdoor environment in which the global positioning system (GPS) can be utilized, indoor positioning is more difficult due to the absence of the GPS signal and complex or unfamiliar building structure. In this paper, a novel landmark-based assistive system is presented for indoor positioning. Our preliminary tests in several buildings indicate that this system can provide accurate indoor location information.

It has been reported that the pulse transit time (PTT), the interval between the peak of the R-wave in electrocardiogram (ECG) and the fingertip photoplethysmogram (PPG), is related to arterial stiffness, and can be used to estimate the systolic blood pressure (SBP) and diastolic blood pressure (DBP). This phenomenon has been used as the basis to design portable systems for continuously cuff-less blood pressure measurement, benefiting numerous people with heart conditions. However, the PTT-based blood pressure estimation may not be sufficiently accurate because the regulation of blood pressure within the human body is a complex, multivariate physiological process. Considering the negative feedback mechanism in the blood pressure control, we introduce the heart rate (HR) and the blood pressure estimate in the previous step to obtain the current estimate. We validate this method using a clinical database. Our results show that the PTT, HR and previous estimate reduce the estimated error significantly when compared to the conventional PTT estimation approach (p<0.05).

Recent advances in mobile devices have made profound changes in people's daily lives. In particular, the impact of easy access of information by the smartphone has been tremendous. However, the impact of mobile devices on healthcare has been limited. Diagnosis and treatment of diseases are still initiated by occurrences of symptoms, and technologies and devices that emphasize on disease prevention and early detection outside hospitals are under-developed. Besides healthcare, mobile devices have not yet been designed to fully benefit people with special needs, such as the elderly and those suffering from certain disabilities, such blindness. In this paper, an overview of our research on a new wearable computer called eButton is presented. The concepts of its design and electronic implementation are described. Several applications of the eButton are described, including evaluating diet and physical activity, studying sedentary behavior, assisting the blind and visually impaired people, and monitoring older adults suffering from dementia.

Propelled by rapid technological advances in smart phones and other mobile devices, indoor navigation for the blind and visually impaired individuals has become an active field of research. A reliable positioning and navigation system will reduce suffering of these individuals, help them live more independently, and promote their employment. Although much progress has been made, localization of the floor level in a multistory building is largely an unsolved problem despite its high significance in helping the blind to find their ways. In this paper, we present a novel approach using a miniature barometer in the form of a low-cost MEMS chip. The relationships among the atmospheric pressure, the absolute height, and the floor location are described along with a real-time calibration method and a hardware platform design. Our experiments in a building of twelve floors have shown high performance of our approach.

Anthropometric measurements, such as the circumferences of the hip, arm, leg and waist, waist-to-hip ratio, and body mass index, are of high significance in obesity and fitness evaluation. In this paper, we present a home based imaging system capable of conducting anthropometric measurements. Body images are acquired at different angles using a home camera and a simple rotating disk. Advanced image processing algorithms are utilized for 3D body surface reconstruction. A coarse body shape model is first established from segmented body silhouettes. Then, this model is refined through an inter-image consistency maximization process based on an energy function. Our experimental results using both a mannequin surrogate and a real human body validate the feasibility of the proposed system.

Parkinson's disease (PD) is a chronic progressive neurodegenerative disease that is clinically manifested by a triad of cardinal motor symptoms - rigidity, bradykinesia and tremor - due to loss of dopaminergic neurons. The motor symptoms of PD become progressively worse as the disease advances. PD is also a heterogeneous disease since rigidity and bradykinesia are the major complaints in some patients whereas tremor is predominant in others. In recent years, many studies have investigated the progression of the hallmark symptoms over time, and the cardinal motor symptoms have different rates of progression, with the disease usually progressing faster in patients with rigidity and bradykinesia than in those with predominant tremor. The current treatment regime of dopamine-replacement therapy improves motor symptoms and alleviates disability. Increasing the dosage of dopaminergic medication is commonly used to combat the worsening symptoms. However, the drug-induced involuntary body movements and motor complications can significantly contribute to overall disability. Further, none of the currently-available therapies can slow or halt the disease progression. Significant research efforts have been directed towards developing neuroprotective or disease-modifying agents that are intended to slow the progression. In this article, the most recent clinical studies investigating disease progression and current progress on the development of disease-modifying drug trials are reviewed.

A wearable computer, called eButton, has been developed for evaluation of the human lifestyle. This ARM-based device acquires multimodal data from a camera module, a motion sensor, an orientation sensor, a light sensor and a GPS receiver. Its performance has been tested both in our laboratory and by human subjects in free-living conditions. Our results indicate that eButton can record real-world data reliably, providing a powerful tool for the evaluation of lifestyle for a broad range of applications.

A new technique to extract and evaluate physical activity patterns from image sequences captured by a wearable camera is presented in this paper. Unlike standard activity recognition schemes, the video data captured by our device do not include the wearer him/herself. The physical activity of the wearer, such as walking or exercising, is analyzed indirectly through the camera motion extracted from the acquired video frames. Two key tasks, pixel correspondence identification and motion feature extraction, are studied to recognize activity patterns. We utilize a multiscale approach to identify pixel correspondences. When compared with the existing methods such as the Good Features detector and the Speed-up Robust Feature (SURF) detector, our technique is more accurate and computationally efficient. Once the pixel correspondences are determined which define representative motion vectors, we build a set of activity pattern features based on motion statistics in each frame. Finally, the physical activity of the person wearing a camera is determined according to the global motion distribution in the video. Our algorithms are tested using different machine learning techniques such as the K-Nearest Neighbor (KNN), Naive Bayesian and Support Vector Machine (SVM). The results show that many types of physical activities can be recognized from field acquired real-world video. Our results also indicate that, with a design of specific motion features in the input vectors, different classifiers can be used successfully with similar performances.

Postural synergies of the hand have been widely proposed in the literature, but only a few attempts were made to visualize temporal postural synergies, i.e., profiles of postural synergies varying over time. This paper aims to derive temporal postural synergies from kinematic synergies extracted from joint angular velocity profiles of rapid grasping movements. The rapid movements constrain the kinematic synergies to combine instantaneously, and thus, the movements can be approximated by a weighted summation of synchronous synergies. After being extracted by using singular value decomposition, the synchronous kinematic synergies were translated into temporal postural synergies, which revealed strategies of enslaving, metacarpal flexion for larger movements, and hierarchical recruitment of joints, adapted by subjects while grasping.

The strategy of human manual control is investigated in balancing an inverted pendulum under time-delay constraints. Experiments show that as the task becomes more difficult due to the increase in time delay, the human operator adopts a more discrete-like strategy. Interpretation of the discrete-control mechanism is provided by relating the observed human responses with a human-performance model.

Due to its large number of degrees of freedom and extensive connection to the brain, the human hand has been used to create channels of communication for a variety of human-machine systems. However, a fundamental question about the hand channel is still unanswered: what is its information capacity? This study aims to provide quantitative indication of effectiveness of the hand as a communication channel. We estimated that per gesture, the thumb and the index finger may deliver at most 10 and 7 bits of information, respectively. Based on this, we derived an upper bound for the information capacity of the hand in gesture-based communication: 150 b/s. Knowing this bound is critical to evaluating the potential and limitation of the hand channel for various forms of human-machine interactions.

This paper proposes an efficient method to acquire sources of tremor in patients with movement disorders based on blind source separation of convolutive mixtures. The extracted sources indicated neural activities that might be generated in the central nervous system. Four patients with essential tremor were tested in a set of movement tasks. Subjects wore a data glove that measured finger movements of the hand. The experimental data were then fed to a convolutive-mixture model, which revealed sources that imbibed in them the tremor frequency components of 2--8 Hz. Time--frequency analysis of these sources might be of potential help to clinicians to devise tasks that can manifest visible tremor from patients.

This paper presents a numerical approach using principal component analysis (PCA) to quantize and characterize the variance of hand postures in a novel posture transformation task. Five subjects were tested in two tasks in which a cursor can be moved by varying the hand posture. This was accomplished by weighted linear combination of 14 sensors of a data glove. The first task was to move a cursor on computer screen in one dimension horizontally, by posing various hand postures. To increase the complexity of control, in the second task, subjects were asked to move a cursor on computer screen in two dimensions. Joint angles were measured during the experiment by the data glove. In both tasks subjects participated in multiple trials until they achieved smooth cursor movement trajectories. PCA was performed over the postures obtained during the multiple trials of the two tasks. Across the trials, in both the tasks a gradual decrease in the number of principal components was observed. This implies that the variance in the postures decreases with learning. Additionally this might indicate that through learning, subjects adapted postural synergies (or eigen postures) in this novel geometrical environment. Postural synergies when visualized revealed task specific synergies.

This paper presents a numerical approach to prove the existence of inherent bimanual postural synergies while performing actions with two hands. Five subjects were tested in two different tasks. The first task was a well coordinated task where each subject screwed nut and bolt using one or both hands. In the second task, subjects were asked to perform several random postures with both hands. Joint angles were measured during the experiment by a pair of data gloves. Principal component analysis (PCA) was performed over the postures obtained during the tasks. In the first task, the number of postural synergies obtained for both hands together was less than the sum of the number of postural synergies for two hands. This is expected intuitively as first task was well coordinated. In the second task where there is no voluntary coordination involved, the number of postural synergies obtained for both hands together was still less than the sum of the number of postural synergies for two hands. This implies that there are innate bimanual synergies wired biomechanically to help brain in bimanual movements.

This paper presents time-varying synergies that were observed during reach and grasp experiments in angular velocity profiles of metacarpophalangeal (MCP) and proximal interphalangeal (PIP) joints of five fingers of the hand. Five right handed subjects were asked to reach and grasp 28 different objects and during this experiment joint angles were measured by a data glove. Our results showed that the angular velocity profiles for a period of 0.86 seconds of ten joints (two per finger) were accurately reproduced by using only 3 synergies in 28 different tasks. Interestingly, there were correlations between the object size and velocity profiles which lead to unique distinctions in the combinations of these synergies in achieving the natural movements.

This paper studies the behavior of recurrent neural networks with lateral inhibition. Such network architecture is important in biological neural systems. General conditions determining the existence, number, and stability of network equilibria are derived. The manner in which these features depend upon steepness of neuronal activation functions and the strength of lateral inhibition is demonstrated for a broad range of nondecreasing activation functions including the discontinuous threshold function which represents the infinite gain limit. For uniform lateral inhibitory networks, the lateral inhibition is shown to sharpen neuron output patterns by increasing separation of suprathreshold activity levels of competing neurons. This results in the tendency of one neuron's output to dominate those of the others which can afford a "winner-take-all" (WTA) mechanism. Importantly, multiple stable equilibria may exist and shifts in inputs levels may yield network state transitions that exhibit hysteresis. A limitation of using lateral inhibition to implement WTA is further demonstrated. The possible significance of these identified network dynamics to physiology and pathophysiology of the striatum (particularly in Parkinsonian rest tremor) is discussed.

This paper explores the limitations of sEMG (surface Electromyography) signals collected from the extrinsic muscles in the forearm in predicting the postures of human hand. Four subjects were asked to try ten extreme postures of hand which need high effort. Two of these four subjects were asked to try ten more normal postures which did not need effort During the experiments, muscle activity and static postures of the hand were measured. The data obtained were analyzed by principal component analysis. The results obtained revealed the limitations of sEMG signals of extrinsic muscles in reproducing the postures of the hand.