Search

RGB and depth cameras are extensively used for the 3D tracking of human pose and motion. Typically, these cameras calculate a set of 3D points representing the human body as a skeletal structure. The tracking capabilities of a single camera are often affected by noise and inaccuracies due to occluded body parts. Multiple-camera setups offer a solution to maximize coverage of the captured human body and to minimize occlusions. According to best practices, fusing information across multiple cameras typically requires spatio-temporal calibration. First, the cameras must synchronize their internal clocks. This is typically performed by physically connecting the cameras to each other using an external device or cable. Second, the pose of each camera relative to the other cameras must be calculated (Extrinsic Calibration). The state-of-the-art methods use specialized calibration session and devices such as a checkerboard to perform calibration. In this paper, we introduce an approach to the spatio-temporal calibration of multiple cameras which is designed to run on-the-fly without specialized devices or equipment requiring only the motion of the human body in the scene. As an example, the system is implemented and evaluated using Microsoft Azure Kinect. The study shows that the accuracy and robustness of this approach is on par with the state-of-the-art practices. [ABSTRACT FROM AUTHOR]

Although camera and sensor noise are often disregarded, assumed negligible or dealt with in the context of denoising, in this paper we show that significant information can actually be deduced from camera noise about the captured scene and the objects within it. Specifically, we deal with depth cameras and their noise patterns. We show that from sensor noise alone, the object's depth and location in the scene can be deduced. Sensor noise can indicate the source camera type, and within a camera type the specific device used to acquire the images. Furthermore, we show that noise distribution on surfaces provides information about the light direction within the scene as well as allows to distinguish between real and masked faces. Finally, we show that the size of depth shadows (missing depth data) is a function of the object's distance from the background, its distance from the camera and the object's size. Hence, can be used to authenticate objects location in the scene. This paper provides tools and insights into what can be learned from depth camera sensor noise. [ABSTRACT FROM AUTHOR]

Unlike landmark methods for estimating object asymmetry, continuous symmetry measures (CSM) can be used to measure the symmetry distance (ds) of inconsistent objects, such as plant leaves. Inconsistent objects have no homologous landmarks, no consistent topology, no quantitative consistency, and sometimes no matching points. When CSM is used in conjugation with LAMINA Leaf Shape Determination software, one can quickly and efficiently process a large number of scanned leaves. LAMINA automatically generates equally-spaced points around the perimeter of each leaf and the resulting x-y coordinates are normalized to average centroid size prior to estimating ds using a fold, average, unfold algorithm. We estimated shape asymmetry of leaves of three species of flowering plants: Ligustrum sinense (Chinese Privet), Rubus cuneifolius (blackberry), and Perilla frutescens (Perilla), as well as individual leaves from a few species of oaks (Quercus) and maples (Acer). We found that 100 to 200 equally-spaced points worked well for all three of the main species. Measurement error accounted for a small proportion of the asymmetry variation. Nevertheless, measurement error was great enough to generate some negative size scaling after normalization to average centroid size. [ABSTRACT FROM AUTHOR]

Automating fall risk assessment, in an efficient, non-invasive manner, specifically in the elderly population, serves as an efficient means for implementing wide screening of individuals for fall risk and determining their need for participation in fall prevention programs. We present an automated and efficient system for fall risk assessment based on a multi-depth camera human motion tracking system, which captures patients performing the well-known and validated Berg Balance Scale (BBS). Trained machine learning classifiers predict the patient's 14 scores of the BBS by extracting spatio-temporal features from the captured human motion records. Additionally, we used machine learning tools to develop fall risk predictors that enable reducing the number of BBS tasks required to assess fall risk, from 14 to 4–6 tasks, without compromising the quality and accuracy of the BBS assessment. The reduced battery, termed Efficient-BBS (E-BBS), can be performed by physiotherapists in a traditional setting or deployed using our automated system, allowing an efficient and effective BBS evaluation. We report on a pilot study, run in a major hospital, including accuracy and statistical evaluations. We show the accuracy and confidence levels of the E-BBS, as well as the average number of BBS tasks required to reach the accuracy thresholds. The trained E-BBS system was shown to reduce the number of tasks in the BBS test by approximately 50% while maintaining 97% accuracy. The presented approach enables a wide screening of individuals for fall risk in a manner that does not require significant time or resources from the medical community. Furthermore, the technology and machine learning algorithms can be implemented on other batteries of medical tests and evaluations. [ABSTRACT FROM AUTHOR]

Fluctuating asymmetry consists of random deviations from perfect symmetry in populations of organisms. It is a measure of developmental noise, which reflects a population's average state of adaptation and coadaptation. Moreover, it increases under both environmental and genetic stress, though responses are often inconsistent. Researchers base studies of fluctuating asymmetry upon deviations from bilateral, radial, rotational, dihedral, translational, helical, and fractal symmetries. Here, we review old and new methods of measuring fluctuating asymmetry, including measures of dispersion, landmark methods for shape asymmetry, and continuous symmetry measures. We also review the theory, developmental origins, and applications of fluctuating asymmetry, and attempt to explain conflicting results. In the process, we present examples from the literature, and from our own research at "Evolution Canyon" and elsewhere. [ABSTRACT FROM AUTHOR]