Search

Background: In the demanding field of live news broadcasting, the intricate studio production procedures and tight schedules pose significant challenges for physical rehearsals by cameramen. This paper explores the design and implementation of a lightweight virtual news previsualization system, leveraging virtual production technology and interaction design methods to address the lack of fidelity in presentations and manipulations, and the quantitative feedback of rehearsal effects in previous virtual approaches. Methods: Our system, Previs-Real, is informed by user investigation with professional cameramen and studio technicians, and adheres to principles of high fidelity, accurate replication of actual hardware operations, and real-time feedback on rehearsal results. The system's software and hardware development are implemented based on Unreal Engine and accompanying toolsets, incorporating cutting-edge modeling and camera calibration methods. Results: We validated Previs-Real through a user study, demonstrating superior performance in previsualization shooting tasks using the virtual system compared to traditional camera setups. The findings, supported by both objective performance metrics and subjective responses, underline Previs-Real's effectiveness and potential in transforming news broadcasting rehearsals. Conclusions: Previs-Real eliminates the requirement for complex equipment interconnections and team coordination inherent in a physical studio by implementing methodologies complying the above principles, objectively resulting in a lightweight design of applicable version of virtual news previsualization system. It offers a novel solution to the challenges in news studio previsualization by focusing on key operational features rather than full environment replication. This design approach is equally effective in the process of designing lightweight systems in other fields.

Abstract Traditional orthodontic treatment relies on subjective estimations of orthodontists and iterative communication with technicians to achieve desired tooth alignments. This process is time-consuming, complex, and highly dependent on the orthodontist’s experience. With the development of artificial intelligence, there’s a growing interest in leveraging deep learning methods to achieve tooth alignment automatically. However, the absence of publicly available datasets containing pre/post-orthodontic 3D dental models has impeded the advancement of intelligent orthodontic solutions. To address this limitation, this paper proposes the first public 3D orthodontic dental dataset, comprising 1,060 pairs of pre/post-treatment dental models sourced from 435 patients. The proposed dataset encompasses 3D dental models with diverse malocclusion, e.g., tooth crowding, deep overbite, and deep overjet; and comprehensive professional annotations, including tooth segmentation labels, tooth position information, and crown landmarks. We also present technical validations for tooth alignment and orthodontic effect evaluation. The proposed dataset is expected to contribute to improving the efficiency and quality of target tooth position design in clinical orthodontic treatment utilizing deep learning methods.

Abstract Mixed emotions have attracted increasing interest recently, but existing datasets rarely focus on mixed emotion recognition from multimodal signals, hindering the affective computing of mixed emotions. On this basis, we present a multimodal dataset with four kinds of signals recorded while watching mixed and non-mixed emotion videos. To ensure effective emotion induction, we first implemented a rule-based video filtering step to select the videos that could elicit stronger positive, negative, and mixed emotions. Then, an experiment with 80 participants was conducted, in which the data of EEG, GSR, PPG, and frontal face videos were recorded while they watched the selected video clips. We also recorded the subjective emotional rating on PANAS, VAD, and amusement-disgust dimensions. In total, the dataset consists of multimodal signal data and self-assessment data from 73 participants. We also present technical validations for emotion induction and mixed emotion classification from physiological signals and face videos. The average accuracy of the 3-class classification (i.e., positive, negative, and mixed) can reach 80.96% when using SVM and features from all modalities, which indicates the possibility of identifying mixed emotional states.

The generalized convex nearly isotonic regression problem addresses a least squares regression model that incorporates both sparsity and monotonicity constraints on the regression coefficients. In this paper, we introduce an efficient semismooth Newton-based augmented Lagrangian (Ssnal) algorithm to solve this problem. We demonstrate that, under reasonable assumptions, the Ssnal algorithm achieves global convergence and exhibits a linear convergence rate. Computationally, we derive the generalized Jacobian matrix associated with the proximal mapping of the generalized convex nearly isotonic regression regularizer and leverage the second-order sparsity when applying the semismooth Newton method to the subproblems in the Ssnal algorithm. Numerical experiments conducted on both synthetic and real datasets clearly demonstrate that our algorithm significantly outperforms first-order methods in terms of efficiency and robustness.

Plant sensors are commonly used in agricultural production, landscaping, and other fields to monitor plant growth and environmental parameters. As an important basic parameter in plant monitoring, leaf inclination angle (LIA) not only influences light absorption and pesticide loss but also contributes to genetic analysis and other plant phenotypic data collection. The measurements of LIA provide a basis for crop research as well as agricultural management, such as water loss, pesticide absorption, and illumination radiation. On the one hand, existing efficient solutions, represented by light detection and ranging (LiDAR), can provide the average leaf angle distribution of a plot. On the other hand, the labor-intensive schemes represented by hand measurements can show high accuracy. However, the existing methods suffer from low automation and weak leaf–plant correlation, limiting the application of individual plant leaf phenotypes. To improve the efficiency of LIA measurement and provide the correlation between leaf and plant, we design an image-phenotype-based noninvasive and efficient optical sensor measurement system, which combines multi-processes implemented via computer vision technologies and RGB images collected by physical sensing devices. Specifically, we utilize object detection to associate leaves with plants and adopt 3-dimensional reconstruction techniques to recover the spatial information of leaves in computational space. Then, we propose a spatial continuity-based segmentation algorithm combined with a graphical operation to implement the extraction of leaf key points. Finally, we seek the connection between the computational space and the actual physical space and put forward a method of leaf transformation to realize the localization and recovery of the LIA in physical space. Overall, our solution is characterized by noninvasiveness, full-process automation, and strong leaf–plant correlation, which enables efficient measurements at low cost. In this study, we validate Auto-LIA for practicality and compare the accuracy with the best solution that is acquired with an expensive and invasive LiDAR device. Our solution demonstrates its competitiveness and usability at a much lower equipment cost, with an accuracy of only 2. 5° less than that of the widely used LiDAR. As an intelligent processing system for plant sensor signals, Auto-LIA provides fully automated measurement of LIA, improving the monitoring of plant physiological information for plant protection. We make our code and data publicly available at http://autolia.samlab.cn.

Abstract Positive human–agent relationships can effectively improve human experience and performance in human–machine systems or environments. The characteristics of agents that enhance this relationship have garnered attention in human–agent or human–robot interactions. In this study, based on the rule of the persona effect, we study the effect of an agent’s social cues on human–agent relationships and human performance. We constructed a tedious task in an immersive virtual environment, designing virtual partners with varying levels of human likeness and responsiveness. Human likeness encompassed appearance, sound, and behavior, while responsiveness referred to the way agents responded to humans. Based on the constructed environment, we present two studies to explore the effects of an agent’s human likeness and responsiveness to agents on participants’ performance and perception of human–agent relationships during the task. The results indicate that when participants work with an agent, its responsiveness attracts attention and induces positive feelings. Agents with responsiveness and appropriate social response strategies have a significant positive effect on human–agent relationships. These results shed some light on how to design virtual agents to improve user experience and performance in human–agent interactions.

Despite the recent advances in artificial tissue and organ engineering, how to generate large size viable and functional complex organs still remains as a grand challenge for regenerative medicine. Three-dimensional bioprinting has demonstrated its advantages as one of the major methods in fabricating simple tissues, yet it still faces difficulties to generate vasculatures and preserve cell functions in complex organ production. Here, we overcome the limitations of conventional bioprinting systems by converting a six degree-of-freedom robotic arm into a bioprinter, therefore enables cell printing on 3D complex-shaped vascular scaffolds from all directions. We also developed an oil bath-based cell printing method to better preserve cell natural functions after printing. Together with a self-designed bioreactor and a repeated print-and-culture strategy, our bioprinting system is capable to generate vascularized, contractible, and long-term survived cardiac tissues. Such bioprinting strategy mimics the in vivo organ development process and presents a promising solution for in vitro fabrication of complex organs.

Abstract Rapid development of artificial intelligence motivates researchers to expand the capabilities of intelligent and autonomous robots. In many robotic applications, robots are required to make planning decisions based on perceptual information to achieve diverse goals in an efficient and effective way. The planning problem has been investigated in active robot vision, in which a robot analyzes its environment and its own state in order to move sensors to obtain more useful information under certain constraints. View planning, which aims to find the best view sequence for a sensor, is one of the most challenging issues in active robot vision. The quality and efficiency of view planning are critical for many robot systems and are influenced by the nature of their tasks, hardware conditions, scanning states, and planning strategies. In this paper, we first summarize some basic concepts of active robot vision, and then review representative work on systems, algorithms and applications from four perspectives: object reconstruction, scene reconstruction, object recognition, and pose estimation. Finally, some potential directions are outlined for future work.

Cartoon faces are widely used in social media, animation production, and social robots because of their attractive ability to convey different emotional information. Despite their popular applications, the mechanisms of recognizing emotional expressions in cartoon faces are still unclear. Therefore, three experiments were conducted in this study to systematically explore a recognition process for emotional cartoon expressions (happy, sad, and neutral) and to examine the influence of key facial features (mouth, eyes, and eyebrows) on emotion recognition. Across the experiments, three presentation conditions were employed: (1) a full face; (2) individual feature only (with two other features concealed); and (3) one feature concealed with two other features presented. The cartoon face images used in this study were converted from a set of real faces acted by Chinese posers, and the observers were Chinese. The results show that happy cartoon expressions were recognized more accurately than neutral and sad expressions, which was consistent with the happiness recognition advantage revealed in real face studies. Compared with real facial expressions, sad cartoon expressions were perceived as sadder, and happy cartoon expressions were perceived as less happy, regardless of whether full-face or single facial features were viewed. For cartoon faces, the mouth was demonstrated to be a feature that is sufficient and necessary for the recognition of happiness, and the eyebrows were sufficient and necessary for the recognition of sadness. This study helps to clarify the perception mechanism underlying emotion recognition in cartoon faces and sheds some light on directions for future research on intelligent human-computer interactions.

The behavioral differentiation of positive emotions has recently been studied in terms of their discrete adaptive functions or appraising profiles. Some preliminary neurophysiological evidences have been found with electroencephalography or autonomic nervous system measurements such as heart rate, skin conductance, etc. However, the brain’s hemodynamic responses to different positive emotions remain largely unknown. In the present study, the functional near-infrared spectroscopy (fNIRS) technique was employed. With this tool, we for the first time reported recognizable discrete positive emotions using fNIRS signals. Thirteen participants watched 30 emotional video clips to elicit 10 typical kinds of positive emotions (joy, gratitude, serenity, interest, hope, pride, amusement, inspiration, awe, and love), and their frontal neural activities were simultaneously recorded with a 24-channel fNIRS system. The multidimensional scaling analysis of participants’ subjective ratings on these 10 positive emotions revealed three distinct clusters, which could be interpreted as “playfulness” for amusement, joy, interest, “encouragement” for awe, gratitude, hope, inspiration, pride, and “harmony” for love, serenity. Hemodynamic responses to these three positive emotion clusters showed distinct patterns, and HbO-based individual-level binary classifications between them achieved an averaged accuracy of 73.79 ± 11.49% (77.56 ± 7.39% for encouragement vs. harmony, 73.29 ± 11.87% for playfulness vs. harmony, 70.51 ± 13.96% for encouragement vs. harmony). Benefited from fNIRS’s high portability, low running cost and the relative robustness against motion and electrical artifacts, our findings provided support for implementing a more fine-grained emotion recognition system with subdivided positive emotion categories.

In this article, we present a human experience–inspired path planning algorithm for service robots. In addition to considering the path distance and smoothness, we emphasize the safety of robot navigation. Specifically, we build a speed field in accordance with several human driving experiences, like slowing down or detouring at a narrow aisle, and keeping a safe distance to the obstacles. Based on this speed field, the path curvatures, path distance, and steering speed are all integrated to form an energy function, which can be efficiently solved by the A* algorithm to seek the optimal path by resorting to an admissible heuristic function estimated from the energy function. Moreover, a simple yet effective fast path smoothing algorithm is proposed so as to ease the robots steering. Several examples are presented, demonstrating the effectiveness of our human experience–inspired path planning method.