Search

Big data present new opportunities for modern society while posing challenges for data scientists. Recent advancements in sensor networks and the widespread adoption of the Internet of Things (IoT) have led to the collection of physical-sensor data on an enormous scale. However, significant challenges arise in conducting high-quality data analytics within the realm of big data. To uncover big data challenges and enhance data quality, it is essential to quantitatively unveil data characteristics. Furthermore, the existing studies lack analysis of the specific time-related characteristics of physical-sensor data. Enhancing the efficiency and precision of data analytics through the big data lifecycle requires a comprehensive understanding of data characteristics to address the hidden big data challenges. To fill in the research gap, this paper proposes a systematic data characteristic framework based on a 6Vs model. The framework aims to unveil the data characteristics in terms of data volume, variety, velocity, veracity, value, and variability through a set of statistical indicators. This model improves the objectivity of data characteristic understanding by relying solely on data-driven indicators. The indicators related to time-related characteristics in physical-sensor data are also included for the analysis of temporal aspects in the physical-sensor data. Furthermore, the big data challenges are linked to each dimension of the 6Vs model to gain a quantitative understanding of the data challenges. Finally, a pipeline is developed to implement the proposed framework, and two case studies are conducted to illustrate the process of understanding the physical-sensor data characteristics and making recommendations for data preprocessing to address the big data challenges. The proposed framework is able to analyze the characteristics of all physical-sensor data, therefore, identifying potential challenges in subsequent analytics, and providing recommendations for data preprocessing. Furthermore, the characteristic indicators can be used to analyze other types of big data. [ABSTRACT FROM AUTHOR]

This study aims to demonstrate a novel cloud big data system, s2Cloud, to enabled both smart and secure transmission and management of patient big data from Internet of Things (IoT), especially in the new common of long covid. More specifically, s2Cloud allows doctors to manage patient records effectively through the interactive web server. It further enables real-time, long-term, and continuous streaming and management of biomechanical dynamics from IoT phones/wearables. The big data can be visualized in both real-time and historical modes. Besides, s2Cloud achieves big data security through secure sign up and log in, as well as data transmission protection. It also allows doctor-patient interactions through instantaneous chat. s2Cloud has been evaluated on the real-world application, in which human IoT biomechanical dynamics are streamed, managed, stored, and visualized to demonstrate the effectiveness. Overall, the proposed system, empowered by smart and secure design innovations, has demonstrated the feasibility and potential for IoT big data-driven precision health. [ABSTRACT FROM AUTHOR]