Search

This work introduces the design, architecture, implementation, and testing of a low-cost and machine-learning-enabled device to be worn on the wrist. The suggested wearable device has been developed for use during emergency incidents of large passenger ship evacuations, and enables the real-time monitoring of the passengers' physiological state, and stress detection. Based on a properly preprocessed PPG signal, the device provides essential biometric data (pulse rate and oxygen saturation level) and an efficient unimodal machine learning pipeline. The stress detecting machine learning pipeline is based on ultra-short-term pulse rate variability, and has been successfully integrated into the microcontroller of the developed embedded device. As a result, the presented smart wristband is able to provide real-time stress detection. The stress detection system has been trained with the use of the publicly available WESAD dataset, and its performance has been tested through a two-stage process. Initially, evaluation of the lightweight machine learning pipeline on a previously unseen subset of the WESAD dataset was performed, reaching an accuracy score equal to 91%. Subsequently, external validation was conducted, through a dedicated laboratory study of 15 volunteers subjected to well-acknowledged cognitive stressors while wearing the smart wristband, which yielded an accuracy score equal to 76%. [ABSTRACT FROM AUTHOR]

The evacuation and abandonment of large passenger ships, involving thousands of passengers, is a safety-critical task where techniques and systems that can improve the complex decision-making process and the timely response to emergencies on board are of vital importance. Current evacuation systems and processes are based on predefined and static exit signs, information provided to the passengers in the form of evacuation drills, emergency information leaflets and public announcements systems. It is mandatory for passengers to wear lifejackets during an evacuation, which are made of buoyant or inflatable material to keep them afloat in the water. Time is the most critical attribute in ship evacuation and can significantly affect the overall evacuation process in case passengers do not reach their embarkation stations in a timely manner. Moreover, extreme conditions and hazards, such as fire or flooding, can prevent and hinder the timely evacuation process. To improve the current evacuation systems onboard large passenger ships, a smart lifejacket has been designed and implemented within the context of the project SafePASS. The proposed smart lifejacket integrates indoor localization and navigation functionality to assist passengers during the evacuation process. Once the passenger location is calculated within the ship, the navigation feature guides the passengers along an escape route using vibration motors attached to the lifejacket. This is done in the form of haptic cues to help passengers reach their destination, especially in low-visibility conditions and in case they are left behind or lost. This can increase passenger safety and reduce the total evacuation time, as well as support dynamic evacuation scenarios where the predefined routes and static exit routes may not be available due to fire or flooding incidents. [ABSTRACT FROM AUTHOR]

Advances in Artificial intelligence (AI) and embedded systems have resulted on a recent increase in use of image processing applications for smart cities' safety. This enables a cost-adequate scale of automated video surveillance, increasing the data available and releasing human intervention. At the same time, although deep learning is a very intensive task in terms of computing resources, hardware and software improvements have emerged, allowing embedded systems to implement sophisticated machine learning algorithms at the edge. Additionally, new lightweight open-source middleware for constrained resource devices, such as EdgeX Foundry, have appeared to facilitate the collection and processing of data at sensor level, with communication capabilities to exchange data with a cloud enterprise application. The objective of this work is to show and describe the development of two Edge Smart Camera Systems for safety of Smart cities within S4AllCities H2020 project. Hence, the work presents hardware and software modules developed within the project, including a custom hardware platform specifically developed for the deployment of deep learning models based on the I.MX8 Plus from NXP, which considerably reduces processing and inference times; a custom Video Analytics Edge Computing (VAEC) system deployed on a commercial NVIDIA Jetson TX2 platform, which provides high level results on person detection processes; and an edge computing framework for the management of those two edge devices, namely Distributed Edge Computing framework, DECIoT. To verify the utility and functionality of the systems, extended experiments were performed. The results highlight their potential to provide enhanced situational awareness and demonstrate the suitability for edge machine vision applications for safety in smart cities. [ABSTRACT FROM AUTHOR]

Nowadays, the transformations of cities into smart cities is a crucial factor in improving the living conditions of the inhabitants as well as addressing emergency situations under the concept of public safety and property loss. In this context, many sensing systems have been designed and developed that provide fire detection and gas leakage alerts. On the other hand, new technologies such edge computing have gained significant attention in recent years. Moreover, the development of recent intelligent applications in IoT aims to integrate several types of systems with automated next-generation emergency calls in case of a serious accident. Currently, there is a lack of studies that combine all the aforementioned technologies. The proposed smart building sensor system, SB112, combines a small-size multisensor-based (temperature, humidity, smoke, flame, CO, LPG, and CNG) scheme with an open-source edge computing framework and automated Next Generation (NG) 112 emergency call functionality. It involves crucial actors such as IoT devices, a Public Safety Answering Point (PSAP), the middleware of a smart city platform, and relevant operators in an end-to-end manner for real-world scenarios. To verify the utility and functionality of the proposed system, a representative end-to-end experiment was performed, publishing raw measurements from sensors as well as a fire alert in real time and with low latency (average latency of 32 ms) to the middleware of a smart city platform. Once the fire was detected, a fully automatic NG112 emergency call to a PSAP was performed. The proposed methodology highlights the potential of the SΒ112 system for exploitation by decision-makers or city authorities. [ABSTRACT FROM AUTHOR]

Maritime operations rely heavily on surveillance and require reliable and timely data that can inform decisions and planning. Critical information in such cases includes the exact location of objects in the water, such as vessels, persons, and others. Due to the unique characteristics of the maritime environment, the location of even inert objects changes through time, depending on the weather conditions, water currents, etc. Unmanned aerial vehicles (UAVs) can be used to support maritime operations by providing live video streams and images from the area of operations. Machine learning algorithms can be developed, trained, and used to automatically detect and track objects of specific types and characteristics. EFFECTOR is an EU-funded project, developing an Interoperability Framework for maritime surveillance. Within the project, we developed an embedded system that employs machine learning algorithms, allowing a UAV to autonomously detect objects in the water and keep track of their changing position through time. Using the on-board computation unit of the UAV, we ran and present the results of a series of comparative tests among possible architecture sizes and training datasets for the detection and tracking of objects in the maritime environment. We tested architectures based on their efficiency, accuracy, and speed. A combined solution for training the datasets is suggested, providing optimal efficiency and accuracy. [ABSTRACT FROM AUTHOR]

Ensuring citizens' safety and security has been identified as the number one priority for city authorities when it comes to the use of smart city technologies. Automatic understanding of the scene, and the associated provision of situational awareness for emergency situations, are able to efficiently contribute to such domains. In this study, a Video Analytics Edge Computing (VAEC) system is presented that performs real-time enhanced situation awareness for person detection in a video surveillance manner that is also able to share geolocated person detection alerts and other accompanied crucial information. The VAEC system adopts state-of-the-art object detection and tracking algorithms, and it is integrated with the proposed Distribute Edge Computing Internet of Things (DECIoT) platform. The aforementioned alerts and information are able to be shared, though the DECIoT, to smart city platforms utilizing proper middleware. To verify the utility and functionality of the VAEC system, extended experiments were performed (i) in several light conditions, (ii) using several camera sensors, and (iii) in several use cases, such as installed in fixed position of a building or mounted to a car. The results highlight the potential of VAEC system to be exploited by decision-makers or city authorities, providing enhanced situational awareness. [ABSTRACT FROM AUTHOR]

Visual sensing of the environment is crucial for flying an unmanned aerial vehicle (UAV) and is a centerpiece of many related applications. The ability to run computer vision and machine learning algorithms onboard an unmanned aerial system (UAS) is becoming more of a necessity in an effort to alleviate the communication burden of high-resolution video streaming, to provide flying aids, such as obstacle avoidance and automated landing, and to create autonomous machines. Thus, there is a growing interest on the part of many researchers in developing and validating solutions that are suitable for deployment on a UAV system by following the general trend of edge processing and airborne computing, which transforms UAVs from moving sensors into intelligent nodes that are capable of local processing. In this paper, we present, in a rigorous way, the design and implementation of a 12.85 kg UAV system equipped with the necessary computational power and sensors to serve as a testbed for image processing and machine learning applications, explain the rationale behind our decisions, highlight selected implementation details, and showcase the usefulness of our system by providing an example of how a sample computer vision application can be deployed on our platform. [ABSTRACT FROM AUTHOR]

Situational awareness is a critical aspect of the decision-making process in emergency response and civil protection and requires the availability of up-to-date information on the current situation. In this context, the related research should not only encompass developing innovative single solutions for (real-time) data collection, but also on the aspect of transforming data into information so that the latter can be considered as a basis for action and decision making. Unmanned systems (UxV) as data acquisition platforms and autonomous or semi-autonomous measurement instruments have become attractive for many applications in emergency operations. This paper proposes a multipurpose situational awareness platform by exploiting advanced on-board processing capabilities and efficient computer vision, image processing, and machine learning techniques. The main pillars of the proposed platform are: (1) a modular architecture that exploits unmanned aerial vehicle (UAV) and terrestrial assets; (2) deployment of on-board data capturing and processing; (3) provision of geolocalized object detection and tracking events; and (4) a user-friendly operational interface for standalone deployment and seamless integration with external systems. Experimental results are provided using RGB and thermal video datasets and applying novel object detection and tracking algorithms. The results show the utility and the potential of the proposed platform, and future directions for extension and optimization are presented. [ABSTRACT FROM AUTHOR]