Search

Gesture recognition is crucial in computer vision-based applications, such as drone control, gaming, virtual and augmented reality (VR/AR), and security, especially in human–computer interaction (HCI)-based systems. There are two types of gesture recognition systems, i.e., static and dynamic. However, our focus in this paper is on dynamic gesture recognition. In dynamic hand gesture recognition systems, the sequences of frames, i.e., temporal data, pose significant processing challenges and reduce efficiency compared to static gestures. These data become multi-dimensional compared to static images because spatial and temporal data are being processed, which demands complex deep learning (DL) models with increased computational costs. This article presents a novel triple-layer algorithm that efficiently reduces the 3D feature map into 1D row vectors and enhances the overall performance. First, we process the individual images in a given sequence using the MediaPipe framework and extract the regions of interest (ROI). The processed cropped image is then passed to the Inception-v3 for the 2D feature extractor. Finally, a long short-term memory (LSTM) network is used as a temporal feature extractor and classifier. Our proposed method achieves an average accuracy of more than 89.7%. The experimental results also show that the proposed framework outperforms existing state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Image processing on smartphones, which are resource-limited devices, is challenging. Panorama generation on modern mobile phones is a requirement of most mobile phone users. This paper presents an automatic sequential image stitching algorithm with high-resolution panorama generation and addresses the issue of stitching failure on smartphone devices. A robust method is used to automatically control the events involved in panorama generation from image capture to image stitching on Android operating systems. The image frames are taken in a firm spatial interval using the orientation sensor included in smartphone devices. The features-based stitching algorithm is used for panorama generation, with a novel modification to address the issue of stitching failure (inability to find local features causes this issue) when performing sequential stitching over mobile devices. We also address the issue of distortion in sequential stitching. Ultimately, in this study, we built an Android application that can construct a high-resolution panorama sequentially with automatic frame capture based on an orientation sensor and device rotation. We present a novel research methodology (called "Sense-Panorama") for panorama construction along with a development guide for smartphone developers. Based on our experiments, performed by Samsung Galaxy SM-N960N, which carries system on chip (SoC) as Qualcomm Snapdragon 845 and a CPU of 4 × 2.8 GHz Kyro 385, our method can generate a high-resolution panorama. Compared to the existing methods, the results show improvement in visual quality for both subjective and objective evaluation. [ABSTRACT FROM AUTHOR]

In the field of image processing and computer vision (CV), machine learning (ML) architectures are widely used. Image compression problems can be solved using convolutional neural networks (CNNs). As a result of bandwidth and memory constraints, compression of images is a necessity. There are three types of information found in images: useful, redundant, and irrelevant. In this survey, we will discuss how ML is used to compress lossy images. Firstly, we describe the background of lossy image compression. Next, we classify ML-based image compression frameworks into subgroups based on their architectures. Auto-encoders (AEs), variational auto-encoders (VAEs), CNNs, recurrent neural networks (RNNs), long short-term memories (LSTMs), gated recurrent units (GRUs), generative adversarial networks (GANs), transformers, principal component analysis (PCA) and fuzzy means clustering are among these subgroups. By analyzing learning-driven image compression frameworks, we present pros and cons of each subgroup. Lastly, we outline several research gaps and future research directions in the field of ML-based image compression. • Discussion about the background of image compression. • Classification of image compression frameworks into subgroups based on architectures. • Insight about open research problems and future research directions in learning-driven image compression. [ABSTRACT FROM AUTHOR]