Search

This article presents approaches, methods, and algorithms for the intellectualization of existing systems and development of fundamentally new systems of transformation of information into forms convenient for human perception. Interfaces with computer environments are proposed for text, voice, and visual ways of communication and their interaction. Information technologies are developed to create tools for training people with hearing impairments, communication with people with disabilities, in medicine, etc.

This paper investigates the intellectualization of text input using a system for accelerated input of texts into digital devices with a view to constructing a model of a corpus of the Ukrainian spoken language and a text typing system based on this model. Such a system uses a smaller number of commands to input letters and predicts variants of words on the basis of the corpus of words and word combinations for communication. It is experimentally shown that the input of texts using four and six command keys is rather efficient for the constructed corpus.

This paper presents an information technology based on modern IT devices (netbooks, tablets, phones, etc) and supporting an alternative communication for persons with (temporary or permanent) verbal communication disorders. It is proposed to implement this communication through the intellectualization of the process of entering text data with applying a limited number of relevant controls specified by a person's hand. A human skeleton model is investigated with a view to determining a limited number of hand configurations and motions reliably identified by recognition tools of IT devices.

This article presents new results on the solution of the problem of definition of efficient features and synthesis of an optimal band-separating classifier for elements of the dactyl alphabet of deaf sign language. Approaches to the qualitative evaluation of the separability of elements of dactyl alphabet for different feature spaces are considered. An algorithm is proposed for obtaining a hyperplane classifier separating groups of dactylemes in a feature space.

This article proposes mathematical models and an information technology for constructing movements of a virtual person and reproducing a sign language based on a set of gesture units and transitions between them. The implementation of movement reproduction in a virtual model allows obtaining a real-time animation of sign information. The efficiency of the proposed approach is illustrated by an example of modelling and identifying dactyl information.

Information and mathematical models are proposed for the animation of sign language communication based on a virtual human model. A model is developed to fix sign language morphemes and is used to create a technology and software to generate, store, and reproduce gestures. Algorithmic solutions are proposed for the computation of human-like trajectories of hand and body movements in passing from a gesture to another and also facial expressions and articulation.