Search

With the increase in the number of sensory substitution devices, the engineering community is confronted with a new challenge: ensuring user training in safe virtual environments before using these devices in real-life situations. We developed a game that uses an original sonification model, which, although not specific to a certain substitution device, can be an effective means of training for orientation in space based on audio stimuli. Thus, the game is not only a means of entertainment for visually impaired (VI) people but also one of training for the use of assistive devices. The game design and audio design are original contributions by the authors. The sonification model, which is crucial for a game dedicated to visually impaired people, is described in detail, both at the user and the implementation level. For better immersion, special sound design techniques have been used, such as ambisonic recordings and impulse response (IR) recordings. The game has been improved gradually, especially the sonification model, based on users’ feedback.

published

Design and develop a system that uses acoustic principles in order to create a user interactive system on a VR environment. The user will be able to interact with the environment, creating a sound response from the system created. En tiempos recientes, la evolución de los videojuegos ha sido posible debido a la mejora de sus contenidos visuales, para así recrear la realidad lo más rigurosamente posible. A pesar de ello, los contenidos de audio no han seguido el mismo camino, a pesar de que se ha demostrado su importancia para una experiencia totalmente envolvente (Lokki y Gröhn 2005). Las características auditivas y la acústica de espacios juegan un papel importante en recrear lugares reales (Larsson et al 2001; Gonot et al 2006; Podkosova et al 2016), los cuales llevan a una experiencia de inmersión total. Por esa razón, la pregunta principal a responder en este proyecto es la importancia de la acústica de salas para una inmersión total del jugador. Desarrollando un juego, este proyecto trabaja con diferentes tipos de acústica y espacios para evaluar las reacciones del jugador. Además, diferentes fuentes sonoras son utilizadas para crear una sensación de localización del espacio para el jugador, y la utilidad de dicha técnica es evaluada. En temps recents, l'evolució dels videojocs ha estat possible degut a la millora dels seus continguts visuals, per així recrear la realitat el més rigurosament possible. Tot i això, els continguts d'àudio no han seguit el mateix camí, tot i que s'ha demostrat la seva importància per a una experiència totalment envolvent (Lokki i Gröhn 2005). Les característiques auditives i l'acústica d'espais juguen un paper important en recrear espais reals (Larsson et al 2001; Gonot et al 2006; Podkosova et al 2016), els quals porten a una experiència d'immersió total. Degut a això, la pregunta principal a respondre en aquest projecte és la importància de l'acústica de sales per a una immersió total del jugador. Desenvolupant un joc, aquest projecte treballa amb diferents tipus d'acústiques i espais per avaluar les reaccions del jugador. A més, diferents fonts sonores són utilitzades per crear una sensació de localització de l'espai per al jugador, avaluant-ne la utilitat. In recent times, the evolution of video games has made possible the improvement of their visual contents in order to recreate reality as accurate as possible. Nevertheless, audio contents have not followed the same path, even though it has been proved its importance in a full immersive experience (Lokki and Gröhn 2005). Aural characteristics and room acoustics play an important role in recreating a real environment (Larsson et al 2001; Gonot et al 2006; Podkosova et al 2016), leading to a full immersive experience. Because of that, the main question to answer in this project is the importance of room acoustics for a full immersive experience of the player. Developing a game, this project works with different types of room acoustics and spaces to evaluate the player’s reactions towards them. Additionally, different audio sources are used in order to create a sense of space location to the player, whose usefulness is evaluated.

Design and develop a system that uses acoustic principles in order to create a user interactive system on a VR environment. The user will be able to interact with the environment, creating a sound response from the system created. En tiempos recientes, la evolución de los videojuegos ha sido posible debido a la mejora de sus contenidos visuales, para así recrear la realidad lo más rigurosamente posible. A pesar de ello, los contenidos de audio no han seguido el mismo camino, a pesar de que se ha demostrado su importancia para una experiencia totalmente envolvente (Lokki y Gröhn 2005). Las características auditivas y la acústica de espacios juegan un papel importante en recrear lugares reales (Larsson et al 2001; Gonot et al 2006; Podkosova et al 2016), los cuales llevan a una experiencia de inmersión total. Por esa razón, la pregunta principal a responder en este proyecto es la importancia de la acústica de salas para una inmersión total del jugador. Desarrollando un juego, este proyecto trabaja con diferentes tipos de acústica y espacios para evaluar las reacciones del jugador. Además, diferentes fuentes sonoras son utilizadas para crear una sensación de localización del espacio para el jugador, y la utilidad de dicha técnica es evaluada. En temps recents, l'evolució dels videojocs ha estat possible degut a la millora dels seus continguts visuals, per així recrear la realitat el més rigurosament possible. Tot i això, els continguts d'àudio no han seguit el mateix camí, tot i que s'ha demostrat la seva importància per a una experiència totalment envolvent (Lokki i Gröhn 2005). Les característiques auditives i l'acústica d'espais juguen un paper important en recrear espais reals (Larsson et al 2001; Gonot et al 2006; Podkosova et al 2016), els quals porten a una experiència d'immersió total. Degut a això, la pregunta principal a respondre en aquest projecte és la importància de l'acústica de sales per a una immersió total del jugador. Desenvolupant un joc, aquest projecte treballa amb diferents tipus d'acústiques i espais per avaluar les reaccions del jugador. A més, diferents fonts sonores són utilitzades per crear una sensació de localització de l'espai per al jugador, avaluant-ne la utilitat. In recent times, the evolution of video games has made possible the improvement of their visual contents in order to recreate reality as accurate as possible. Nevertheless, audio contents have not followed the same path, even though it has been proved its importance in a full immersive experience (Lokki and Gröhn 2005). Aural characteristics and room acoustics play an important role in recreating a real environment (Larsson et al 2001; Gonot et al 2006; Podkosova et al 2016), leading to a full immersive experience. Because of that, the main question to answer in this project is the importance of room acoustics for a full immersive experience of the player. Developing a game, this project works with different types of room acoustics and spaces to evaluate the player’s reactions towards them. Additionally, different audio sources are used in order to create a sense of space location to the player, whose usefulness is evaluated.

Technology applications including games are generally not designed with the blind or visually impaired in mind. This is an invaluable area of research as it is this population that would benefit the most from accessible technology enabling inclusion and participation in society. "Nobody makes games for us" was a motivator for this research. This paper describes the process of creating a set of audio games for the visually impaired. The principles of audio game design are discussed and based upon these the Audio Game Hub is proposed. Audio Game Hub is currently a set of four audio games that have suitable interfaces for the visually impaired. Audio Game Hub is currently available for download on multiple platforms and has seen popularity with both visually impaired and normal sighted players, which provides an area for future research. Technology applications including games are generally not designed with the blind or visually impaired in mind. This is an invaluable area of research as it is this population that would benefit the most from accessible technology enabling inclusion and participation in society. "Nobody makes games for us" was a motivator for this research. This paper describes the process of creating a set of audio games for the visually impaired. The principles of audio game design are discussed and based upon these the Audio Game Hub is proposed. Audio Game Hub is currently a set of four audio games that have suitable interfaces for the visually impaired. Audio Game Hub is currently available for download on multiple platforms and has seen popularity with both visually impaired and normal sighted players, which provides an area for future research.

This article discusses the potential of audio games based on the evaluation of three projects: a story-driven audio role-playing game (RPG), an interactive audiobook with RPG elements, and a set of casual sound-based games. The potential is understood, both in popularity and playability terms. The first factor is connected to the degree of players’ interest, while the second one to the degree of their engagement in sound-based game worlds. Although presented projects are embedded within the landscape of past and contemporary audio games and gaming platforms, the authors reach into the near future, concluding with possible development directions for this non-visual interactive entertainment.

This paper presents a game for mobile devices which simulates a tennis match between two players. It is an audio-based game, so the majority of information and feedback to the user is given through sound instead of being displayed on a screen. As users are not requested to keep their eyes on the display, the device can be used as a motion-based controller, exploiting its internal motion sensors to their full potential. The game aims to be useful for both entertainment and educational purposes, and enjoyable both by visually-impaired (the main target audience for audio-based games nowadays) and sighted users.

This paper presents an audio-based tennis simulation game for mobile devices, which uses motion input and non-verbal audio feedback as exclusive means of interaction. Players have to listen carefully to the provided auditory clues, like racquet hits and ball bounces, rhythmically synchronizing their movements in order to keep the ball into play. The device can be swung freely and act as a full-fledged motionbased controller, as the game does not rely at all on visual feedback and the device display can thus be ignored. The game aims to be entertaining but also effective for educational purposes, such as ear training or improvement of the sense of timing, and enjoyable both by visually-impaired and sighted users.