Search

Copyright of Notfall & Rettungsmedizin is the property of Springer Nature and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Background: Sonified biofeedback is a subtype of auditory biofeedback that conveys biological data through specific non-verbal sounds. It can be designed to provide augmented biomechanical feedback in near-real-time when provided as "concurrent" biofeedback. As a practice that developed spanning across engineering and the arts, sonified biofeedback can extend beyond simple tones and beeps, towards more fully incorporating music in movement training. Sonified biofeedback may leverage the motivational aspects of music in movement training, the neuroplasticity benefits demonstrated from participation in music-based interventions, and neurological auditory-motor coupling, all while providing task-relevant cues to facilitate motor (re)learning. Sonified biofeedback may also provide similar benefits as rhythmic cueing (e.g., rhythmic auditory stimulation), or added benefits because sonified biofeedback does not impose a strict isochronous rhythm when it follows rhythms that are driven by outputs of the motor control system. In this review paper, the unique opportunity presented by concurrent sonified biofeedback as a movement training tool for balance and gait is introduced and discussed. Results and discussion: This review paper brings together prior research from clinical, engineering, and artistic design sources using sonified biofeedback in balance and gait training across diverse end-users to highlight trends, reveal gaps in knowledge, and provide perspective for future work in the area. The goal was to review progress and critically assess research using sonified biofeedback during movement training for postural control or gait. 49 papers were selected based on their experimental investigation and statistical analyses of the effects of using sonified biofeedback to assist in movement training for feet-in-place balance tasks (20 papers) or gait tasks such as walking and running (29 papers). The sound design choices, experimental design features, and movement training results are summarized and reviewed. All but two studies reported at least one statistically significant positive effect of training with sonified biofeedback in biomechanical, clinical, or psychosocial measures. Conversely, only seven studies shared any negative effect on one biomechanical, clinical, or psychosocial measure (with five of these studies also reporting at least one other positive effect). After describing these encouraging findings, this review closes by sharing perspectives about future directions for designing and using sonified biofeedback in balance and gait training, and opportunities for more cohesive growth in this practice. One such suggestion is to pursue sonified designs and experimental designs that can translate to the neurorehabilitation field. This includes strategically selecting control groups and evaluation tasks to understand if improvements from training with one task transfer to additional relevant movement tasks. Additionally, it is important that future publications share details about the design processes and sound designs so researchers can more readily learn from one another. Conclusions: Overall, this review shares the positive impact of using sonified biofeedback in balance and gait training. This review highlights the evidence of existing successes and potential for even more impactful future positive effects from using sonified biofeedback to help diverse populations with a spectrum of balance and mobility challenges and goals. [ABSTRACT FROM AUTHOR]

Introduction: The present article reports on a case study aimed at improving STEAM education in secondary schools. It discusses the use of sonification as a teaching strategy to integrate music into science learning, using different approaches from data audification to parameter mapping into aural models and to the rewriting of song lyrics based on STEM topics. Methods: A qualitative research study has been performed in a secondary school in the school district of Bari (South of Italy). More specifically, students' and experts' perceptions of experienced sonification activities have been collected through six rounds of focus group interviews. Results: While there was a good improvement in student achievement in science, it is worth noting how musical activities also led to some benefits for students involved in the sonification workshops. The integration of music with STEM disciplines has promoted more cooperation and empathy among the students. Additionally, musical inputs can help students discover and regain interest in music. However, the study also highlighted the differences in teacher training and content knowledge, suggesting the need for future research to consider broader samples and experimental designs. Discussion: Results and implications for educational research and practice are discussed considering the recent literature on STEAM. Finally, this study demonstrates the importance of a robust instructional design for sonification activities, so that they can be more effective, aligned with the school curriculum, and integrated into the classroom teaching-learning process. [ABSTRACT FROM AUTHOR]

Background/Objectives: Gait retraining is widely used in orthopedic rehabilitation to address abnormal movement patterns. However, retaining walking modifications can be challenging without guidance from physical therapists. Real-time auditory biofeedback can help patients learn and maintain gait alterations. This study piloted the feasibility of the musification of feedback to medialize the center of pressure (COP). Methods: To provide musical feedback, COP and plantar pressure were captured in real time at 100 Hz from a wireless 16-sensor pressure insole. Twenty healthy subjects (29 ± 5 years old, 75.9 ± 10.5 Kg, 1.73 ± 0.07 m) were recruited to walk using this system and were further analyzed via marker-based motion capture. A lowpass filter muffled a pre-selected music playlist when the real-time center of pressure exceeded a predetermined lateral threshold. The only instruction participants received was to adjust their walking to avoid the muffling of the music. Results: All participants significantly medialized their COP (−9.38% ± 4.37, range −2.3% to −19%), guided solely by musical feedback. Participants were still able to reproduce this new walking pattern when the musical feedback was removed. Importantly, no significant changes in cadence or walking speed were observed. The results from a survey showed that subjects enjoyed using the system and suggested that they would adopt such a system for rehabilitation. Conclusions: This study highlights the potential of musical feedback for orthopedic rehabilitation. In the future, a portable system will allow patients to train at home, while clinicians could track their progress remotely through cloud-enabled telemetric health data monitoring. [ABSTRACT FROM AUTHOR]

Introduction: In recent years, music-based therapeutic interventions have evolved to integrate technological supports, bridging the gap between more traditional music therapy practices (linked to active or receptive relational settings) and other music-based practices that focus on therapeutic/rehabilitative aspects through the direct action of sound on the patient/client. These novel approaches maintain the characteristics of therapeutic interventions while differentiating themselves from more traditional music therapy through the integration of technological supports, directly or indirectly facilitating its implementation. Method: The article reports some application and research experiences carried out in a music therapy research laboratory. For each experience, the therapeutic rationale and possible clinical applications are described, and results obtained from some studies are presented. Results: The first example involves the use of sonification techniques mediated by the use of sensors and applied in the context of neuromotor rehabilitation. The second example involves the use of an algorithm (Melomics-Health) designed to create music specifically for therapeutic purposes. The third example refers to the possibility of employing machine learning techniques and/or artificial neural networks to identify predictive factors of success or relevance in therapeutic interventions with music. Discussion: The paper shows how technologies can support music therapy but, more importantly, how they can create new application possibilities and potential future developments. From this perspective, the music therapist assumes a role that goes beyond music interaction and explores novel technology applications with the idea of discovering new resources applicable to therapeutic music interventions. [ABSTRACT FROM AUTHOR]

Plants communicate with their fellow species, but also with other species. The communication of humans with plants, in turn, represents an old phantasm that is intended to lead to contact with the seemingly mute creatures. This article revisits the history of plant cognition from a media theory perspective. The article questions the extent to which media and electricity have historically been and are currently leitmotifs for entering into resonance with plants. The focus is on media-historical and science-historical approaches that have conferred to plants the ability to communicate and on current sensor interfaces through which plants are turned into sound in media art. The article argues that, whenever media technology makes plants ‘speak’, what the human listener actually hears is the medium, not the plant, because it is a human construct.

As an embodied and spatial medium, virtual reality is proving an attractive proposition for robot teleoperation in hazardous environments. This paper examines a nuclear decommissioning scenario in which a simulated team of semi-autonomous robots are used to characterise a chamber within a virtual nuclear facility. This study examines the potential utility and impact of sonification as a means of communicating salient operator data in such an environment. However, the question of what sound should be used and how it can be applied in different applications is far from resolved. This paper explores and compares two sonification design approaches. The first is inspired by the theory of cognitive metaphor to create sonifications that align with socially acquired contextual and ecological understanding of the application domain. The second adopts a computationalist approach using auditory mappings that are commonplace in the literature. The results suggest that the computationalist approach outperforms the cognitive metaphor approach in terms of predictability and mental workload. However, qualitative data analysis demonstrates that the cognitive metaphor approach resulted in sounds that were more intuitive, and were better implemented for spatialisation of data sources and data legibility when there was more than one sound source. [ABSTRACT FROM AUTHOR]

The aim of this study was to evaluate the effect of ultrasound used as a preliminary treatment and drying temperature on the properties of dried apples (var. Golden Delicious). The aim of the work was also to optimise the process in terms of reducing the drying time and obtaining a product with specific properties. The apple tissue was sonicated for various times from 30 to 60 min. Then, the tissue was air-dried with a constant air flow of 55 to 85 °C. The work determined the dry substance content, water activity, colour parameters, content, antioxidant activity, and hygroscopicity of the dried material. The drying kinetics were also analysed. The results showed that the decrease in sonification time increased the dry matter content and reduced water activity. Also, the decrease in drying temperature caused a smaller intake of water and led to a lower hygroscopicity of dried apples. The selected parameters of the process had a positive effect on the preservation of bioactive compounds and led to an increase in antioxidant activity. Experimental results were adapted by a second-order polynomial model, where analysis of variance was utilized to define optimal drying conditions. Therefore, considering the shortest drying time, the lowest colour difference, ΔE, and the highest antioxidant activity, the best condition for the drying of apple tissue can be obtained with the application of 30 min of samples sonication and drying of apples at a temperature of 80.9 °C. [ABSTRACT FROM AUTHOR]

AbstractThis paper explores the design, evaluation, and formalisation of a framework for the creation of soundscape sonifications: data-to-sound mappings which make use of sounds recorded from real-world sources to communicate information to a listener. This approach is informed by design principles from the field of embodied cognitive science. It opens with a consideration of the relationship between soundscapes, sonification, and embodied cognition design principles. Four approaches to soundscape sonification are presented and evaluated. Evaluation results are presented and analysed before the paper closes with a discussion of the findings and a formalisation of the most effective candidate framework. The article shows how embodied cognition principles can be applied to the design of communicatively effective soundscape sonifications with the takeaway point for researchers being the formalisation of an “Embodied Soundscape Sonification Framework” as a guide to the design of effective soundscape sonifications. [ABSTRACT FROM AUTHOR]

Purpose: Visually impaired people (VIP) find it challenging to understand and gain awareness of their surroundings. Most activities require the use of the auditory or tactile senses. As such, assistive systems which are capable of aiding visually impaired people to understand, navigate and form a mental representation of their environment are extensively being studied and developed. The aim of this paper is to provide insight regarding the characteristics, as well as the advantages and drawbacks of different types of sonification strategies in assistive systems, to assess their suitability for certain use-cases. Materials and methods: To this end, we reviewed a sizeable number of assistive solutions for VIP which provide a form of auditory feedback to the user, encountered in different scientific databases (Scopus, IEEE Xplore, ACM and Google Scholar) through direct searches and cross-referencing. Results: We classified these solutions based on the aural information they provide to the VIP – alerts, guidance and information about their environment, be it spatial or semantic. Our intention is not to provide an exhaustive review, but to select representative implementations from recent literature that highlight the particularities of each sonification approach. Conclusions: Thus, anyone who is intent on developing an assistive solution will be able to choose the desired sonification class, being aware of the advantages/disadvantages and at the same time having a fairly wide selection of articles from the representative class. IMPLICATIONS FOR REHABILITATION: The motivation behind this paper is to provide an overview of sonification strategies in the context of assistive systems for the visually impaired people. Whilst surveys and reviews which provide in-depth insights into assistive technologies and sonification exist, papers which provide a combined view of these topics are rather lacking. The analysis of the selected papers provides insight regarding the characteristics of different types of sonification strategies in assistive systems for visually impaired people and their suitability for certain use-cases. [ABSTRACT FROM AUTHOR]

This paper presents the design, implementation, and evaluation of a sound installation titled "Unnatural Nature," which explores climate change through data sonification and interactivity. The installation comprises two parts: (1) immersive sonification of climate data on global temperature, CO2 concentration, Arctic and Antarctic ice sheet mass, and sea level variation, and (2) interactive engagement with physical plants using a custom sensor system. In the first part, the sonification employs a diverse range of sounds that model elements of a natural soundscape presented through higher-order Ambisonics to establish an immersive experience for the audience. In the second part, the sensor system embedded into live plants detects touch and inertial interactions that are mapped to audio and visual events. In this way, the audience is invited to reflect on our interconnectedness with nature and our active involvement in its transformation, as evidenced by the data presented in the first part of the installation. In this paper, we first discuss the implementation of our sonification, describing its technical and aesthetic development. We then offer details of our sensor system, discussing the interactive and audiovisual design of the second part of our installation. Finally, we present the results of a user study conducted to understand participants' interpretation of and engagement with the sonification and evaluate its effectiveness in conveying climate data. We also offer insights from the first public presentation of the installation, highlighting the visitors' reflections on their experiences. By merging data sonification, interactive plant art, and immersive audio, "Unnatural Nature" aims to foster environmental awareness, evoke emotional engagement with the subject matter, and encourage participation in climate change discourse. [ABSTRACT FROM AUTHOR]

One of the commonly used visualization techniques for multivariate data is the parallel coordinates plot. It provides users with a visual overview of multivariate data and the possibility to interactively explore it. While pattern recognition is a strength of the human visual system, it is also a strength of the auditory system. Inspired by the integration of the visual and auditory perception in everyday life, we introduce an audio-visual analytics design named Parallel Chords combining both visual and auditory displays. Parallel Chords lets users explore multivariate data using both visualization and sonification through the interaction with the axes of a parallel coordinates plot. To illustrate the potential of the design, we present (1) prototypical data patterns where the sonification helps with the identification of correlations, clusters, and outliers, (2) a usage scenario showing the sonification of data from non-adjacent axes, and (3) a controlled experiment on the sensitivity thresholds of participants when distinguishing the strength of correlations. During this controlled experiment, 35 participants used three different display types, the visualization, the sonification, and the combination of these, to identify the strongest out of three correlations. The results show that all three display types enabled the participants to identify the strongest correlation — with visualization resulting in the best sensitivity. The sonification resulted in sensitivities that were independent from the type of displayed correlation, and the combination resulted in increased enjoyability during usage. [ABSTRACT FROM AUTHOR]

The fabrication process of reduced graphene oxide depends on many factors (e.g., graphite precursor, methods of oxidation, reduction, and exfoliation) which have a significant influence on the properties of this material. Therefore, their selection is not easy due to the large number of possible combinations of these factors. To overcome this problem, we proposed to use a multivariate analysis of variance method of finding associations between the qualitative type of independent variables and the quantitative type of dependent variable. Using ANOVA, we showed that the combination (interaction) of these variables is more important than the individual influence of the variables on the fabricated rGO. Knowing how the particular variables and their combinations affect the properties of rGO, it is easier to plan the fabrication process of this material. In this paper, we analyzed the number of oxide layers and designated the most promising oxides in terms of sensor gas application. Independently, we fabricated chemiresistor sensors and studied their response to NO2 in the analyzed atmosphere. We were able to combine the experimental results with statistical analysis indicating which oxidation methods and which graphite precursors will provide the best sensitivity. [ABSTRACT FROM AUTHOR]

This paper presents a simple method to transform two‐dimensional data sets into a format that can be easily processed into sound files. These files can be loaded into software wavetable synthesizers to create audible forms of data that can represent complex information. Some background about sonification will be discussed, and the simple method developed here will be applied to graphene optoelectronics. Some key illustrative examples will be used to demonstrate the method, including data sets from previous work on light emission from graphene field effect transistors. We use the sonification method to show how changes in observed phenomena (e.g., light emission intensity and spectral shape) result in changes of the resulting sound (such as the timbre). Demonstrations are included in video format to hear and illustrate the method and resulting effects. [ABSTRACT FROM AUTHOR]

Sonification, or the practice of generating sound from data, is a promising alternative or complement to data visualization for exploring research questions in the life sciences. Expressing or communicating data in the form of sound rather than graphs, tables, or renderings can provide a secondary information source for multitasking or remote monitoring purposes or make data accessible when visualizations cannot be used. While popular in astronomy, neuroscience, and geophysics as a technique for data exploration and communication, its potential in the biological and biotechnological sciences has not been fully explored. In this review, we introduce sonification as a concept, some examples of how sonification has been used to address areas of interest in biology, and the history of the technique. We then highlight a selection of biology‐related publications that involve sonifications of DNA datasets and protein datasets, sonifications for data collection and interpretation, and sonifications aimed to improve science communication and accessibility. Through this review, we aim to show how sonification has been used both as a discovery tool and a communication tool and to inspire more life‐science researchers to incorporate sonification into their own studies. [ABSTRACT FROM AUTHOR]

IntroductionThe present article reports on a case study aimed at improving STEAM education in secondary schools. It discusses the use of sonification as a teaching strategy to integrate music into science learning, using different approaches from data audification to parameter mapping into aural models and to the rewriting of song lyrics based on STEM topics.MethodsA qualitative research study has been performed in a secondary school in the school district of Bari (South of Italy). More specifically, students’ and experts’ perceptions of experienced sonification activities have been collected through six rounds of focus group interviews.ResultsWhile there was a good improvement in student achievement in science, it is worth noting how musical activities also led to some benefits for students involved in the sonification workshops. The integration of music with STEM disciplines has promoted more cooperation and empathy among the students. Additionally, musical inputs can help students discover and regain interest in music. However, the study also highlighted the differences in teacher training and content knowledge, suggesting the need for future research to consider broader samples and experimental designs.DiscussionResults and implications for educational research and practice are discussed considering the recent literature on STEAM. Finally, this study demonstrates the importance of a robust instructional design for sonification activities, so that they can be more effective, aligned with the school curriculum, and integrated into the classroom teaching-learning process.

Introduction: Skin cancer (SC) is common in fair skin (FS) at a 1:5 lifetime incidence for nonmelanoma skin cancer. In order to assist clinicians’ decisions, a risk intervention technology was developed, which combines a dual-mode machine learning of visual and sonified (pixel to sound) data. The addition of an audio technology enhances malignant features of lesions, increases sensitivity and was previously validated under a prospective clinical setting in FS. In dark skin (DS), although rare by a 10–30 factor, skin cancer is diagnosed at more advanced stages resulting in a delayed diagnosis and affecting life quality and expectancy. It is known as well that SC diagnostic accuracy by machine learning in DS is decreased as compared to FS. The present study tests the use of sonification aided by artificial intelligence algorithms to compare diagnostics of different skin tones. Methodology: Biopsy-validated smartphone images were diagnosed in a retrospective study by a dual audio-visual convoluted neural network. A total of 60 Fitzpatrick I-III were compared to 72 Fitzpatrick IV-VI. A dichotomous diagnostic output, either malignant or benign, was assessed for sensitivity, specificity and area under the curves (AUCs) for the receiver operating characteristic (ROC) curve. Results: ROC curve analytics indicated an AUC of 0.858 (95% CI: 0.795–0.921) and 0.856 (95% CI: 0.759–0.953) for fair and DS (p = NS). Sensitivity of Fitzpatrick I-III skin and Fitzpatrick IV-VI were 84.4% (71.8–96.9) and 79.6% (63.4–93.8), respectively (p = NS). Specificity of Fitzpatrick I-III skin and Fitzpatrick IV-VI were 84.2% (72.6–95.8) and 85.3% (73.4–97.2), respectively (p = NS). The positive predictive and negative predictive values as well as accuracy (0.817 vs. 0.847) were all within the same range (p = NS). Conclusions: The results demonstrate that the dual-modality classifier identifies skin cancer of FS and DS similarly well. Sonification of malignant signs of a skin lesion demonstrates promising results, even with smartphone images, which should be considered as a tool to achieve more effective and accessible healthcare. [ABSTRACT FROM AUTHOR]

The field of EEG-Neurofeedback (EEG-NF) training has showcased significant promise in treating various mental disorders, while also emerging as a cognitive enhancer across diverse applications. The core principle of EEG-NF involves consciously guiding the brain in desired directions, necessitating active engagement in neurofeedback (NF) tasks over an extended period. Music listening tasks have proven to be effective stimuli for such training, influencing emotions, mood, and brainwave patterns. This has spurred the development of musical NF systems and training protocols. Despite these advancements, there exists a gap in systematic literature that comprehensively explores and discusses the various modalities of feedback mechanisms, its benefits, and the emerging applications. Addressing this gap, our review article presents a thorough literature survey encompassing studies on musical NF conducted over the past decade. This review highlights the several benefits and applications ranging from neurorehabilitation to therapeutic interventions, stress management, diagnostics of neurological disorders, and sports performance enhancement. While acknowledged for advantages and popularity of musical NF, there is an opportunity for growth in the literature in terms of the need for systematic randomized controlled trials to compare its effectiveness with other modalities across different tasks. Addressing this gap will involve developing standardized methodologies for studying protocols and optimizing parameters, presenting an exciting prospect for advancing the field. [ABSTRACT FROM AUTHOR]

Caulerpa racemosa, a type of green algae, has been studied for its potential health benefits, including antioxidant and antibacterial properties. The extraction of bioactive compounds from marine algae using green solvents like Deep Eutectic Solvents (DES) has gained interest due to their efficiency and environmental friendliness. This research aimed to determine the potential antioxidant activity of C. racemosa extract using DES solvents and different sonication times as an antibacterial against pathogenic bacteria. The research employed a Factorial Completely Randomized Design (CRD) with two variables: sonication time (10, 20, and 30 minutes) and different DES solvents (ethanol and ethylene glycol (1:20) with 90% aquades, and methanol and glycerol (1:10) with 90% aquades. The highest antioxidant activity was found in DES Methanol-Glycerol (36.39 mg TE/g dw), followed by DES Ethanol- Ethylene glycol (28.30 mg TE/g dw), both significantly different (p<0.05). The C. racemosa extract inhibited the growth of V. parahaemolyticus with an inhibition zone of 8.08 mm at 50 ppm and 13.13 mm at 1,000 ppm. For V. harveyi, inhibition started at 6.37 mm at 50 ppm, reaching 11.70 mm at 1,000 ppm. DES Methanol-Glycerol with a 10-minute sonication provided the highest antioxidant activity and effectively inhibited V. parahaemolyticus and V. harveyi. Extraction of C. racemosa with DES-MG solvent and varying sonication times influences its antioxidant activity and antibacterial properties. [ABSTRACT FROM AUTHOR]

Movement sonification has emerged as a promising approach for rehabilitation and motion control. Despite significant advancements in sensor technologies, challenges remain in developing cost-effective, user-friendly, and reliable systems for gait detection and sonification. This study introduces a novel wearable personalised sonification and biofeedback device to enhance movement awareness for individuals with irregular gait and posture. Through the integration of inertial measurement units (IMUs), MATLAB, and sophisticated audio feedback mechanisms, the device offers real-time, intuitive cues to facilitate gait correction and improve functional mobility. Utilising a single wearable sensor attached to the L4 vertebrae, the system captures kinematic parameters to generate auditory feedback through discrete and continuous tones corresponding to heel strike events and sagittal plane rotations. A preliminary test that involved 20 participants under various audio feedback conditions was conducted to assess the system's accuracy, reliability, and user synchronisation. The results indicate a promising improvement in movement awareness facilitated by auditory cues. This suggests a potential for enhancing gait and balance, particularly beneficial for individuals with compromised gait or those undergoing a rehabilitation process. This paper details the development process, experimental setup, and initial findings, discussing the integration challenges and future research directions. It also presents a novel approach to providing real-time feedback to participants about their balance, potentially enabling them to make immediate adjustments to their posture and movement. Future research should evaluate this method in varied real-world settings and populations, including the elderly and individuals with Parkinson's disease. [ABSTRACT FROM AUTHOR]

In this study, we examine different approaches to the presentation of Y coordinates in mobile auditory graphs, including the representation of negative numbers. These studies involved both normally sighted and visually impaired users, as there are applications where normally sighted users might employ auditory graphs, such as the unseen monitoring of stocks, or fuel consumption in a car. Multi-reference sonification schemes are investigated as a means of improving the performance of mobile non-visual point estimation tasks. The results demonstrated that both populations are able to carry out point estimation tasks with a good level of performance when presented with auditory graphs using multiple reference tones. Additionally, visually impaired participants performed better on graphs represented in this format than normally sighted participants. This work also implements the component representation approach for negative numbers to represent the mapping by using the same positive mapping reference for the digit and adding a sign before the digit which leads to a better accuracy of the polarity sign. This work contributes to the areas of the design process of mobile auditory devices in human-computer interaction and proposed a methodological framework related to improving auditory graph performance in graph reproduction. [ABSTRACT FROM AUTHOR]

Computer Algebra Systems (CAS) currently lack an effective auditory representation, with most existing solutions relying on screen readers that provide limited functionality. This limitation prevents blind users from fully understanding and interpreting mathematical expressions, leading to confusion and self-doubt. This paper addresses the challenges blind individuals face when comprehending mathematical expressions within a CAS environment. We propose "Math for Everybody" (Math4e, version 1.0), a software module to reduce barriers for blind users in education. Math4e is a Sonification Module for CAS that generates a series of auditory tones, prosodic cues, and variations in audio parameters such as volume and speed. These resources are designed to eliminate ambiguity and facilitate the interpretation and understanding of mathematical expressions for blind users. To assess the effectiveness of Math4e, we conducted standardized tests employing the methodologies outlined in the Software Engineering Body of Knowledge (SWEBOK), International Software Testing Qualifications Board (ISTBQ), and ISO/IEC/IEEE 29119. The evaluation encompassed two scenarios: one involving simulated blind users and another with real blind users associated with the "Asociación de Invidentes Milton Vedado" foundation in Ecuador. Through the SAM methodology and verbal surveys (given the condition of the evaluated user), results are obtained, such as 90.56% for pleasure, 90.78% for arousal, and 91.56% for dominance, which demonstrates significant acceptance of the systems by the users. The outcomes underscored the users' commendable ability to identify mathematical expressions accurately. [ABSTRACT FROM AUTHOR]

Copyright of Journal of Computer-Aided Design & Computer Graphics / Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao is the property of Gai Kan Bian Wei Hui and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Molecular dynamics (MD) simulations study the trajectories of hundreds of atoms over tens of thousands of steps. Atom hops in crystalline ionic conductors are distinguishable events between discrete and well-defined sites in the crystal. A procedure to sonify information on such atom hops was developed. Changes in atom coordinate values are converted to a non-negative hopping signal, and sudden changes caused by hopping are detected as peaks in the signal. Atom hops can be ‘heard’ by using the hopping signal as an envelope of an arbitrary audio signal. Identifying where, when and how often atoms hop is much easier using audio information compared to using a video image of moving atoms. Superimposing sounds with different frequencies provide information on the hopping of different groups of atoms, and translating imperceptible scientific phenomena into a piece of appealing artistic audio performance may be appraised by the general public.

Abstract Background A major challenge of evolutionary biology is making underlying concepts accessible to wide audiences. One method for doing so is to utilise multi-media formats that have potential to engage and inform through entertainment. This pilot study outlines and discusses a sonification concert that integrated musical performance with a range of evolutionary concepts and ideas fundamental to an understanding of evolution, such as protein sequences. We aimed to showcase sound-art objects and live-coding performances created using sonification as a mechanism for presenting complex biological processes to both researcher and non-researchers. We sought to evaluate the effectiveness of this art-adjacent practice for public engagement with evolutionary biology research, and also to gather feedback to guide future events. Toward this end, we held a live concert showcasing biologically-based algorithmic music exploring links between evolutionary biology research, sound art, and musical performance. The event had three main acts: a generative audio-visual piece giving an artistic representation of SARS coronavirus based on a parameter-mapping sonification of protein sequence of the replicase polyprotein; a pre-recorded string ensemble demonstrating the effects of codon selection on translation speed using parameter-mapping sonification; and a live-coded music piece interactively sonifying protein structures. Results Our event attracted 90 attendees. We evaluated success using direct observation and written feedback forms with a 58% response rate: 95% of respondents stated they had enjoyed the event and 63% indicated they were inspired by it. Conclusions Presenting the sonic outputs of sonification research in a concert format showed good potential for the pursuit of public engagement with evolutionary biology research, demonstrating the ability to engage curiosity and inspire an audience while also conveying scientific content alongside the nuanced and complex world of modern evolutionary biology.

People with Parkinson's disease often show deficits in dexterity, which, in turn, can lead to limitations in performing activities of daily life. Previous studies have suggested that training in playing the piano may improve or prevent a decline in dexterity in this population. In this pilot study, we tested three participants on a six-week, custom, piano-based training protocol, and quantified dexterity before and after the intervention using a sensor-enabled version of the nine-hole peg test, the box and block test, a test of finger synergies using unidimensional force sensors, and the Quantitative Digitography test using a digital piano, as well as selected relevant items from the motor parts of the MDS-Unified Parkinson's Disease Rating Scale (MDS-UPDRS) and the Parkinson's Disease Questionnaire (PDQ-39) quality of life questionnaire. The participants showed improved dexterity following the training program in several of the measures used. This pilot study proposes measures that can track changes in dexterity as a result of practice in people with Parkinson's disease and describes a potential protocol that needs to be tested in a larger cohort. [ABSTRACT FROM AUTHOR]

The Augmented Reality (AR) techniques for the buyer's industry are established and suitable for multiple uses. As seen in the wellness sector, with more publications on the use of augmented reality in surgery, medicine, and rehabilitation, there is a high demand for solutions that can enhance clinical practice. This paper aims to offer technicians, computer scientists, and users an overview of AR technologies' possibility of developing beneficial applications shortly. This paper explores the foundational components and development methodologies crucial to effective Medical Augmented Reality Systems (MARS). It also aims to guide academic research toward overcoming technological and human-factor issues in current devices and popular modalities for enriching visual sensations with computer-generated elements. Six submissions have been accepted after being assessed by authorities in their academic fields. This paper presents examples of uses for medical treatment, spanning interactions between physicians and patients, surgery, rehabilitation, and fear treatments. This paper illustrates the framework's application and its potential to revolutionize medical practices, fostering interdisciplinary collaboration between technology and healthcare domains. [ABSTRACT FROM AUTHOR]

Background: A major challenge of evolutionary biology is making underlying concepts accessible to wide audiences. One method for doing so is to utilise multi-media formats that have potential to engage and inform through entertainment. This pilot study outlines and discusses a sonification concert that integrated musical performance with a range of evolutionary concepts and ideas fundamental to an understanding of evolution, such as protein sequences. We aimed to showcase sound-art objects and live-coding performances created using sonification as a mechanism for presenting complex biological processes to both researcher and non-researchers. We sought to evaluate the effectiveness of this art-adjacent practice for public engagement with evolutionary biology research, and also to gather feedback to guide future events. Toward this end, we held a live concert showcasing biologically-based algorithmic music exploring links between evolutionary biology research, sound art, and musical performance. The event had three main acts: a generative audio-visual piece giving an artistic representation of SARS coronavirus based on a parameter-mapping sonification of protein sequence of the replicase polyprotein; a pre-recorded string ensemble demonstrating the effects of codon selection on translation speed using parameter-mapping sonification; and a live-coded music piece interactively sonifying protein structures. Results: Our event attracted 90 attendees. We evaluated success using direct observation and written feedback forms with a 58% response rate: 95% of respondents stated they had enjoyed the event and 63% indicated they were inspired by it. Conclusions: Presenting the sonic outputs of sonification research in a concert format showed good potential for the pursuit of public engagement with evolutionary biology research, demonstrating the ability to engage curiosity and inspire an audience while also conveying scientific content alongside the nuanced and complex world of modern evolutionary biology. [ABSTRACT FROM AUTHOR]

This paper presents interdisciplinary research exploring the development of inclusive multisensory science books, communicating immunology data for blind, low‐vision and diverse‐needs audiences. The research adopted an inductive theory‐building approach, practice‐based art methods and music and design methods, leveraging the lived experience of a legally blind artist. The research also involved designers and scientists in a cocreation process, producing books that incorporate tactile artworks, Braille‐inspired protein models, image sonification and interaction. Two multisensory book titles, "The Heroes Within You: A Multisensory Exploration of Infection and Immunity" and "My Goodness: A Multisensory Exploration of Nutrition and Immunity", were developed for the Monash Sensory Science 2023 Exhibition Day. The books offer an innovative way to make science and art more accessible and engaging, addressing the limitations of traditional museum methods. Feedback from audiences has been positive, emphasizing the fascination, sensory engagement and ease of understanding. This paper highlights the potential for an interdisciplinary and inclusive approach to science and art, demonstrating the value of multisensory books as tools for science communication. The findings highlight the positive reception of this novel approach and suggest its potential for broader applications, promoting inclusivity and accessibility. [ABSTRACT FROM AUTHOR]

Background: Students who are blind are integrated into public schools in many countries, yet are often excluded from full participation in science since most learning materials are visual. To create a compensatory route, an existing model‐based inquiry‐learning environment was adapted by means of sonification (addition of non‐speech sounds that represent dynamic information). The learning environment uses agent‐based models and a complex systems approach to teach the Kinetic Molecular Theory (KMT) and Gas Laws. The models are accompanied by a workbook consisting of text (printed or auditory) and images (printed or tactile). Objectives: The current research examined whether such perceptual compensation creates a comparable learning environment for learners who are blind compared with learners who are sighted using the original learning environment. The aim of the study is to expand knowledge about how the auditory channel may compensate the visual channel among individuals who are blind. Methods: Conceptual learning in science and reasoning about complex systems were assessed using pre‐ and post‐questionnaires. To explore learners' learning progression throughout the unit, four progression analysis 'windows' were selected. These were groups of adjacent or nearly adjacent items in the workbook that permitted a glimpse of learners' progression. Results: The sonified environment not only supported the learning of learners who are blind compared with the learning of learners who are sighted using visual material, but even furthered their learning with respect to diffusion, one of the more challenging concepts in KMT. It seems the types of sonified representations used in this study increased listeners' sensitivity to the micro‐level interactions in a way less accessible in visual representations. Takeaways: Sonified environments can be provide learners who are blind with equitable participation by compensating and complementing the visual channel. Sonification can have implications for students who are blind as well as students who are sighted. Lay Description: What is already known: Sonification is the use of non‐speech sounds to represent dynamic information. Sonification can potentialy be used to allow equitable participation for students who are blind. What this paper adds: To test this, the study compared the outcomes of learners who are blind who used a sonified learning environment (L2C) to that of learners who are sighted who used a visual environment. Implications for practice: Learners who are blind showed equal or better learning outcomes using the sonified models compared with the learners who are sighted using the visual models. There are major implications for integrating students who are blind in public school classrooms. [ABSTRACT FROM AUTHOR]

Objective: Auditory enhancements to the pulse oximetry tone may help clinicians detect deviations from target ranges for oxygen saturation (SpO2) and heart rate (HR). Background: Clinical guidelines recommend target ranges for SpO2 and HR during neonatal resuscitation in the first 10 minutes after birth. The pulse oximeter currently maps HR to tone rate, and SpO2 to tone pitch. However, deviations from target ranges for SpO2 and HR are not easy to detect. Method: Forty-one participants were presented with 30-second simulated scenarios of an infant's SpO2 and HR levels in the first minutes after birth. Tremolo marked distinct HR ranges and formants marked distinct SpO2 ranges. Participants were randomly allocated to conditions: (a) No Enhancement control, (b) Enhanced HR Only, (c) Enhanced SpO2 Only, and (d) Enhanced Both. Results: Participants in the Enhanced HR Only and Enhanced SpO2 Only conditions identified HR and SpO2 ranges, respectively, more accurately than participants in the No Enhancement condition, ps < 0.001. In the Enhanced Both condition, the tremolo enhancement of HR did not affect participants' ability to identify SpO2 range, but the formants enhancement of SpO2 may have attenuated participants' ability to identify tremolo-enhanced HR range. Conclusion: Tremolo and formant enhancements improve range identification for HR and SpO2, respectively, and could improve clinicians' ability to identify SpO2 and HR ranges in the first minutes after birth. Application: Enhancements to the pulse oximeter tone to indicate clinically important ranges could improve the management of oxygen delivery to the neonate during resuscitation in the first 10 minutes after birth. [ABSTRACT FROM AUTHOR]

In this study, we examine different approaches to the presentation of Y coordinates in mobile auditory graphs, including the representation of negative numbers. These studies involved both normally sighted and visually impaired users, as there are applications where normally sighted users might employ auditory graphs, such as the unseen monitoring of stocks, or fuel consumption in a car. Multi-reference sonification schemes are investigated as a means of improving the performance of mobile non-visual point estimation tasks. The results demonstrated that both populations are able to carry out point estimation tasks with a good level of performance when presented with auditory graphs using multiple reference tones. Additionally, visually impaired participants performed better on graphs represented in this format than normally sighted participants. This work also implements the component representation approach for negative numbers to represent the mapping by using the same positive mapping reference for the digit and adding a sign before the digit which leads to a better accuracy of the polarity sign. This work contributes to the areas of the design process of mobile auditory devices in human-computer interaction and proposed a methodological framework related to improving auditory graph performance in graph reproduction.

Purpose Humans interact with the environment using sensory channels. Although vision is the main sensory channel, the auditory channel is excellent for learning when trained. Movement learning via auditory inputs requires sound analysis, such as sonification. Methods Data on peak plantar pressure from 43 recreational runners were collected using Flexinfit resistive insoles. Participants wore Run Falcon 1.0 (Adidas) running shoes and were categorised into four groups: without pain; spine or hip pain; thigh or knee pain; and leg, ankle, or foot pain. Participants responded to whether they presented pain and whether it was related to running (training or races). Sonification data were collected using the TwoTone software. We used the C note in the first octave to transform numerical data into sounds according to the pressure magnitude. The sound file was decomposed using the Audacity software into a spectrogram illustrating the main frequency components and their amplitudes. Results The spectrogram made it possible to identify qualitative differences between the runners with and without pain after running. The frequency spectrum showed that some frequencies had greater sound intensity in runners without pain. Conclusions Our results indicated differences between runners with and without pain after running using sonification. The frequency spectrum also indicated a difference in the sound intensity produced between the groups at specific frequencies.

This paper presents a new tool to help people with visual impairments learn mathematical functions through the extensive use of sounds and touch. STEM subjects like mathematics are difficult for this kind of user, since concepts like lines or curves heavily depend on visual content to convey essential information. GraficiAccessibili is a mobile app that allows to draw lines and parabolas in the cartesian plane, incorporating sound and haptic feedback to make them perceivable by all users. Mathematical functions are sonified enabling users to discern the position of their points on the quarters of the cartesian plane through sound cues. Furthermore, the application assists users in exploring the cartesian plane through touch giving haptic feedback for curves and axes. In this way, the user can mentally visualize the graphical representation of the function. Tests were conducted with real users to assess the effectiveness of this approach.

To mitigate the rising threat of Android malware, researchers have been actively looking for mechanisms that will enable rapid and accurate malware detection. Recently, attention has been paid to the use of audio-based features derived through the use of music information retrieval techniques. Since the exploration of these features is still in the early stages, there is a need to continue experimentation, especially with features that have yet to be used for this task. In this paper, we present the results of an ongoing investigation into the use of audio-based features for Android malware detection. In addition to extracting new audio-based features, this research aims to find the most discriminative subset of audio-based features through a comparative evaluation of Wrapper-based metaheuristic optimization algorithms on two separate datasets. First, we sonified the Android APK datasets, then extracted 191 static audio-based features from the resultant audio datasets. Fourteen different nature-inspired Wrapper-based metaheuristic optimization algorithms were evaluated for feature selection, and the selected features were then used to train the light gradient-boosting machine (LGBM) classification model. Experimental results demonstrate that the proposed approach exhibits high discriminative capabilities that can outperform other state-of-the-art techniques. The best outcome for Android malware detection was obtained using features selected by the Genetic Algorithm, which achieved 50.26% feature reduction and an improved classification accuracy of 99.72%.

The aim of this study was to evaluate the effect of ultrasound used as a preliminary treatment and drying temperature on the properties of dried apples (var. Golden Delicious). The aim of the work was also to optimise the process in terms of reducing the drying time and obtaining a product with specific properties. The apple tissue was sonicated for various times from 30 to 60 min. Then, the tissue was air-dried with a constant air flow of 55 to 85 °C. The work determined the dry substance content, water activity, colour parameters, content, antioxidant activity, and hygroscopicity of the dried material. The drying kinetics were also analysed. The results showed that the decrease in sonification time increased the dry matter content and reduced water activity. Also, the decrease in drying temperature caused a smaller intake of water and led to a lower hygroscopicity of dried apples. The selected parameters of the process had a positive effect on the preservation of bioactive compounds and led to an increase in antioxidant activity. Experimental results were adapted by a second-order polynomial model, where analysis of variance was utilized to define optimal drying conditions. Therefore, considering the shortest drying time, the lowest colour difference, ΔE, and the highest antioxidant activity, the best condition for the drying of apple tissue can be obtained with the application of 30 min of samples sonication and drying of apples at a temperature of 80.9 °C.

As an embodied and spatial medium, virtual reality is proving an attractive proposition for robot teleoperation in hazardous environments. This paper examines a nuclear decommissioning scenario in which a simulated team of semi-autonomous robots are used to characterise a chamber within a virtual nuclear facility. This study examines the potential utility and impact of sonification as a means of communicating salient operator data in such an environment. However, the question of what sound should be used and how it can be applied in different applications is far from resolved. This paper explores and compares two sonification design approaches. The first is inspired by the theory of cognitive metaphor to create sonifications that align with socially acquired contextual and ecological understanding of the application domain. The second adopts a computationalist approach using auditory mappings that are commonplace in the literature. The results suggest that the computationalist approach outperforms the cognitive metaphor approach in terms of predictability and mental workload. However, qualitative data analysis demonstrates that the cognitive metaphor approach resulted in sounds that were more intuitive, and were better implemented for spatialisation of data sources and data legibility when there was more than one sound source.

Clinical screening tests for balance and mobility often fall short of predicting fall risk. Cognitive distractors and unpredictable external stimuli, common in busy natural environments, contribute to this risk, especially in older adults. Less is known about the effects of upper sensory– motor coordination, such as coordinating one’s hand with an external stimulus. We combined movement sonification and affordable inertial motion sensors to develop a task for the precise measurement and manipulation of full-body interaction with stimuli in the environment. In a double-task design, we studied how a supra-postural activity affected quiet stance. The supra-postural task consisted of rhythmic synchronization with a repetitive auditory stimulus. The stimulus was attentionally demanding because it was being modulated continuously. The participant’s hand movement was sonified in real time, and their goal was to synchronize their hand movement with the stimulus. In the unpredictable condition, the tempo changed at random points in the trial. A separate sensor recorded postural fluctuations. Young healthy adults were compared to older adult (OA) participants without known risk of falling. The results supported the hypothesis that supra-postural coordination would entrain postural control. The effect was stronger in OAs, supporting the idea that diminished reserve capacities reduce the ability to isolate postural control from sensory–motor and cognitive activity. [ABSTRACT FROM AUTHOR]

By using sound to visualize the real-world environment, audio games can offer a completely new game experience. In this paper, we study how audio cues can be visualized in audio games and their effects on the players' navigation skills, gaming experience, and immersion. Also, factors that impact the system performance in terms of navigation using audio components. To this end, we propose an audio game in which blindfolded players move through a physical maze with the help of audio cues. To realize this game, a sonar headset is designed and built based on ultrasonic sensors, which maps the external environment features into musical sounds. Actually, the design of the sonar headset is the result of design and research efforts. The gaming environment of this game is a physical maze, where the blindfolded players enter the maze while wearing the sonar headset. A user study was conducted to evaluate the effect of using different sound mapping techniques on navigation performance and playing experience in the game proposed in this paper. The results show that producing musical sound can lead to better navigation performance, game experience, and immersion in players. [ABSTRACT FROM AUTHOR]

Starting approximately from the beginning of the new millennium, a series of studies highlighted that auditory information deriving from biological motion can significantly influence the behavioral, cognitive and neurophysiological processes involved in the perception and execution of complex movements. In particular, it was observed that an appropriate use of sounds deriving from one's own movement promotes improvements in the movement execution itself. Two main approaches can be used, namely the sonification one or the ecological sound one; the former is based on the conversion of physiological and/or physical movement data into sound, while the latter is based on the use of auditory recordings of movement sounds as models. In the present article, some of the main applications of both approaches—especially the latter—to the domains of sport and motor rehabilitation are reviewed, with the aim of addressing two questions: Is it possible to consider rhythm as a Gestalt of human movement? If so, is it possible to build up cognitive strategies to improve/standardize movement performance from this Gestalt? As with most topics in science, a definitive answer is not possible, yet the evidence leads us to lean toward a positive answer to both questions. [ABSTRACT FROM AUTHOR]