Sonification
View article
A Review on the Relationship Between Sound and Movement in Sports and Rehabilitation Open
The role of auditory information on perceptual-motor processes has gained increased interest in sports and psychology research in recent years. Numerous neurobiological and behavioral studies have demonstrated the close interaction between…
View article
<i>Go-with-the-Flow</i>: Tracking, Analysis and Sonification of Movement and Breathing to Build Confidence in Activity Despite Chronic Pain Open
Chronic (persistent) pain (CP) affects 1 in 10 adults; clinical resources are insufficient, and anxiety about activity restricts lives. Technological aids monitor activity but lack necessary psychological support. This article proposes a n…
View article
Movement Sonification: Effects on Motor Learning beyond Rhythmic Adjustments Open
Motor learning is based on motor perception and emergent perceptual-motor representations. A lot of behavioral research is related to single perceptual modalities but during last two decades the contribution of multimodal perception on mot…
View article
Sensori-Motor Learning with Movement Sonification: Perspectives from Recent Interdisciplinary Studies Open
This article reports on an interdisciplinary research project on movement sonification for sensori-motor learning. First, we describe different research fields which have contributed to movement sonification, from music technology includin…
View article
Sonification of Arm Movements in Stroke Rehabilitation – A Novel Approach in Neurologic Music Therapy Open
Gross motor impairments are common after stroke, but efficient and motivating therapies for these impairments are scarce. We present an innovative musical sonification therapy, especially designed to retrain patients' gross motor functions…
View article
Supporting Everyday Function in Chronic Pain Using Wearable Technology Open
While most rehabilitation technologies target situated exercise sessions and associated performance metrics, physiotherapists recommend physical activities that are integrated with everyday functioning. We conducted a 1-2 week home study t…
View article
WatchOut Open
Independent mobility is one of the main challenges for blind or visually impaired (BVI) people. In particular, BVI people often need to identify and avoid nearby obstacles, for example a bicycle parked on the sidewalk. This is generally ac…
View article
Comparison and Evaluation of Sonification Strategies for Guidance Tasks Open
International audience
View article
Action Observation Plus Sonification. A Novel Therapeutic Protocol for Parkinson’s Patient with Freezing of Gait Open
Freezing of gait (FoG) is a disabling symptom associated with falls, with little or no responsiveness to pharmacological treatment. Current protocols used for rehabilitation are based on the use of external sensory cues. However, cued stra…
View article
Dermoscopy diagnosis of cancerous lesions utilizing dual deep learning algorithms via visual and audio (sonification) outputs: Laboratory and prospective observational studies Open
Adding a second stage of processing, which includes a deep learning algorithm of sonification and heuristic inspection with machine learning, significantly improves diagnostic accuracy. A combined two-stage system is expected to assist cli…
View article
Using Data Sonification to Overcome Science Literacy, Numeracy, and Visualization Barriers in Science Communication Open
Sharing the complex narratives within scientific data in an intuitive fashion has proven difficult, especially for communicators endeavoring to reach a wide audience comprised of individuals with differing levels of scientific knowledge an…
View article
The Ambisonic Recordings of Typical Environments (ARTE) Database Open
Everyday listening environments are characterized by far more complex spatial, spectral and temporal sound field distributions than the acoustic stimuli that are typically employed in controlled laboratory settings. As such, the reproducti…
View article
Stereosonic vision: Exploring visual-to-auditory sensory substitution mappings in an immersive virtual reality navigation paradigm Open
Sighted people predominantly use vision to navigate spaces, and sight loss has negative consequences for independent navigation and mobility. The recent proliferation of devices that can extract 3D spatial information from visual scenes op…
View article
Is Sonification Doomed to Fail? Open
Despite persistent research and design efforts over the last twenty years, widespread adoption of sonification to display complex data has largely failed to materialize, and many of the challenges to successful sonification identified in t…
View article
HindSight Open
Our perception of our surrounding environment is limited by the constraints of human biology. The field of augmented perception asks how our sensory capabilities can be usefully extended through computational means. We argue that spatial a…
View article
More Feedback Is Better than Less: Learning a Novel Upper Limb Joint Coordination Pattern with Augmented Auditory Feedback Open
Motor learning is a process whereby the acquisition of new skills occurs with practice, and can be influenced by the provision of feedback. An important question is what frequency of feedback facilitates motor learning. The guidance hypoth…
View article
Mini-Map for Gamers Who Walk and Teleport in a Virtual Stronghold Open
Studies of the effectiveness of multimedia cartography products may include mini-map design for navigation. In this study, we have touched upon designing gameplay to indicate the impact of the mini-map on the time effectiveness of a player…
View article
Musical Sonification of Arm Movements in Stroke Rehabilitation Yields Limited Benefits Open
Neurologic music therapy in rehabilitation of stroke patients has been shown to be a promising supplement to the often strenuous conventional rehabilitation strategies. The aim of this study was threefold: (i) replicate results from a prev…
View article
Interactive sonification of U-depth images in a navigation aid for the visually impaired Open
In this paper we propose an electronic travel aid system for the visually impaired that utilizes interactive sonification of U-depth maps of the environment. The system is comprised of a depth sensor connected to a mobile device and a dedi…
View article
An auditory display tool for DNA sequence analysis Open
This study presents a proof-of-concept that some properties of a DNA sequence can be identified through sonification alone and argues for their inclusion within the toolkit of DNA sequence browsers as an adjunct to existing visual and anal…
View article
Haptic Feedback to Assist Blind People in Indoor Environment Using Vibration Patterns Open
Feedback is one of the significant factors for the mental mapping of an environment. It is the communication of spatial information to blind people to perceive the surroundings. The assistive smartphone technologies deliver feedback for di…
View article
Mapping Sonification for Perception and Action in Motor Skill Learning Open
OPINION article Front. Neurosci., 21 August 2017Sec. Neuroprosthetics Volume 11 - 2017 | https://doi.org/10.3389/fnins.2017.00463
View article
Combining VR Visualization and Sonification for Immersive Exploration of Urban Noise Standards Open
Urban traffic noise situations are usually visualized as conventional 2D maps or 3D scenes. These representations are indispensable tools to inform decision makers and citizens about issues of health, safety, and quality of life but requir…
View article
3Mo: A Model for Music-Based Biofeedback Open
In the domain of sports and motor rehabilitation, it is of major importance to regulate and control physiological processes and physical motion in most optimal ways. For that purpose, real-time auditory feedback of physiological and physic…
View article
On the Auditory-Proprioception Substitution Hypothesis: Movement Sonification in Two Deafferented Subjects Learning to Write New Characters Open
The aim of this study was to evaluate the compensatory effects of real-time auditory feedback on two proprioceptively deafferented subjects. The real-time auditory feedback was based on a movement sonification approach, consisting of trans…
View article
RESonance: Lightweight, Room-Scale Audio-Visual Biofeedback for Immersive Relaxation Training Open
Biofeedback systems enable the users' awareness of their internal health status by displaying their physiological signal, and further facilitate them to move toward self-regulation and behavior change. Single-modal biofeedback display can …
View article
Exploring maps by sounds: using parameter mapping sonification to make digital elevation models audible Open
This study empirically investigates the potential of auditory displays for spatial data exploration, as an additional means to broaden the accessibility and dissemination of geographic information for a diverse body of users. In a mixed fa…
View article
Sonification: Review of Auditory Display Solutions in Electronic Travel Aids for the Blind Open
Sonification is defined as presentation of information by means of non-speech audio. In assistive technologies for the blind, sonification is most often used in electronic travel aids (ETAs) - devices which aid in independent mobility thro…
View article
SONIGait: a wireless instrumented insole device for real-time sonification of gait Open
The treatment of gait disorders and impairments are major challenges in physical therapy. The broad and fast development in low-cost, miniaturized, and wireless sensing technologies supports the development of embedded and unobtrusive syst…
View article
Sonification as Concurrent Augmented Feedback for Motor Skill Learning and the Importance of Mapping Design Open
There is a whole body of research that provides evidence that the motor system plays a crucial role in controlling as well as perceiving movements. So far a lot of evidence for the interaction of action and perception derives from studies …