open access publication

Article, 2023

Design and Evaluation of a Multisensory Concert for Cochlear Implant Users

Arts, ISSN 2076-0752, Volume 12, 4, Page 149, 10.3390/arts12040149

Contributors

Paisa, Razvan 0000-0002-3801-3793 (Corresponding author) [1] Cavdir, Doga 0000-0003-0169-2945 [2] Ganis, Francesco 0000-0001-8146-1156 [1] Williams, Peter 0000-0003-3865-3536 [1] Percy-Smith, Lone Marianne 0000-0002-5904-3879 [3] Serafin, Stefania 0000-0001-6971-1132 [1]

Affiliations

  1. [1] Aalborg University
  2. [NORA names: AAU Aalborg University; University; Denmark; Europe, EU; Nordic; OECD];
  3. [2] Stanford University
  4. [NORA names: United States; America, North; OECD];
  5. [3] Rigshospitalet
  6. [NORA names: Capital Region of Denmark; Hospital; Denmark; Europe, EU; Nordic; OECD]

Abstract

This article describes the design, implementation, and evaluation of vibrotactile concert furniture, aiming to improve the live music experience of people with hearing loss using hearing technology such as cochlear implants (CI). The system was the result of a series of participatory design sessions involving CI users with different hearing assistive setups (bi-implant, bimodal, and monoimplant), and it was evaluated in a concert scenario (drums, bass, and female vocals) at the Royal Danish Academy of Music. The project aimed to improve the music appreciation for CI users by providing a multisensory concert designed with CI challenges in mind, but not excluding normal-hearing individuals or individuals with other forms of hearing aids from participating in the event. The evaluation was based on (video-recorded) observations and postexperience semistructured interviews; the data were analyzed using event analysis and meaning condensation. The results indicate that tactile augmentation provides a pleasant experience for CI users. However, concertgoers with residual hearing reported being overwhelmed if the tactile stimulation amplitude exceeds a certain threshold. Furthermore, devices that highlight instrument segregation are preferred over ones that present a tactile mixdown of multiple auditory streams.

Keywords

AIDS, Academy of Music, CI challenges, CI users, Cochlear, Multisensory, Royal, amplitude, analysis, appreciation, article, auditory streams, augmentation, challenges, cochlear implant users, cochlear implantation, concertgoers, concerts, condensation, data, design, design sessions, devices, evaluation, event analysis, events, experiences of people, experiments, furniture, hearing, hearing aids, hearing loss, hearing technology, implant users, implantation, implementation, individuals, instrument, interviews, live music experiences, loss, meaning condensation, music, music appreciation, normal-hearing individuals, observations, participatory design sessions, people, pleasant experience, postexperiment, project, residual hearing, results, segregation, sessions, setup, stimulation amplitude, stream, system, tactile, tactile augmentation, technology, threshold, users

Funders

  • Andersen (United States)

Data Provider: Digital Science