open access publication

Article, 2023

Perceptual Relevance of Haptic Feedback during Virtual Plucking, Bowing and Rubbing of Physically-Based Musical Resonators

In: Arts, ISSN 2076-0752, Volume 12, 4, Page 144, 10.3390/arts12040144

Contributors (3)

Onofrei, Marius George [1] Fontana, Federico (0000-0002-1692-2603) (Corresponding author) [2] Serafin, Stefania (0000-0001-6971-1132) [1]

Affiliations

  1. [1] Aalborg University
  2. [NORA names: AAU Aalborg University; University; Denmark; Europe, EU; Nordic; OECD]
  3. [2] University of Udine
  4. [NORA names: Italy; Europe, EU; OECD]

Abstract

The physics-based design and realization of a digital musical interface asks for the modeling and implementation of the contact-point interaction with the performer. Musical instruments always include a resonator that converts the input energy into sound, meanwhile feeding part of it back to the performer through the same point. Specifically during plucking or bowing interactions, musicians receive a handful of information from the force feedback and vibrations coming from the contact points. This paper focuses on the design and realization of digital music interfaces realizing two physical interactions along with a musically unconventional one, rubbing, rarely encountered in assimilable forms across the centuries on a few instruments. Therefore, it aims to highlight the significance of haptic rendering in improving quality during a musical experience as opposed to interfaces provided with a passive contact point. Current challenges are posed by the specific requirements of the haptic device, as well as the computational effort needed for realizing such interactions without occurrence during the performance of typical digital artifacts such as latency and model instability. Both are however seemingly transitory due to the constant evolution of computer systems for virtual reality and the progressive popularization of haptic interfaces in the sonic interaction design community. In summary, our results speak in favor of adopting nowadays haptic technologies as an essential component for digital musical interfaces affording point-wise contact interactions in the personal performance space.

Keywords

Physically, artifacts, assimilable form, bowing, century, challenges, community, components, computational effort, computer systems, constant evolution, contact interaction, contact points, current challenges, design, design community, devices, digital artifacts, efforts, energy, essential component, evolution, experience, favor, feedback, force feedback, form, handful, handful of information, haptic device, haptic feedback, haptic interface, haptic rendering, haptic technology, implementation, information, input energy, instability, instrument, interaction, interaction design community, interface, latency, model instability, modeling, music interfaces, musical experience, musical instruments, musical interfaces, musicians, occurrence, paper, part, perceptual relevance, performance, performance space, performers, physical interaction, physics-based design, plucking, point, popularization, quality, reality, realization, relevance, rendering, requirements, resonator, results, rubbing, same point, significance, sound, space, specific requirements, such interactions, summary, system, technology, vibration, virtual reality