Conference Paper, 2024

Exploring Aesthetic Qualities of Deep Generative Models through Technological (Art) Mediation

Designing Interactive Systems Conference, ISBN 9798400705830, Pages 2738-2752, 10.1145/3643834.3661498

Contributors

Sivertsen, Christian 0000-0001-6843-5009 [1] Løvlie, Anders Sundnes 0000-0003-0484-4668 [1]

Affiliations

  1. [1] IT University of Copenhagen
  2. [NORA names: ITU IT University of Copenhagen; University; Denmark; Europe, EU; Nordic; OECD]

Abstract

Deep Generative Models (DGM) have had a great impact both on visual art and broader visual culture. In this research-through-design project we investigate the use of a DGM for helping museum visitors explore the aesthetics of Edvard Munch’s art. We designed and built an interactive drawing table that allows a user to explore a StyleGAN model trained on sketches by Edvard Munch. The paper makes two novel contributions: 1. It presents a system that allows users to interact with a DGM by drawing on paper (rather than the typical text prompts used by most current systems). 2. We demonstrate how this mode and quality of interaction establish a unique perspective on Munch’s drawings as a practice. Through qualitative evaluation, we discuss how this setup led users towards a specific hermeneutic drawing strategy that enables building competency with the model and by proxy the data it is trained on. We suggest that the resulting interaction may contribute to an "education of attention" helping museum visitors to become attentive to certain visual qualities in Munch’s drawing practice. Finally, we discuss how the concepts of technological mediation and relationality are useful for designing how the output of a DGM is understood by its users.

Keywords

Deep, Edvard Munch, Munch, StyleGAN model, aesthetic quality, aesthetics, art, attention, competence, concept, concept of technological mediation, contribution, culture, data, deep generative models, drawing, drawing practice, drawing table, evaluation, generative model, impact, interaction, mediators, mode, model, museum, museum visitors, novel contributions, output, paper, perspective, practice, project, qualitative evaluation, quality, quality of interaction, relationality, setup, strategies, system, table, technological mediation, technology, users, visitors, visual arts, visual culture, visual quality

Data Provider: Digital Science