-
Proceedings of The first international workshop on eXplainable AI for the Arts (XAIxArts)
Authors:
Nick Bryan-Kinns,
Corey Ford,
Alan Chamberlain,
Steven David Benford,
Helen Kennedy,
Zijin Li,
Wu Qiong,
Gus G. Xia,
Jeba Rezwana
Abstract:
This first international workshop on explainable AI for the Arts (XAIxArts) brought together a community of researchers in HCI, Interaction Design, AI, explainable AI (XAI), and digital arts to explore the role of XAI for the Arts.
Workshop held at the 15th ACM Conference on Creativity and Cognition (C&C 2023).
This first international workshop on explainable AI for the Arts (XAIxArts) brought together a community of researchers in HCI, Interaction Design, AI, explainable AI (XAI), and digital arts to explore the role of XAI for the Arts.
Workshop held at the 15th ACM Conference on Creativity and Cognition (C&C 2023).
△ Less
Submitted 10 October, 2023;
originally announced October 2023.
-
Interactive Rainbow Score: A Visual-centered Multimodal Flute Tutoring System
Authors:
Daniel Chin,
Yian Zhang,
Tianyu Zhang,
Jake Zhao,
Gus G. Xia
Abstract:
Learning to play an instrument is intrinsically multimodal, and we have seen a trend of applying visual and haptic feedback in music games and computer-aided music tutoring systems. However, most current systems are still designed to master individual pieces of music; it is unclear how well the learned skills can be generalized to new pieces. We aim to explore this question. In this study, we cont…
▽ More
Learning to play an instrument is intrinsically multimodal, and we have seen a trend of applying visual and haptic feedback in music games and computer-aided music tutoring systems. However, most current systems are still designed to master individual pieces of music; it is unclear how well the learned skills can be generalized to new pieces. We aim to explore this question. In this study, we contribute Interactive Rainbow Score, an interactive visual system to boost the learning of sight-playing, the general musical skill to read music and map the visual representations to performance motions. The key design of Interactive Rainbow Score is to associate pitches (and the corresponding motions) with colored notation and further strengthen such association via real-time interactions. Quantitative results show that the interactive feature on average increases the learning efficiency by 31.1%. Further analysis indicates that it is critical to apply the interaction in the early period of learning.
△ Less
Submitted 28 April, 2020;
originally announced April 2020.
-
Music Style Transfer: A Position Paper
Authors:
Shuqi Dai,
Zheng Zhang,
Gus G. Xia
Abstract:
Led by the success of neural style transfer on visual arts, there has been a rising trend very recently in the effort of music style transfer. However, "music style" is not yet a well-defined concept from a scientific point of view. The difficulty lies in the intrinsic multi-level and multi-modal character of music representation (which is very different from image representation). As a result, de…
▽ More
Led by the success of neural style transfer on visual arts, there has been a rising trend very recently in the effort of music style transfer. However, "music style" is not yet a well-defined concept from a scientific point of view. The difficulty lies in the intrinsic multi-level and multi-modal character of music representation (which is very different from image representation). As a result, depending on their interpretation of "music style", current studies under the category of "music style transfer", are actually solving completely different problems that belong to a variety of sub-fields of Computer Music. Also, a vanilla end-to-end approach, which aims at dealing with all levels of music representation at once by directly adopting the method of image style transfer, leads to poor results. Thus, we vitally propose a more scientifically-viable definition of music style transfer by breaking it down into precise concepts of timbre style transfer, performance style transfer and composition style transfer, as well as to connect different aspects of music style transfer with existing well-established sub-fields of computer music studies. In addition, we discuss the current limitations of music style modeling and its future directions by drawing spirit from some deep generative models, especially the ones using unsupervised learning and disentanglement techniques.
△ Less
Submitted 19 July, 2018; v1 submitted 19 March, 2018;
originally announced March 2018.
