← All projects
CHI 2025 / MIT Media Lab2025

ReMirrorFugue

A CHI 2025 mixed-methods study of presence and perceived communication through recorded piano performances.

ReMirrorFugue

I am a co-author of ReMirrorFugue, a study with 28 participants examining interactions with archival performances on MirrorFugue. The installation combines an acoustic player piano with life-sized projections of the recorded pianist’s hands and body.

Read the CHI 2025 paper ↗

Role

Co-author.

Method

Wearables, questionnaires and interviews with 28 participants.

Installation

Player piano with life-sized recorded projection.

01

Research questions

The study examined how an interface can evoke a person’s presence across time. It asked how participants interpreted recorded performances, how an existing relationship with the pianist affected that experience, and how the pianist being living or deceased shaped the response.

02

Study design

Twenty-eight participants experienced four archival performances on MirrorFugue. The mixed-methods protocol combined questionnaires and semi-structured interviews with wearable measurements of electrodermal activity, heart rate and hand movement.

03

Reported findings

Participants reported a strong sense of the pianist’s presence despite knowing that the performance was recorded. Some who improvised alongside a recording described an illusory sense of two-way communication. Existing relationships and the pianist’s vital status shaped participants’ memories, interpretations and emotional responses.

04

Contribution and interpretation

The paper contributes empirical evidence on social presence across time, with implications for interfaces involving memory and recorded human performance. The reported communication is an experience described by participants; the installation plays archival material and does not provide a live or reciprocal exchange with the recorded pianist.

05

Publication

Xiao Xiao, Hayoun Noh, Adrien Lefevre, Lucy Li, Holly McKee, Alaa Algargoosh and Hiroshi Ishii. ReMirrorFugue: Examining the Emotional Experience of Presence and (Illusory) Communications Across Time. CHI Conference on Human Factors in Computing Systems, 2025. DOI: 10.1145/3706598.3713328.