Master Thesis
Master of Science thesis investigating tangible and augmented interfaces for music practice and sign-language learning.
Project
Gamified Interfaces for Music and Sign-Language Learning and Performance Enhancement brings together my work on tangible scores, augmented-mirror applications and gesture-based learning. This thesis contributed to my Master of Science qualification.
Read the full thesis
The complete master thesis is available as a PDF.
Read thesis (PDF, 35.5 MB) ↗ Download PDF ↓Research focus
The thesis investigates how interfaces can connect a representation—a written note, a target pitch or a demonstrated sign—with a physical action and immediate feedback. It considers this question through music and sign-language applications.
Prototypes, implementation and evaluation
The work brings together an interactive paper score, an American Sign Language learning game, and augmented-mirror applications for singing and theremin practice. Their implementation combines conductive-ink electronics, computer vision, temporal gesture classification, audio analysis and browser-based interfaces.
The projects use demonstrations, exercises and visual or auditory feedback to structure practice. The thesis discusses their implementation, user tests where conducted, technical constraints and directions for further development.
Its contribution is a set of implemented interfaces and an analysis of their design and use. The individual prototypes and observations do not, by themselves, establish a general improvement in long-term learning or information retention.
Full thesis and related work
The complete thesis is available through the PDF links above. Dedicated project pages document the interactive musical score, sign-language recognition and game modules, and augmented-mirror music applications in greater technical detail.